immich-app/immich
1
0
Fork 0
mirror of https://github.com/immich-app/immich.git synced 2026-07-25 14:00:45 +03:00
Code Issues 783 Packages Projects Releases 22 Wiki Activity

Initial IOS app sync never completes with 500k+ assets (IsarError: The database is full.) #3867

New Issue
Closed
opened 2026-02-05 09:21:52 +03:00 by OVERLORD · 3 comments
OVERLORD commented 2026-02-05 09:21:52 +03:00
Owner
Copy Link

Originally created by @iansewell on GitHub (Jul 13, 2024).

The bug

I have an underpowered server with 400k+ assets (mostly external lib). WebUI works fine. (somewhat slow). When I try to connect iphone client, initial timeline sync never completes. I have waited 12+ hours for it but it appears stuck. Would be nice to have a progress bar.
this is most likely related to https://github.com/immich-app/immich/issues/7166 , as I see the same IsarError:
2024-07-11 02:16:46.487832 | SEVERE | SyncService | Failed to upsert 528633 assets into the DB | IsarError: The database is full. |

The OS that Immich Server is running on

Windows 10 (also tried ubuntu 22.04.3 server, same failure)

Version of Immich Server

v1.107.2

Version of Immich Mobile App

1.108.0 build 163

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

version: "3.8"

#
# WARNING: Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
#

name: immich

services:
  immich-server:
    container_name: immich_servera
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      - "d:/personal photos 10:/mnt/media/pp10"
      - "d:/personal photos 9:/mnt/media/pp9"
      - "d:/personal photos 8:/mnt/media/pp8"
      - "d:/personal photos 7:/mnt/media/pp7"
      - "d:/personal photos 6:/mnt/media/pp6"
      - "e:/personal photos 5:/mnt/media/pp5"
      - "e:/personal photos 4:/mnt/media/pp4"
      - "e:/personal photos 3:/mnt/media/pp3"
      - "e:/personal photos 2:/mnt/media/pp2"
      - "e:/personal photos:/mnt/media/pp"
      - "e:/personal movies:/mnt/media/pm"
      - "e:/personal movies 2009-2010:/mnt/media/pm2"
      - "e:/icloudwendy:/mnt/media/icloudwendy"
      - "e:/icloudian:/mnt/media/icloudian"
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always

 

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:afb290a0a0d0b2bd7537b62ebff1eb84d045c757c1c31ca2ca48c79536c0de82
    restart: always

  database:
    container_name: immich_postgres
    image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    env_file:
      - .env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

volumes:
  pgdata:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
DB_PASSWORD=pass

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich
MACHINE_LEARNING_WORKER_TIMEOUT=1200

REDIS_HOSTNAME=immich_redis

Reproduction steps

1.unintall immich app
2.reinstall
3.connect to server
full sync never completes

Relevant log output

2024-07-11 02:17:01.900204 | INFO     | AssetNotifier        | Load assets: 1279810ms |
2024-07-11 02:17:01.900181 | INFO     | AlbumService         | Syncing completed. Changes: true |
2024-07-11 02:17:01.900175 | FINE     | SyncService          | 0 assets to delete, 0 to update |
2024-07-11 02:17:01.900171 | FINE     | SyncService          | Syncing all local albums almost done. Collected 0 asset candidates to delete |
2024-07-11 02:17:01.900161 | INFO     | SyncService          | Added a new local album to DB: Long Exposure |
2024-07-11 02:17:01.899013 | INFO     | SyncService          | Upserted 9 assets into the DB |
2024-07-11 02:17:01.898342 | INFO     | SyncService          | 0 assets already existed in DB, to upsert 9 |
2024-07-11 02:17:01.655204 | INFO     | SyncService          | Syncing a new local album to DB: Long Exposure |
2024-07-11 02:17:01.655196 | INFO     | SyncService          | Added a new local album to DB: 2019 cousins summer |
2024-07-11 02:17:01.654023 | INFO     | SyncService          | Upserted 25 assets into the DB |
2024-07-11 02:17:01.653490 | INFO     | SyncService          | 0 assets already existed in DB, to upsert 25 |
2024-07-11 02:17:01.610077 | INFO     | SyncService          | Syncing a new local album to DB: 2019 cousins summer |
2024-07-11 02:17:01.525937 | INFO     | SyncService          | Upserted 44 assets into the DB |
2024-07-11 02:17:00.352343 | INFO     | SyncService          | Upserted 225 assets into the DB |
2024-07-11 02:16:59.170838 | SEVERE   | ImmichErrorLogger    | PlatformDispatcher - Catch all | IsarError: The database is full. |

2024-07-11 02:16:56.888658 | INFO     | AlbumService         | refreshDeviceAlbums is already in progress |
2024-07-11 02:16:56.882780 | FINE     | socket_io_client:engine.Socket | flushing 1 packets in socket |
2024-07-11 02:16:56.882764 | FINE     | socket_io_client:engine.Socket | socket receive: type "ping", data "null" |
2024-07-11 02:16:46.487832 | SEVERE   | SyncService          | Failed to upsert 528633 assets into the DB | IsarError: The database is full. |
2024-07-11 02:16:41.586142 | FINE     | AssetService         | Received 8633 assets from fbc212ae-8081-478d-9283-247ea3af0430 to ffffa5cb-2784-4808-ab50-8f102d2190cb |
2024-07-11 02:16:27.236399 | FINE     | socket_io_client:engine.Socket | flushing 1 packets in

Additional information

No response

Originally created by @iansewell on GitHub (Jul 13, 2024). ### The bug I have an underpowered server with 400k+ assets (mostly external lib). WebUI works fine. (somewhat slow). When I try to connect iphone client, initial timeline sync never completes. I have waited 12+ hours for it but it appears stuck. Would be nice to have a progress bar. this is most likely related to https://github.com/immich-app/immich/issues/7166 , as I see the same IsarError: 2024-07-11 02:16:46.487832 | SEVERE | SyncService | Failed to upsert 528633 assets into the DB | IsarError: The database is full. | ### The OS that Immich Server is running on Windows 10 (also tried ubuntu 22.04.3 server, same failure) ### Version of Immich Server v1.107.2 ### Version of Immich Mobile App 1.108.0 build 163 ### Platform with the issue - [ ] Server - [ ] Web - [ ] Mobile ### Your docker-compose.yml content ```YAML version: "3.8" # # WARNING: Make sure to use the docker-compose.yml of the current release: # # https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml # # The compose file on main may not be compatible with the latest release. # name: immich services: immich-server: container_name: immich_servera image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro - "d:/personal photos 10:/mnt/media/pp10" - "d:/personal photos 9:/mnt/media/pp9" - "d:/personal photos 8:/mnt/media/pp8" - "d:/personal photos 7:/mnt/media/pp7" - "d:/personal photos 6:/mnt/media/pp6" - "e:/personal photos 5:/mnt/media/pp5" - "e:/personal photos 4:/mnt/media/pp4" - "e:/personal photos 3:/mnt/media/pp3" - "e:/personal photos 2:/mnt/media/pp2" - "e:/personal photos:/mnt/media/pp" - "e:/personal movies:/mnt/media/pm" - "e:/personal movies 2009-2010:/mnt/media/pm2" - "e:/icloudwendy:/mnt/media/icloudwendy" - "e:/icloudian:/mnt/media/icloudian" env_file: - .env ports: - 2283:3001 depends_on: - redis - database restart: always immich-machine-learning: container_name: immich_machine_learning # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag. # Example tag: ${IMMICH_VERSION:-release}-cuda image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release} # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration # file: hwaccel.ml.yml # service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable volumes: - model-cache:/cache env_file: - .env restart: always redis: container_name: immich_redis image: redis:6.2-alpine@sha256:afb290a0a0d0b2bd7537b62ebff1eb84d045c757c1c31ca2ca48c79536c0de82 restart: always database: container_name: immich_postgres image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0 env_file: - .env environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} volumes: - pgdata:/var/lib/postgresql/data restart: always volumes: pgdata: model-cache: ``` ### Your .env content ```Shell # You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables # The location where your uploaded files are stored UPLOAD_LOCATION=./library # The Immich version to use. You can pin this to a specific version like "v1.71.0" IMMICH_VERSION=release # Connection secret for postgres. You should change it to a random password DB_PASSWORD=pass # The values below this line do not need to be changed ################################################################################### DB_HOSTNAME=immich_postgres DB_USERNAME=postgres DB_DATABASE_NAME=immich MACHINE_LEARNING_WORKER_TIMEOUT=1200 REDIS_HOSTNAME=immich_redis ``` ### Reproduction steps ```bash 1.unintall immich app 2.reinstall 3.connect to server full sync never completes ``` ### Relevant log output ```shell 2024-07-11 02:17:01.900204 | INFO | AssetNotifier | Load assets: 1279810ms | 2024-07-11 02:17:01.900181 | INFO | AlbumService | Syncing completed. Changes: true | 2024-07-11 02:17:01.900175 | FINE | SyncService | 0 assets to delete, 0 to update | 2024-07-11 02:17:01.900171 | FINE | SyncService | Syncing all local albums almost done. Collected 0 asset candidates to delete | 2024-07-11 02:17:01.900161 | INFO | SyncService | Added a new local album to DB: Long Exposure | 2024-07-11 02:17:01.899013 | INFO | SyncService | Upserted 9 assets into the DB | 2024-07-11 02:17:01.898342 | INFO | SyncService | 0 assets already existed in DB, to upsert 9 | 2024-07-11 02:17:01.655204 | INFO | SyncService | Syncing a new local album to DB: Long Exposure | 2024-07-11 02:17:01.655196 | INFO | SyncService | Added a new local album to DB: 2019 cousins summer | 2024-07-11 02:17:01.654023 | INFO | SyncService | Upserted 25 assets into the DB | 2024-07-11 02:17:01.653490 | INFO | SyncService | 0 assets already existed in DB, to upsert 25 | 2024-07-11 02:17:01.610077 | INFO | SyncService | Syncing a new local album to DB: 2019 cousins summer | 2024-07-11 02:17:01.525937 | INFO | SyncService | Upserted 44 assets into the DB | 2024-07-11 02:17:00.352343 | INFO | SyncService | Upserted 225 assets into the DB | 2024-07-11 02:16:59.170838 | SEVERE | ImmichErrorLogger | PlatformDispatcher - Catch all | IsarError: The database is full. | 2024-07-11 02:16:56.888658 | INFO | AlbumService | refreshDeviceAlbums is already in progress | 2024-07-11 02:16:56.882780 | FINE | socket_io_client:engine.Socket | flushing 1 packets in socket | 2024-07-11 02:16:56.882764 | FINE | socket_io_client:engine.Socket | socket receive: type "ping", data "null" | 2024-07-11 02:16:46.487832 | SEVERE | SyncService | Failed to upsert 528633 assets into the DB | IsarError: The database is full. | 2024-07-11 02:16:41.586142 | FINE | AssetService | Received 8633 assets from fbc212ae-8081-478d-9283-247ea3af0430 to ffffa5cb-2784-4808-ab50-8f102d2190cb | 2024-07-11 02:16:27.236399 | FINE | socket_io_client:engine.Socket | flushing 1 packets in ``` ### Additional information _No response_
OVERLORD commented 2026-02-05 09:21:54 +03:00
Author
Owner
Copy Link

@alextran1502 commented on GitHub (Jul 13, 2024):

How much free space do you have on your iPhone?

@alextran1502 commented on GitHub (Jul 13, 2024): How much free space do you have on your iPhone?
OVERLORD commented 2026-02-05 09:21:56 +03:00
Author
Owner
Copy Link

@alextran1502 commented on GitHub (Jul 13, 2024):

AH let me try to increase the size of maxSizeMib and see if it helps

@alextran1502 commented on GitHub (Jul 13, 2024): AH let me try to increase the size of `maxSizeMib` and see if it helps
OVERLORD commented 2026-02-05 09:21:58 +03:00
Author
Owner
Copy Link

@iansewell commented on GitHub (Jul 13, 2024):

How much free space do you have on your iPhone?

20 gb.

@iansewell commented on GitHub (Jul 13, 2024): > How much free space do you have on your iPhone? 20 gb.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
accessibility
changelog:enhancement
changelog:security
changelog:skip
changelog:translation
cli
date-time
dependencies
documentation
external-library
format
good first issue
mobile-beta
mobile-beta
mobile-beta
needs-answer
nice to have
pull-request
Mirrored from GitHub Pull Request
 sharing
tech-debt
📱mobile
🖥️web
🗄️server
🧠machine-learning
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
OVERLORD
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#3867
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?