immich-app/immich
1
0
Fork 0
mirror of https://github.com/immich-app/immich.git synced 2026-02-28 03:13:04 +03:00
Code Issues 783 Packages Projects Releases 12 Wiki Activity

The built-in backup in Immich does not always work after the update to v1.129.0 #5578

New Issue
Closed
opened 2026-02-05 11:34:15 +03:00 by OVERLORD · 11 comments
OVERLORD commented 2026-02-05 11:34:15 +03:00
Owner
Copy Link

Originally created by @Doomnometron on GitHub (Mar 8, 2025).

I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.

  • Yes

The bug

On March 6, I updated Immich from v1.126.1 to v1.129.0. Since then, the backup no longer works as smoothly as before. No more backups have been made since the update, only after I adjusted the cronjob and restarted all Docker containers is it partially working again. After the restart, two backup jobs ran one after the other, one successfully and the other not.

The OS that Immich Server is running on

Debian 12 bookworm

Version of Immich Server

v1.129.0

Version of Immich Mobile App

v1.129.0 build.187

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

name: immich

services:
  immich-server:
    container_name: immich-server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    volumes:
      - upload:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      - import:/import:ro
    env_file:
      - .env
    ports:
      - 2283:2283
    depends_on:
      - redis
      - database
    restart: no
    networks:
      - mynetwork

  immich-machine-learning:
    container_name: immich-machine-learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: no
    networks:
      - mynetwork

  redis:
    container_name: immich-redis
    image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:84882e87b54734154586e5f8abd4dce69fe7311315e2fc6d67c29614c8de2672
    restart: no
    volumes:
      - redisdata:/data
    networks:
      - mynetwork

  database:
    container_name: immich-postgres
    image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      - db-data:/var/lib/postgresql/data
    restart: no
    command: ["postgres", "-c" ,"shared_preload_libraries=vectors.so", "-c", 'search_path="$$user", public, vectors', "-c", "logging_collector=on", "-c", "max_wal_size=2GB", "-c", "shared_buffers=512MB", "-c", "wal_compression=on"]
    networks:
      - mynetwork

  immich-folder-album-creator:
    container_name: immich-folder-album-creator
    image: salvoxia/immich-folder-album-creator:latest
    restart: no
    environment:
      API_URL: http://immich-server:2283/api
      API_KEY_FILE: /mnt/api.key
      ALBUM_LEVELS: 1
      ROOT_PATH: /import
      CRON_EXPRESSION: "10 * * * *"
      TZ: Europe/Berlin
    volumes:
      - apikey:/mnt:ro
    depends_on:
      - immich-server
    networks:
      - mynetwork

networks:
   mynetwork:
    name: mynetwork
    external: true

volumes:
  model-cache:
    driver: local
    driver_opts:
      type: "nfs"
      o: "addr=10.0.0.10,rw,nfsvers=4"
      device: ":/volume1/docker/immich/model-cache"

  db-data:
    driver: local
    driver_opts:
      type: none
      o: bind
      device: /etc/docker/immich/db

  upload:
    driver: local
    driver_opts:
      type: "nfs"
      o: "addr=10.0.0.10,rw,nfsvers=4"
      device: ":/volume1/docker/immich/upload"

  import:
    driver: local
    driver_opts:
      type: "nfs"
      o: "addr=10.0.0.10,ro,nfsvers=4"
      device: ":/volume1/photos"

  redisdata:
    driver: local
    driver_opts:
      type: "nfs"
      o: "addr=10.0.0.10,rw,nfsvers=4"
      device: ":/volume1/docker/immich/redisdata"

  apikey:
    driver: local
    driver_opts:
      type: "nfs"
      o: "addr=10.0.0.10,ro,nfsvers=4"
      device: ":/volume1/docker/immich/folder-album-creator"

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
#UPLOAD_LOCATION=./library
# The location where your database files are stored
#DB_DATA_LOCATION=./postgres

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
DB_PASSWORD=securepassword

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

Reproduction steps

Use of the integrated backup job that starts via cronjob.

Relevant log output

[Nest] 7  - 03/08/2025, 2:00:00 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 7  - 03/08/2025, 2:00:00 AM   ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 2. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 8  - 03/08/2025, 8:03:00 AM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 8  - 03/08/2025, 8:04:18 AM     LOG [Microservices:BackupService] Database Backup Success
[Nest] 8  - 03/08/2025, 8:04:18 AM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 8  - 03/08/2025, 8:05:36 AM     LOG [Microservices:BackupService] Database Backup Success
[Nest] 8  - 03/08/2025, 8:05:36 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 8  - 03/08/2025, 8:05:36 AM   ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 121. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)

Additional information

No backup since March 6, only after I intervened manually.

me@server:~$ ls -l /mnt/immichbackup
total 4759616
-rwxr-xr-x 1 root root 347826945 Feb 23 03:01 immich-db-backup-1740276000011.sql.gz
-rwxr-xr-x 1 root root 347827065 Feb 24 03:01 immich-db-backup-1740362400008.sql.gz
-rwxr-xr-x 1 root root 347826927 Feb 25 03:01 immich-db-backup-1740448800009.sql.gz
-rwxr-xr-x 1 root root 347827409 Feb 26 03:01 immich-db-backup-1740535200004.sql.gz
-rwxr-xr-x 1 root root 347827267 Feb 27 03:01 immich-db-backup-1740621600005.sql.gz
-rwxr-xr-x 1 root root 347826941 Feb 28 03:01 immich-db-backup-1740708000008.sql.gz
-rwxr-xr-x 1 root root 347511481 Mar  1 03:01 immich-db-backup-1740794400013.sql.gz
-rwxr-xr-x 1 root root 347509418 Mar  2 03:01 immich-db-backup-1740880800006.sql.gz
-rwxr-xr-x 1 root root 347509567 Mar  3 03:01 immich-db-backup-1740967200008.sql.gz
-rwxr-xr-x 1 root root 347509556 Mar  4 03:01 immich-db-backup-1741053600008.sql.gz
-rwxr-xr-x 1 root root 347509948 Mar  5 03:01 immich-db-backup-1741140000009.sql.gz
-rwxr-xr-x 1 root root 347478063 Mar  6 03:01 immich-db-backup-1741226400006.sql.gz
-rwxr-xr-x 1 root root 350858266 Mar  8 09:04 immich-db-backup-1741420980128.sql.gz
-rwxr-xr-x 1 root root 350858266 Mar  8 09:05 immich-db-backup-1741421058265.sql.gz
Originally created by @Doomnometron on GitHub (Mar 8, 2025). ### I have searched the existing issues, both open and closed, to make sure this is not a duplicate report. - [x] Yes ### The bug On March 6, I updated Immich from v1.126.1 to v1.129.0. Since then, the backup no longer works as smoothly as before. No more backups have been made since the update, only after I adjusted the cronjob and restarted all Docker containers is it partially working again. After the restart, two backup jobs ran one after the other, one successfully and the other not. ### The OS that Immich Server is running on Debian 12 bookworm ### Version of Immich Server v1.129.0 ### Version of Immich Mobile App v1.129.0 build.187 ### Platform with the issue - [x] Server - [ ] Web - [ ] Mobile ### Your docker-compose.yml content ```YAML name: immich services: immich-server: container_name: immich-server image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} volumes: - upload:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro - import:/import:ro env_file: - .env ports: - 2283:2283 depends_on: - redis - database restart: no networks: - mynetwork immich-machine-learning: container_name: immich-machine-learning image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release} volumes: - model-cache:/cache env_file: - .env restart: no networks: - mynetwork redis: container_name: immich-redis image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:84882e87b54734154586e5f8abd4dce69fe7311315e2fc6d67c29614c8de2672 restart: no volumes: - redisdata:/data networks: - mynetwork database: container_name: immich-postgres image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0 environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} POSTGRES_INITDB_ARGS: '--data-checksums' volumes: - db-data:/var/lib/postgresql/data restart: no command: ["postgres", "-c" ,"shared_preload_libraries=vectors.so", "-c", 'search_path="$$user", public, vectors', "-c", "logging_collector=on", "-c", "max_wal_size=2GB", "-c", "shared_buffers=512MB", "-c", "wal_compression=on"] networks: - mynetwork immich-folder-album-creator: container_name: immich-folder-album-creator image: salvoxia/immich-folder-album-creator:latest restart: no environment: API_URL: http://immich-server:2283/api API_KEY_FILE: /mnt/api.key ALBUM_LEVELS: 1 ROOT_PATH: /import CRON_EXPRESSION: "10 * * * *" TZ: Europe/Berlin volumes: - apikey:/mnt:ro depends_on: - immich-server networks: - mynetwork networks: mynetwork: name: mynetwork external: true volumes: model-cache: driver: local driver_opts: type: "nfs" o: "addr=10.0.0.10,rw,nfsvers=4" device: ":/volume1/docker/immich/model-cache" db-data: driver: local driver_opts: type: none o: bind device: /etc/docker/immich/db upload: driver: local driver_opts: type: "nfs" o: "addr=10.0.0.10,rw,nfsvers=4" device: ":/volume1/docker/immich/upload" import: driver: local driver_opts: type: "nfs" o: "addr=10.0.0.10,ro,nfsvers=4" device: ":/volume1/photos" redisdata: driver: local driver_opts: type: "nfs" o: "addr=10.0.0.10,rw,nfsvers=4" device: ":/volume1/docker/immich/redisdata" apikey: driver: local driver_opts: type: "nfs" o: "addr=10.0.0.10,ro,nfsvers=4" device: ":/volume1/docker/immich/folder-album-creator" ``` ### Your .env content ```Shell # You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables # The location where your uploaded files are stored #UPLOAD_LOCATION=./library # The location where your database files are stored #DB_DATA_LOCATION=./postgres # The Immich version to use. You can pin this to a specific version like "v1.71.0" IMMICH_VERSION=release # Connection secret for postgres. You should change it to a random password DB_PASSWORD=securepassword # The values below this line do not need to be changed ################################################################################### DB_USERNAME=postgres DB_DATABASE_NAME=immich ``` ### Reproduction steps Use of the integrated backup job that starts via cronjob. ### Relevant log output ```shell [Nest] 7 - 03/08/2025, 2:00:00 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 7 - 03/08/2025, 2:00:00 AM ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 2. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 8 - 03/08/2025, 8:03:00 AM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 8 - 03/08/2025, 8:04:18 AM LOG [Microservices:BackupService] Database Backup Success [Nest] 8 - 03/08/2025, 8:04:18 AM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 8 - 03/08/2025, 8:05:36 AM LOG [Microservices:BackupService] Database Backup Success [Nest] 8 - 03/08/2025, 8:05:36 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 8 - 03/08/2025, 8:05:36 AM ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 121. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) ``` ### Additional information No backup since March 6, only after I intervened manually. ```shell me@server:~$ ls -l /mnt/immichbackup total 4759616 -rwxr-xr-x 1 root root 347826945 Feb 23 03:01 immich-db-backup-1740276000011.sql.gz -rwxr-xr-x 1 root root 347827065 Feb 24 03:01 immich-db-backup-1740362400008.sql.gz -rwxr-xr-x 1 root root 347826927 Feb 25 03:01 immich-db-backup-1740448800009.sql.gz -rwxr-xr-x 1 root root 347827409 Feb 26 03:01 immich-db-backup-1740535200004.sql.gz -rwxr-xr-x 1 root root 347827267 Feb 27 03:01 immich-db-backup-1740621600005.sql.gz -rwxr-xr-x 1 root root 347826941 Feb 28 03:01 immich-db-backup-1740708000008.sql.gz -rwxr-xr-x 1 root root 347511481 Mar 1 03:01 immich-db-backup-1740794400013.sql.gz -rwxr-xr-x 1 root root 347509418 Mar 2 03:01 immich-db-backup-1740880800006.sql.gz -rwxr-xr-x 1 root root 347509567 Mar 3 03:01 immich-db-backup-1740967200008.sql.gz -rwxr-xr-x 1 root root 347509556 Mar 4 03:01 immich-db-backup-1741053600008.sql.gz -rwxr-xr-x 1 root root 347509948 Mar 5 03:01 immich-db-backup-1741140000009.sql.gz -rwxr-xr-x 1 root root 347478063 Mar 6 03:01 immich-db-backup-1741226400006.sql.gz -rwxr-xr-x 1 root root 350858266 Mar 8 09:04 immich-db-backup-1741420980128.sql.gz -rwxr-xr-x 1 root root 350858266 Mar 8 09:05 immich-db-backup-1741421058265.sql.gz ```
OVERLORD commented 2026-02-05 11:34:18 +03:00
Author
Owner
Copy Link

@bo0tzz commented on GitHub (Mar 8, 2025):

I suspect this was stale jobs in redis that caused temporary gremlins. If it happens again we can reopen.

@bo0tzz commented on GitHub (Mar 8, 2025): I suspect this was stale jobs in redis that caused temporary gremlins. If it happens again we can reopen.
OVERLORD commented 2026-02-05 11:34:19 +03:00
Author
Owner
Copy Link

@Doomnometron commented on GitHub (Mar 10, 2025):

@bo0tzz Can you please reopen my issue. It has happened again. I will continue with sharing the log files after the last restart of all Docker containers.

[Nest] 8  - 03/09/2025, 2:00:00 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 8  - 03/09/2025, 2:00:00 AM   ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 122. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 8  - 03/10/2025, 2:00:00 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 8  - 03/10/2025, 2:00:00 AM   ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 123. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Initializing Immich v1.129.0
Detected CPU Cores: 6
Starting api worker
Starting microservices worker
[Nest] 6  - 03/10/2025, 3:47:55 PM     LOG [Microservices:EventRepository] Initialized websocket server
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:MetadataService] Bootstrapping metadata service
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:MetadataService] Initializing metadata service
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:MapRepository] Initializing metadata repository
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:MetadataService] Initialized local reverse geocoder
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:ServerService] Feature Flags: {
  "smartSearch": true,
  "facialRecognition": true,
  "duplicateDetection": true,
  "map": true,
  "reverseGeocoding": true,
  "importFaces": false,
  "sidecar": true,
  "search": true,
  "trash": true,
  "oauth": false,
  "oauthAutoLaunch": false,
  "passwordLogin": true,
  "configFile": false,
  "email": false
}
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}}
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:EventRepository] Initialized websocket server
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:StorageService] Successfully verified system mount folder checks
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:SystemConfigService] LogLevel=log (set via system config)
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:NestFactory] Starting Nest application...
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] ClsModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] TypeOrmModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] TypeOrmCoreModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] TypeOrmModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:NestApplication] Nest application successfully started
[Nest] 6  - 03/10/2025, 3:47:56 PM     LOG [Microservices:Bootstrap] Immich Microservices is running [v1.129.0] [production] 
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:ServerService] Feature Flags: {
  "smartSearch": true,
  "facialRecognition": true,
  "duplicateDetection": true,
  "map": true,
  "reverseGeocoding": true,
  "importFaces": false,
  "sidecar": true,
  "search": true,
  "trash": true,
  "oauth": false,
  "oauthAutoLaunch": false,
  "passwordLogin": true,
  "configFile": false,
  "email": false
}
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}}
[Nest] 6  - 03/10/2025, 3:47:56 PM   ERROR [Microservices:{"id":"1741c77f-4c7a-44d4-9e09-411d1edc0673"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format
Error: Input file contains unsupported image format
    at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
    at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68)
    at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:StorageService] Successfully verified system mount folder checks
[Nest] 6  - 03/10/2025, 3:47:56 PM   ERROR [Microservices:{"id":"1741c77f-4c7a-44d4-9e09-411d1edc0673"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format
Error: Input file contains unsupported image format
    at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
    at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68)
    at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:SystemConfigService] LogLevel=log (set via system config)
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:NestFactory] Starting Nest application...
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] ClsModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] TypeOrmModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] KyselyModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] ClsRootModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] ScheduleModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] TypeOrmCoreModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] TypeOrmModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:InstanceLoader] ApiModule dependencies initialized
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] ActivityController {/api/activities}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] AlbumController {/api/albums}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] AppController {/api}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] AssetController {/api/assets}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/memory-lane, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] AssetMediaController {/api/assets}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] AuthController {/api/auth}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] DownloadController {/api/download}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] FaceController {/api/faces}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] JobController {/api/jobs}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] LibraryController {/api/libraries}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] MapController {/api/map}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] MemoryController {/api/memories}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] NotificationController {/api/notifications}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/test-email, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/templates/:name, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] OAuthController {/api/oauth}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] PartnerController {/api/partners}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] PersonController {/api/people}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] ReportController {/api/reports}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/reports, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/reports/checksum, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/reports/fix, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] SearchController {/api/search}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] ServerController {/api/server}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] SessionController {/api/sessions}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] StackController {/api/stacks}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] SyncController {/api/sync}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] TagController {/api/tags}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] TimelineController {/api/timeline}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] TrashController {/api/trash}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] UserController {/api/users}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RoutesResolver] ViewController {/api/view}:
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:NestApplication] Nest application successfully started
[Nest] 16  - 03/10/2025, 3:47:56 PM     LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.129.0] [production] 
[Nest] 6  - 03/10/2025, 3:47:56 PM   ERROR [Microservices:{"id":"cc698958-a4f1-4de8-8c0b-061ef6f9d6c8"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block
    at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
    at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68)
    at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/10/2025, 3:47:56 PM   ERROR [Microservices:{"id":"cc698958-a4f1-4de8-8c0b-061ef6f9d6c8"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Unknown error
Error: Unknown error
    at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17)
    at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68)
    at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25)
    at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/10/2025, 3:48:26 PM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 6  - 03/10/2025, 3:49:42 PM     LOG [Microservices:BackupService] Database Backup Success
[Nest] 6  - 03/10/2025, 3:49:42 PM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 6  - 03/10/2025, 3:50:57 PM     LOG [Microservices:BackupService] Database Backup Success
[Nest] 6  - 03/10/2025, 3:50:57 PM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 6  - 03/10/2025, 3:52:13 PM     LOG [Microservices:BackupService] Database Backup Success

If further information or logs are required, I will be happy to provide them.

@Doomnometron commented on GitHub (Mar 10, 2025): @bo0tzz Can you please reopen my issue. It has happened again. I will continue with sharing the log files after the last restart of all Docker containers. ``` [Nest] 8 - 03/09/2025, 2:00:00 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 8 - 03/09/2025, 2:00:00 AM ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 122. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 8 - 03/10/2025, 2:00:00 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 8 - 03/10/2025, 2:00:00 AM ERROR [Microservices:{}] Unable to run job handler (backupDatabase/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 123. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Initializing Immich v1.129.0 Detected CPU Cores: 6 Starting api worker Starting microservices worker [Nest] 6 - 03/10/2025, 3:47:55 PM LOG [Microservices:EventRepository] Initialized websocket server [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:MetadataService] Bootstrapping metadata service [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:MetadataService] Initializing metadata service [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:MapRepository] Initializing metadata repository [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:MetadataService] Initialized local reverse geocoder [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:ServerService] Feature Flags: { "smartSearch": true, "facialRecognition": true, "duplicateDetection": true, "map": true, "reverseGeocoding": true, "importFaces": false, "sidecar": true, "search": true, "trash": true, "oauth": false, "oauthAutoLaunch": false, "passwordLogin": true, "configFile": false, "email": false } [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:EventRepository] Initialized websocket server [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:StorageService] Successfully verified system mount folder checks [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:SystemConfigService] LogLevel=log (set via system config) [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:NestFactory] Starting Nest application... [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] ClsModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] TypeOrmModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] TypeOrmCoreModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] TypeOrmModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:NestApplication] Nest application successfully started [Nest] 6 - 03/10/2025, 3:47:56 PM LOG [Microservices:Bootstrap] Immich Microservices is running [v1.129.0] [production] [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:ServerService] Feature Flags: { "smartSearch": true, "facialRecognition": true, "duplicateDetection": true, "map": true, "reverseGeocoding": true, "importFaces": false, "sidecar": true, "search": true, "trash": true, "oauth": false, "oauthAutoLaunch": false, "passwordLogin": true, "configFile": false, "email": false } [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} [Nest] 6 - 03/10/2025, 3:47:56 PM ERROR [Microservices:{"id":"1741c77f-4c7a-44d4-9e09-411d1edc0673"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format Error: Input file contains unsupported image format at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17) at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68) at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25) at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:StorageService] Successfully verified system mount folder checks [Nest] 6 - 03/10/2025, 3:47:56 PM ERROR [Microservices:{"id":"1741c77f-4c7a-44d4-9e09-411d1edc0673"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file contains unsupported image format Error: Input file contains unsupported image format at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17) at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68) at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25) at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:SystemConfigService] LogLevel=log (set via system config) [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:NestFactory] Starting Nest application... [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] ClsModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] TypeOrmModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] KyselyModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] ClsRootModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] ScheduleModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] TypeOrmCoreModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] TypeOrmModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:InstanceLoader] ApiModule dependencies initialized [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] ActivityController {/api/activities}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] AlbumController {/api/albums}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] AppController {/api}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] AssetController {/api/assets}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/memory-lane, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] AssetMediaController {/api/assets}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] AuthController {/api/auth}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] DownloadController {/api/download}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] FaceController {/api/faces}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] JobController {/api/jobs}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] LibraryController {/api/libraries}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] MapController {/api/map}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] MemoryController {/api/memories}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] NotificationController {/api/notifications}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/test-email, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/templates/:name, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] OAuthController {/api/oauth}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] PartnerController {/api/partners}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] PersonController {/api/people}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] ReportController {/api/reports}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/reports, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/reports/checksum, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/reports/fix, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] SearchController {/api/search}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] ServerController {/api/server}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] SessionController {/api/sessions}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] StackController {/api/stacks}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] SyncController {/api/sync}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] TagController {/api/tags}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] TimelineController {/api/timeline}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] TrashController {/api/trash}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] UserController {/api/users}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RoutesResolver] ViewController {/api/view}: [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:NestApplication] Nest application successfully started [Nest] 16 - 03/10/2025, 3:47:56 PM LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.129.0] [production] [Nest] 6 - 03/10/2025, 3:47:56 PM ERROR [Microservices:{"id":"cc698958-a4f1-4de8-8c0b-061ef6f9d6c8"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block Error: VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block VipsJpeg: ./lib/jpegli/decode_scan.cc:539: Failed to decode DCT block at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17) at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68) at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25) at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/10/2025, 3:47:56 PM ERROR [Microservices:{"id":"cc698958-a4f1-4de8-8c0b-061ef6f9d6c8"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Unknown error Error: Unknown error at Sharp.toBuffer (/usr/src/app/node_modules/sharp/lib/output.js:163:17) at MediaRepository.decodeImage (/usr/src/app/dist/repositories/media.repository.js:54:68) at MediaService.generateImageThumbnails (/usr/src/app/dist/services/media.service.js:164:63) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async MediaService.handleGenerateThumbnails (/usr/src/app/dist/services/media.service.js:114:25) at async JobService.onJobStart (/usr/src/app/dist/services/job.service.js:153:28) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/10/2025, 3:48:26 PM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 6 - 03/10/2025, 3:49:42 PM LOG [Microservices:BackupService] Database Backup Success [Nest] 6 - 03/10/2025, 3:49:42 PM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 6 - 03/10/2025, 3:50:57 PM LOG [Microservices:BackupService] Database Backup Success [Nest] 6 - 03/10/2025, 3:50:57 PM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 6 - 03/10/2025, 3:52:13 PM LOG [Microservices:BackupService] Database Backup Success ``` If further information or logs are required, I will be happy to provide them.
OVERLORD commented 2026-02-05 11:34:20 +03:00
Author
Owner
Copy Link

@bo0tzz commented on GitHub (Mar 10, 2025):

Do you use a remote microservices container?

@bo0tzz commented on GitHub (Mar 10, 2025): Do you use a remote microservices container?
OVERLORD commented 2026-02-05 11:34:22 +03:00
Author
Owner
Copy Link

@Doomnometron commented on GitHub (Mar 10, 2025):

No, at least not since v1.106.1 (removal of the immich-microservices container).

Except for 'immich-folder-album-creator' I also run Immich in the standard (recommended Docker compose)

@Doomnometron commented on GitHub (Mar 10, 2025): No, at least not since v1.106.1 (removal of the immich-microservices container). Except for 'immich-folder-album-creator' I also run Immich in the standard (recommended Docker compose)
OVERLORD commented 2026-02-05 11:34:23 +03:00
Author
Owner
Copy Link

@Doomnometron commented on GitHub (Mar 11, 2025):

Some new logs since yesterday.

[Nest] 6  - 03/11/2025, 12:00:00 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 6  - 03/11/2025, 12:00:00 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 3. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/11/2025, 12:00:00 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 6  - 03/11/2025, 12:00:00 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 4. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/11/2025, 2:00:00 AM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 6  - 03/11/2025, 2:01:16 AM     LOG [Microservices:BackupService] Database Backup Success
@Doomnometron commented on GitHub (Mar 11, 2025): Some new logs since yesterday. ``` [Nest] 6 - 03/11/2025, 12:00:00 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 6 - 03/11/2025, 12:00:00 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 3. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/11/2025, 12:00:00 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 6 - 03/11/2025, 12:00:00 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:154:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 4. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/11/2025, 2:00:00 AM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 6 - 03/11/2025, 2:01:16 AM LOG [Microservices:BackupService] Database Backup Success ```
OVERLORD commented 2026-02-05 11:34:24 +03:00
Author
Owner
Copy Link

@Oddsodz commented on GitHub (Mar 13, 2025):

I too am suffering from this issue.

@Oddsodz commented on GitHub (Mar 13, 2025): I too am suffering from this issue.
OVERLORD commented 2026-02-05 11:34:24 +03:00
Author
Owner
Copy Link

@Doomnometron commented on GitHub (Mar 30, 2025):

The problem also exists with v1.130.3. No backups were made for a few days (pre v1.130.3), then I updated the Docker container (and thus unfortunately deleted the old logs) and had to restart the v1.130.3 container several times so that the backups were created again (and then three were made directly one after the other, so the backup jobs were in the queue and had to be processed).

The first start after upgrading to v1.130.3

Initializing Immich v1.130.3
Detected CPU Cores: 6
Starting api worker
Starting microservices worker
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:EventRepository] Initialized websocket server
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:DatabaseRepository] Running migrations, this may take a while
[Nest] 17  - 03/27/2025, 5:20:13 PM     LOG [Api:EventRepository] Initialized websocket server
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:MetadataService] Bootstrapping metadata service
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:MetadataService] Initializing metadata service
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:MapRepository] Initializing metadata repository
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:MetadataService] Initialized local reverse geocoder
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:ServerService] Feature Flags: {
  "smartSearch": true,
  "facialRecognition": true,
  "duplicateDetection": true,
  "map": true,
  "reverseGeocoding": true,
  "importFaces": false,
  "sidecar": true,
  "search": true,
  "trash": true,
  "oauth": false,
  "oauthAutoLaunch": false,
  "passwordLogin": true,
  "configFile": false,
  "email": false
}
[Nest] 17  - 03/27/2025, 5:20:13 PM     LOG [Api:DatabaseRepository] Running migrations, this may take a while
[Nest] 7  - 03/27/2025, 5:20:13 PM     LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}}
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:StorageService] Successfully verified system mount folder checks
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:VersionService] Adding 1.130.3 to upgrade history
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:SystemConfigService] LogLevel=log (set via system config)
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:NestFactory] Starting Nest application...
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] ClsModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:NestApplication] Nest application successfully started
[Nest] 7  - 03/27/2025, 5:20:14 PM     LOG [Microservices:Bootstrap] Immich Microservices is running [v1.130.3] [production] 
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:ServerService] Feature Flags: {
  "smartSearch": true,
  "facialRecognition": true,
  "duplicateDetection": true,
  "map": true,
  "reverseGeocoding": true,
  "importFaces": false,
  "sidecar": true,
  "search": true,
  "trash": true,
  "oauth": false,
  "oauthAutoLaunch": false,
  "passwordLogin": true,
  "configFile": false,
  "email": false
}
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}}
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:StorageService] Successfully verified system mount folder checks
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:SystemConfigService] LogLevel=log (set via system config)
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:NestFactory] Starting Nest application...
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] ClsModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] KyselyModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] ClsRootModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] ScheduleModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:InstanceLoader] ApiModule dependencies initialized
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] ActivityController {/api/activities}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] AlbumController {/api/albums}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] AppController {/api}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] AssetController {/api/assets}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/memory-lane, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] AssetMediaController {/api/assets}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] AuthController {/api/auth}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] DownloadController {/api/download}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] FaceController {/api/faces}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] JobController {/api/jobs}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] LibraryController {/api/libraries}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] MapController {/api/map}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] MemoryController {/api/memories}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] NotificationController {/api/notifications}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/test-email, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/templates/:name, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] OAuthController {/api/oauth}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] PartnerController {/api/partners}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] PersonController {/api/people}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] ReportController {/api/reports}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/reports, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/reports/checksum, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/reports/fix, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] SearchController {/api/search}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] ServerController {/api/server}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] SessionController {/api/sessions}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] StackController {/api/stacks}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] SyncController {/api/sync}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] TagController {/api/tags}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] TimelineController {/api/timeline}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] TrashController {/api/trash}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] UserController {/api/users}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RoutesResolver] ViewController {/api/view}:
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:NestApplication] Nest application successfully started
[Nest] 17  - 03/27/2025, 5:20:14 PM     LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.130.3] [production]

The second start after upgrading

Initializing Immich v1.130.3
Detected CPU Cores: 6
Starting api worker
Starting microservices worker
[Nest] 7  - 03/29/2025, 9:02:01 AM     LOG [Microservices:EventRepository] Initialized websocket server
[Nest] 7  - 03/29/2025, 9:02:02 AM     LOG [Microservices:DatabaseRepository] Running migrations, this may take a while
[Nest] 17  - 03/29/2025, 9:02:02 AM     LOG [Api:EventRepository] Initialized websocket server
[Nest] 7  - 03/29/2025, 9:02:02 AM     LOG [Microservices:MetadataService] Bootstrapping metadata service
[Nest] 7  - 03/29/2025, 9:02:02 AM     LOG [Microservices:MetadataService] Initializing metadata service
[Nest] 7  - 03/29/2025, 9:02:02 AM     LOG [Microservices:MapRepository] Initializing metadata repository
[Nest] 7  - 03/29/2025, 9:02:02 AM     LOG [Microservices:MetadataService] Initialized local reverse geocoder
[Nest] 17  - 03/29/2025, 9:02:02 AM     LOG [Api:DatabaseRepository] Running migrations, this may take a while
(...) skipping more log messages (...)
[Nest] 17  - 03/29/2025, 9:02:03 AM     LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.130.3] [production]

The third start

Initializing Immich v1.130.3
Detected CPU Cores: 6
Starting api worker
Starting microservices worker
[Nest] 6  - 03/29/2025, 9:15:23 AM     LOG [Microservices:EventRepository] Initialized websocket server
[Nest] 6  - 03/29/2025, 9:15:23 AM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 16  - 03/29/2025, 9:15:23 AM     LOG [Api:EventRepository] Initialized websocket server
[Nest] 6  - 03/29/2025, 9:15:24 AM     LOG [Microservices:DatabaseRepository] Running migrations, this may take a while
[Nest] 6  - 03/29/2025, 9:15:24 AM     LOG [Microservices:MetadataService] Bootstrapping metadata service
[Nest] 6  - 03/29/2025, 9:15:24 AM     LOG [Microservices:MetadataService] Initializing metadata service
[Nest] 6  - 03/29/2025, 9:15:24 AM     LOG [Microservices:MapRepository] Initializing metadata repository
[Nest] 6  - 03/29/2025, 9:15:24 AM     LOG [Microservices:MetadataService] Initialized local reverse geocoder
[Nest] 16  - 03/29/2025, 9:15:24 AM     LOG [Api:DatabaseRepository] Running migrations, this may take a while
(...) skipping more log messages (...)
[Nest] 6  - 03/29/2025, 9:15:24 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
[Nest] 6  - 03/29/2025, 9:15:24 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 960532. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/29/2025, 9:15:24 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 6  - 03/29/2025, 9:15:24 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 960533. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
(...) some more log messages (...)
[Nest] 16  - 03/29/2025, 9:15:25 AM     LOG [Api:NestApplication] Nest application successfully started
[Nest] 16  - 03/29/2025, 9:15:25 AM     LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.130.3] [production] 
[Nest] 6  - 03/29/2025, 9:15:25 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 6  - 03/29/2025, 9:15:25 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 960534. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/29/2025, 9:15:25 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 6  - 03/29/2025, 9:15:25 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 960535. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/29/2025, 9:15:25 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
[Nest] 6  - 03/29/2025, 9:15:25 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/29/2025, 9:15:25 AM    WARN [Microservices:JobRepository] Skipping unknown job: "undefined"
Error: Missing lock for job 960536. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 6  - 03/29/2025, 9:15:25 AM   ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll')
TypeError: Cannot read properties of undefined (reading 'replaceAll')
    at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13)
    at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
Error: Missing lock for job 960537. failed
    at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24)
    at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21)
    at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24)
[Nest] 16  - 03/29/2025, 9:15:34 AM     LOG [Api:EventRepository] Websocket Connect:    wOqL_yU6qY_K8VM8AAAB

And finally the backup job started and created three backups

[Nest] 6  - 03/29/2025, 9:16:40 AM     LOG [Microservices:BackupService] Database Backup Success
[Nest] 6  - 03/29/2025, 9:16:40 AM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 6  - 03/29/2025, 9:17:55 AM     LOG [Microservices:BackupService] Database Backup Success
[Nest] 6  - 03/29/2025, 9:17:55 AM     LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14
[Nest] 6  - 03/29/2025, 9:19:09 AM     LOG [Microservices:BackupService] Database Backup Success

Any ideas?

@Doomnometron commented on GitHub (Mar 30, 2025): The problem also exists with v1.130.3. No backups were made for a few days (pre v1.130.3), then I updated the Docker container (and thus unfortunately deleted the old logs) and had to restart the v1.130.3 container several times so that the backups were created again (and then three were made directly one after the other, so the backup jobs were in the queue and had to be processed). The first start after upgrading to v1.130.3 ``` Initializing Immich v1.130.3 Detected CPU Cores: 6 Starting api worker Starting microservices worker [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:EventRepository] Initialized websocket server [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:DatabaseRepository] Running migrations, this may take a while [Nest] 17 - 03/27/2025, 5:20:13 PM LOG [Api:EventRepository] Initialized websocket server [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:MetadataService] Bootstrapping metadata service [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:MetadataService] Initializing metadata service [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:MapRepository] Initializing metadata repository [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:MetadataService] Initialized local reverse geocoder [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:ServerService] Feature Flags: { "smartSearch": true, "facialRecognition": true, "duplicateDetection": true, "map": true, "reverseGeocoding": true, "importFaces": false, "sidecar": true, "search": true, "trash": true, "oauth": false, "oauthAutoLaunch": false, "passwordLogin": true, "configFile": false, "email": false } [Nest] 17 - 03/27/2025, 5:20:13 PM LOG [Api:DatabaseRepository] Running migrations, this may take a while [Nest] 7 - 03/27/2025, 5:20:13 PM LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:StorageService] Successfully verified system mount folder checks [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:VersionService] Adding 1.130.3 to upgrade history [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:SystemConfigService] LogLevel=log (set via system config) [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:NestFactory] Starting Nest application... [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] ClsModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:NestApplication] Nest application successfully started [Nest] 7 - 03/27/2025, 5:20:14 PM LOG [Microservices:Bootstrap] Immich Microservices is running [v1.130.3] [production] [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:ServerService] Feature Flags: { "smartSearch": true, "facialRecognition": true, "duplicateDetection": true, "map": true, "reverseGeocoding": true, "importFaces": false, "sidecar": true, "search": true, "trash": true, "oauth": false, "oauthAutoLaunch": false, "passwordLogin": true, "configFile": false, "email": false } [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:StorageService] Successfully verified system mount folder checks [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:SystemConfigService] LogLevel=log (set via system config) [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:NestFactory] Starting Nest application... [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] ClsModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] KyselyModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] ClsRootModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] ScheduleModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:InstanceLoader] ApiModule dependencies initialized [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] ActivityController {/api/activities}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] AlbumController {/api/albums}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] AppController {/api}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] AssetController {/api/assets}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/memory-lane, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] AssetMediaController {/api/assets}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] AuthController {/api/auth}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] DownloadController {/api/download}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] FaceController {/api/faces}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] JobController {/api/jobs}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] LibraryController {/api/libraries}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] MapController {/api/map}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] MemoryController {/api/memories}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] NotificationController {/api/notifications}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/test-email, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/templates/:name, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] OAuthController {/api/oauth}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] PartnerController {/api/partners}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] PersonController {/api/people}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] ReportController {/api/reports}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/reports, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/reports/checksum, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/reports/fix, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] SearchController {/api/search}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] ServerController {/api/server}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] SessionController {/api/sessions}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] StackController {/api/stacks}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] SyncController {/api/sync}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] TagController {/api/tags}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] TimelineController {/api/timeline}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] TrashController {/api/trash}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] UserController {/api/users}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RoutesResolver] ViewController {/api/view}: [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:NestApplication] Nest application successfully started [Nest] 17 - 03/27/2025, 5:20:14 PM LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.130.3] [production] ``` The second start after upgrading ``` Initializing Immich v1.130.3 Detected CPU Cores: 6 Starting api worker Starting microservices worker [Nest] 7 - 03/29/2025, 9:02:01 AM LOG [Microservices:EventRepository] Initialized websocket server [Nest] 7 - 03/29/2025, 9:02:02 AM LOG [Microservices:DatabaseRepository] Running migrations, this may take a while [Nest] 17 - 03/29/2025, 9:02:02 AM LOG [Api:EventRepository] Initialized websocket server [Nest] 7 - 03/29/2025, 9:02:02 AM LOG [Microservices:MetadataService] Bootstrapping metadata service [Nest] 7 - 03/29/2025, 9:02:02 AM LOG [Microservices:MetadataService] Initializing metadata service [Nest] 7 - 03/29/2025, 9:02:02 AM LOG [Microservices:MapRepository] Initializing metadata repository [Nest] 7 - 03/29/2025, 9:02:02 AM LOG [Microservices:MetadataService] Initialized local reverse geocoder [Nest] 17 - 03/29/2025, 9:02:02 AM LOG [Api:DatabaseRepository] Running migrations, this may take a while (...) skipping more log messages (...) [Nest] 17 - 03/29/2025, 9:02:03 AM LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.130.3] [production] ``` The third start ``` Initializing Immich v1.130.3 Detected CPU Cores: 6 Starting api worker Starting microservices worker [Nest] 6 - 03/29/2025, 9:15:23 AM LOG [Microservices:EventRepository] Initialized websocket server [Nest] 6 - 03/29/2025, 9:15:23 AM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 16 - 03/29/2025, 9:15:23 AM LOG [Api:EventRepository] Initialized websocket server [Nest] 6 - 03/29/2025, 9:15:24 AM LOG [Microservices:DatabaseRepository] Running migrations, this may take a while [Nest] 6 - 03/29/2025, 9:15:24 AM LOG [Microservices:MetadataService] Bootstrapping metadata service [Nest] 6 - 03/29/2025, 9:15:24 AM LOG [Microservices:MetadataService] Initializing metadata service [Nest] 6 - 03/29/2025, 9:15:24 AM LOG [Microservices:MapRepository] Initializing metadata repository [Nest] 6 - 03/29/2025, 9:15:24 AM LOG [Microservices:MetadataService] Initialized local reverse geocoder [Nest] 16 - 03/29/2025, 9:15:24 AM LOG [Api:DatabaseRepository] Running migrations, this may take a while (...) skipping more log messages (...) [Nest] 6 - 03/29/2025, 9:15:24 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') [Nest] 6 - 03/29/2025, 9:15:24 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 960532. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/29/2025, 9:15:24 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 6 - 03/29/2025, 9:15:24 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 960533. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) (...) some more log messages (...) [Nest] 16 - 03/29/2025, 9:15:25 AM LOG [Api:NestApplication] Nest application successfully started [Nest] 16 - 03/29/2025, 9:15:25 AM LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.130.3] [production] [Nest] 6 - 03/29/2025, 9:15:25 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 6 - 03/29/2025, 9:15:25 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 960534. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/29/2025, 9:15:25 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 6 - 03/29/2025, 9:15:25 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 960535. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/29/2025, 9:15:25 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" [Nest] 6 - 03/29/2025, 9:15:25 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/29/2025, 9:15:25 AM WARN [Microservices:JobRepository] Skipping unknown job: "undefined" Error: Missing lock for job 960536. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 6 - 03/29/2025, 9:15:25 AM ERROR [Microservices:{}] Unable to run job handler (thumbnailGeneration/undefined): TypeError: Cannot read properties of undefined (reading 'replaceAll') TypeError: Cannot read properties of undefined (reading 'replaceAll') at JobService.onJobStart (/usr/src/app/dist/services/job.service.js:157:55) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async EventRepository.onEvent (/usr/src/app/dist/repositories/event.repository.js:126:13) at async Worker.processJob (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:394:28) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) Error: Missing lock for job 960537. failed at Scripts.finishedErrors (/usr/src/app/node_modules/bullmq/dist/cjs/classes/scripts.js:272:24) at Job.moveToFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/job.js:427:32) at process.processTicksAndRejections (node:internal/process/task_queues:105:5) at async handleFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:379:21) at async Worker.retryIfFailed (/usr/src/app/node_modules/bullmq/dist/cjs/classes/worker.js:581:24) [Nest] 16 - 03/29/2025, 9:15:34 AM LOG [Api:EventRepository] Websocket Connect: wOqL_yU6qY_K8VM8AAAB ``` And finally the backup job started and created three backups ``` [Nest] 6 - 03/29/2025, 9:16:40 AM LOG [Microservices:BackupService] Database Backup Success [Nest] 6 - 03/29/2025, 9:16:40 AM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 6 - 03/29/2025, 9:17:55 AM LOG [Microservices:BackupService] Database Backup Success [Nest] 6 - 03/29/2025, 9:17:55 AM LOG [Microservices:BackupService] Database Backup Starting. Database Version: 14 [Nest] 6 - 03/29/2025, 9:19:09 AM LOG [Microservices:BackupService] Database Backup Success ``` Any ideas?
OVERLORD commented 2026-02-05 11:34:25 +03:00
Author
Owner
Copy Link

@alextran1502 commented on GitHub (Mar 30, 2025):

@Doomnometron can you run docker compose down then docker compose up? Do you use a separate Redis container?

@alextran1502 commented on GitHub (Mar 30, 2025): @Doomnometron can you run docker compose down then docker compose up? Do you use a separate Redis container?
OVERLORD commented 2026-02-05 11:34:25 +03:00
Author
Owner
Copy Link

@Doomnometron commented on GitHub (Mar 30, 2025):

@alextran1502 Yes, docker compose down / up are working properly. Do you need specific log files from the down/up commands?

I am using an Immich-exclusive Redis container, as can be seen in my compose.yml, but this should correspond to the standard according to https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml.
I have just noticed that the Redis versions in my file and the linked file are different. I'll correct that in a moment.

@Doomnometron commented on GitHub (Mar 30, 2025): @alextran1502 Yes, docker compose down / up are working properly. Do you need specific log files from the down/up commands? I am using an Immich-exclusive Redis container, as can be seen in my compose.yml, but this should correspond to the standard according to https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml. I have just noticed that the Redis versions in my file and the linked file are different. I'll correct that in a moment.
OVERLORD commented 2026-02-05 11:34:26 +03:00
Author
Owner
Copy Link

@Doomnometron commented on GitHub (May 30, 2025):

I am now on v1.134.0 and the problem still exists. It has even gotten worse with regard to the missing reference to the backup not running (the message “[Microservices:JobRepository] Skipping unknown job: ‘undefined’ is missing in the log).

Initializing Immich v1.134.0
Detected CPU Cores: 6
Starting api worker
Starting microservices worker
[Nest] 7  - 05/28/2025, 4:03:51 PM     LOG [Microservices:EventRepository] Initialized websocket server
[Nest] 7  - 05/28/2025, 4:03:51 PM     LOG [Microservices:DatabaseRepository] targetLists=1, current=1 for clip_index of 59245 rows
[Nest] 7  - 05/28/2025, 4:03:51 PM     LOG [Microservices:DatabaseRepository] targetLists=1, current=1 for face_index of 61538 rows
[Nest] 7  - 05/28/2025, 4:03:51 PM     LOG [Microservices:DatabaseRepository] Running migrations, this may take a while
[Nest] 17  - 05/28/2025, 4:03:51 PM     LOG [Api:EventRepository] Initialized websocket server
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:MetadataService] Bootstrapping metadata service
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:MetadataService] Initializing metadata service
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:MapRepository] Initializing metadata repository
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:MetadataService] Initialized local reverse geocoder
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:DatabaseRepository] targetLists=1, current=1 for clip_index of 59245 rows
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:DatabaseRepository] targetLists=1, current=1 for face_index of 61538 rows
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:DatabaseRepository] Running migrations, this may take a while
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:ServerService] Feature Flags: {
  "smartSearch": true,
  "facialRecognition": true,
  "duplicateDetection": true,
  "map": true,
  "reverseGeocoding": true,
  "importFaces": false,
  "sidecar": true,
  "search": true,
  "trash": true,
  "oauth": false,
  "oauthAutoLaunch": false,
  "passwordLogin": true,
  "configFile": false,
  "email": false
}
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}}
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:ServerService] Feature Flags: {
  "smartSearch": true,
  "facialRecognition": true,
  "duplicateDetection": true,
  "map": true,
  "reverseGeocoding": true,
  "importFaces": false,
  "sidecar": true,
  "search": true,
  "trash": true,
  "oauth": false,
  "oauthAutoLaunch": false,
  "passwordLogin": true,
  "configFile": false,
  "email": false
}
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:StorageService] Successfully verified system mount folder checks
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}}
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:VersionService] Adding 1.134.0 to upgrade history
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:StorageService] Successfully verified system mount folder checks
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:SystemConfigService] LogLevel=log (set via system config)
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:SystemConfigService] LogLevel=log (set via system config)
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:NestFactory] Starting Nest application...
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] ClsModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] BullModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:NestApplication] Nest application successfully started
[Nest] 7  - 05/28/2025, 4:03:52 PM     LOG [Microservices:Bootstrap] Immich Microservices is running [v1.134.0] [production] 
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:NestFactory] Starting Nest application...
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] ClsModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] KyselyModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] ClsRootModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] ScheduleModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] BullModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:InstanceLoader] ApiModule dependencies initialized
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] ActivityController {/api/activities}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] AlbumController {/api/albums}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] AppController {/api}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] AssetController {/api/assets}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] AssetMediaController {/api/assets}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] AuthController {/api/auth}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/status, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/pin-code, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/pin-code, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/pin-code, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/session/unlock, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/auth/session/lock, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] DownloadController {/api/download}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] FaceController {/api/faces}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] JobController {/api/jobs}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] LibraryController {/api/libraries}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] MapController {/api/map}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] MemoryController {/api/memories}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] NotificationController {/api/notifications}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/notifications/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] NotificationAdminController {/api/admin/notifications}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/notifications, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/notifications/test-email, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/notifications/templates/:name, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] OAuthController {/api/oauth}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] PartnerController {/api/partners}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] PersonController {/api/people}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] SearchController {/api/search}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] ServerController {/api/server}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/server/version-check, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] SessionController {/api/sessions}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sessions/:id/lock, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] StackController {/api/stacks}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] SyncController {/api/sync}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/system-metadata/version-check-state, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] TagController {/api/tags}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] TimelineController {/api/timeline}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] TrashController {/api/trash}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/statistics, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] UserController {/api/users}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RoutesResolver] ViewController {/api/view}:
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:NestApplication] Nest application successfully started
[Nest] 17  - 05/28/2025, 4:03:52 PM     LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.134.0] [production] 
[Nest] 17  - 05/28/2025, 4:03:54 PM     LOG [Api:EventRepository] Websocket Connect:    N0T_-wsv1giaLVQoAAAB
[Nest] 17  - 05/28/2025, 4:04:19 PM     LOG [Api:EventRepository] Websocket Disconnect: N0T_-wsv1giaLVQoAAAB
[Nest] 17  - 05/28/2025, 4:04:19 PM     LOG [Api:EventRepository] Websocket Connect:    cECdVsnXULUyT3MpAAAD
`orderBy(..., expr)` is deprecated. Use `orderBy(..., 'asc')` or `orderBy(..., (ob) => ...)` instead.
[Nest] 17  - 05/28/2025, 6:05:58 PM     LOG [Api:EventRepository] Websocket Disconnect: cECdVsnXULUyT3MpAAAD
[Nest] 7  - 05/29/2025, 12:00:01 AM     LOG [Microservices:SessionService] Deleted 0 expired session tokens
[Nest] 17  - 05/29/2025, 6:56:40 AM     LOG [Api:EventRepository] Websocket Connect:    0u5NmVCIbyLXDppLAAAF
[Nest] 17  - 05/29/2025, 1:42:36 PM     LOG [Api:EventRepository] Websocket Disconnect: 0u5NmVCIbyLXDppLAAAF
[Nest] 7  - 05/30/2025, 12:00:03 AM     LOG [Microservices:SessionService] Deleted 0 expired session tokens
[Nest] 17  - 05/30/2025, 6:41:36 AM     LOG [Api:EventRepository] Websocket Connect:    TIimOiGBtbmV19LDAAAH
[Nest] 17  - 05/30/2025, 8:03:47 AM     LOG [Api:EventRepository] Websocket Disconnect: TIimOiGBtbmV19LDAAAH
[Nest] 17  - 05/30/2025, 8:03:47 AM     LOG [Api:EventRepository] Websocket Connect:    8S2qlPVkVA6njkqiAAAJ

The last backup ran at 4 a.m. on May 28. Even restarting the Immich Docker container no longer provides a solution; the backup job is simply no longer started.

@Doomnometron commented on GitHub (May 30, 2025): I am now on v1.134.0 and the problem still exists. It has even gotten worse with regard to the missing reference to the backup not running (the message “[Microservices:JobRepository] Skipping unknown job: ‘undefined’ is missing in the log). ``` Initializing Immich v1.134.0 Detected CPU Cores: 6 Starting api worker Starting microservices worker [Nest] 7 - 05/28/2025, 4:03:51 PM LOG [Microservices:EventRepository] Initialized websocket server [Nest] 7 - 05/28/2025, 4:03:51 PM LOG [Microservices:DatabaseRepository] targetLists=1, current=1 for clip_index of 59245 rows [Nest] 7 - 05/28/2025, 4:03:51 PM LOG [Microservices:DatabaseRepository] targetLists=1, current=1 for face_index of 61538 rows [Nest] 7 - 05/28/2025, 4:03:51 PM LOG [Microservices:DatabaseRepository] Running migrations, this may take a while [Nest] 17 - 05/28/2025, 4:03:51 PM LOG [Api:EventRepository] Initialized websocket server [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:MetadataService] Bootstrapping metadata service [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:MetadataService] Initializing metadata service [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:MapRepository] Initializing metadata repository [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:MetadataService] Initialized local reverse geocoder [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:DatabaseRepository] targetLists=1, current=1 for clip_index of 59245 rows [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:DatabaseRepository] targetLists=1, current=1 for face_index of 61538 rows [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:DatabaseRepository] Running migrations, this may take a while [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:ServerService] Feature Flags: { "smartSearch": true, "facialRecognition": true, "duplicateDetection": true, "map": true, "reverseGeocoding": true, "importFaces": false, "sidecar": true, "search": true, "trash": true, "oauth": false, "oauthAutoLaunch": false, "passwordLogin": true, "configFile": false, "email": false } [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:ServerService] Feature Flags: { "smartSearch": true, "facialRecognition": true, "duplicateDetection": true, "map": true, "reverseGeocoding": true, "importFaces": false, "sidecar": true, "search": true, "trash": true, "oauth": false, "oauthAutoLaunch": false, "passwordLogin": true, "configFile": false, "email": false } [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:StorageService] Successfully verified system mount folder checks [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:StorageService] Verifying system mount folder checks, current state: {"mountFiles":true,"mountChecks":{"thumbs":true,"upload":true,"backups":true,"library":true,"profile":true,"encoded-video":true}} [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:VersionService] Adding 1.134.0 to upgrade history [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:StorageService] Successfully verified system mount folder checks [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:SystemConfigService] LogLevel=log (set via system config) [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:SystemConfigService] LogLevel=log (set via system config) [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:NestFactory] Starting Nest application... [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] ClsModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] ClsCommonModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] OpenTelemetryModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] KyselyModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] KyselyCoreModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] DiscoveryModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] OpenTelemetryCoreModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] ClsRootModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] BullModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:InstanceLoader] MicroservicesModule dependencies initialized [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:NestApplication] Nest application successfully started [Nest] 7 - 05/28/2025, 4:03:52 PM LOG [Microservices:Bootstrap] Immich Microservices is running [v1.134.0] [production] [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:NestFactory] Starting Nest application... [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] ClsModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] ClsCommonModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] OpenTelemetryModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] KyselyModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] KyselyCoreModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] DiscoveryModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] OpenTelemetryCoreModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] ClsRootModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] ScheduleModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] BullModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:InstanceLoader] ApiModule dependencies initialized [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] APIKeyController {/api/api-keys}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/api-keys/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] ActivityController {/api/activities}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/activities, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/activities, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/activities/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/activities/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] AlbumController {/api/albums}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, PATCH} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/assets, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/users, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/albums/:id/user/:userId, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] AppController {/api}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/.well-known/immich, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/custom.css, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] AssetController {/api/assets}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/random, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/device/:deviceId, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/jobs, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] AssetMediaController {/api/assets}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/original, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/thumbnail, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/:id/video/playback, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/exist, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/assets/bulk-upload-check, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] AuthController {/api/auth}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/login, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/admin-sign-up, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/validateToken, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/change-password, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/logout, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/status, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/pin-code, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/pin-code, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/pin-code, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/session/unlock, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/auth/session/lock, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] DownloadController {/api/download}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/download/info, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/download/archive, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] DuplicateController {/api/duplicates}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/duplicates, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] FaceController {/api/faces}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/faces, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/faces, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/faces/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] JobController {/api/jobs}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/jobs, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/jobs/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] LibraryController {/api/libraries}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/validate, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/libraries/:id/scan, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] MapController {/api/map}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/map/markers, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/map/reverse-geocode, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] MemoryController {/api/memories}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/memories/:id/assets, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] NotificationController {/api/notifications}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/notifications, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/notifications, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/notifications, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/notifications/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] NotificationAdminController {/api/admin/notifications}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/notifications, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/notifications/test-email, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/notifications/templates/:name, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] OAuthController {/api/oauth}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/mobile-redirect, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/authorize, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/callback, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/link, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/oauth/unlink, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] PartnerController {/api/partners}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/partners, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/partners/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] PersonController {/api/people}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/thumbnail, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/reassign, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/people/:id/merge, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] SearchController {/api/search}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/metadata, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/random, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/smart, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/explore, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/person, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/places, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/cities, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/search/suggestions, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] ServerController {/api/server}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/about, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/storage, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/ping, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/version, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/version-history, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/features, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/theme, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/config, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/media-types, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/license, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/server/version-check, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] SessionController {/api/sessions}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sessions, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sessions/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sessions/:id/lock, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] SharedLinkController {/api/shared-links}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/me, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, PATCH} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/shared-links/:id/assets, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] StackController {/api/stacks}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/stacks, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/stacks/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] SyncController {/api/sync}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sync/full-sync, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sync/delta-sync, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sync/stream, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/sync/ack, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] SystemConfigController {/api/system-config}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/defaults, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-config, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-config/storage-template-options, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] SystemMetadataController {/api/system-metadata}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/admin-onboarding, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/reverse-geocoding-state, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/system-metadata/version-check-state, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] TagController {/api/tags}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags/assets, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/tags/:id/assets, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] TimelineController {/api/timeline}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/buckets, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/timeline/bucket, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] TrashController {/api/trash}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/trash/empty, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/trash/restore/assets, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] UserAdminController {/api/admin/users}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/statistics, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/preferences, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/admin/users/:id/restore, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] UserController {/api/users}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/preferences, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, PUT} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/me/license, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, POST} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/profile-image, DELETE} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/users/:id/profile-image, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RoutesResolver] ViewController {/api/view}: [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder/unique-paths, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:RouterExplorer] Mapped {/api/view/folder, GET} route [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:NestApplication] Nest application successfully started [Nest] 17 - 05/28/2025, 4:03:52 PM LOG [Api:Bootstrap] Immich Server is listening on http://[::1]:2283 [v1.134.0] [production] [Nest] 17 - 05/28/2025, 4:03:54 PM LOG [Api:EventRepository] Websocket Connect: N0T_-wsv1giaLVQoAAAB [Nest] 17 - 05/28/2025, 4:04:19 PM LOG [Api:EventRepository] Websocket Disconnect: N0T_-wsv1giaLVQoAAAB [Nest] 17 - 05/28/2025, 4:04:19 PM LOG [Api:EventRepository] Websocket Connect: cECdVsnXULUyT3MpAAAD `orderBy(..., expr)` is deprecated. Use `orderBy(..., 'asc')` or `orderBy(..., (ob) => ...)` instead. [Nest] 17 - 05/28/2025, 6:05:58 PM LOG [Api:EventRepository] Websocket Disconnect: cECdVsnXULUyT3MpAAAD [Nest] 7 - 05/29/2025, 12:00:01 AM LOG [Microservices:SessionService] Deleted 0 expired session tokens [Nest] 17 - 05/29/2025, 6:56:40 AM LOG [Api:EventRepository] Websocket Connect: 0u5NmVCIbyLXDppLAAAF [Nest] 17 - 05/29/2025, 1:42:36 PM LOG [Api:EventRepository] Websocket Disconnect: 0u5NmVCIbyLXDppLAAAF [Nest] 7 - 05/30/2025, 12:00:03 AM LOG [Microservices:SessionService] Deleted 0 expired session tokens [Nest] 17 - 05/30/2025, 6:41:36 AM LOG [Api:EventRepository] Websocket Connect: TIimOiGBtbmV19LDAAAH [Nest] 17 - 05/30/2025, 8:03:47 AM LOG [Api:EventRepository] Websocket Disconnect: TIimOiGBtbmV19LDAAAH [Nest] 17 - 05/30/2025, 8:03:47 AM LOG [Api:EventRepository] Websocket Connect: 8S2qlPVkVA6njkqiAAAJ ``` The last backup ran at 4 a.m. on May 28. Even restarting the Immich Docker container no longer provides a solution; the backup job is simply no longer started.
OVERLORD commented 2026-02-05 11:34:26 +03:00
Author
Owner
Copy Link

@ananthb commented on GitHub (Sep 17, 2025):

I'm having the same issue (of backups not working) on Immich 1.140.1 running baremetal on NixOS.

@ananthb commented on GitHub (Sep 17, 2025): I'm having the same issue (of backups not working) on Immich 1.140.1 running baremetal on NixOS.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
accessibility
changelog:enhancement
changelog:security
changelog:skip
changelog:translation
cli
date-time
dependencies
documentation
external-library
format
good first issue
mobile-beta
mobile-beta
mobile-beta
needs-answer
nice to have
pull-request
Mirrored from GitHub Pull Request
 sharing
tech-debt
📱mobile
🖥️web
🗄️server
🧠machine-learning
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
OVERLORD
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#5578
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?