immich-app/immich
1
0
Fork 0
mirror of https://github.com/immich-app/immich.git synced 2026-07-25 14:00:45 +03:00
Code Issues 783 Packages Projects Releases 22 Wiki Activity

Too many files open error #7008

New Issue
Open
opened 2026-02-05 12:42:54 +03:00 by OVERLORD · 8 comments
OVERLORD commented 2026-02-05 12:42:54 +03:00
Owner
Copy Link

Originally created by @ghost on GitHub (Aug 28, 2025).

I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.

  • Yes

The bug

Scanning an external library that has about 18.5k files - seeing an error in the logs:

30a1579cb204"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/imported/2023'

Error: EMFILE: too many open files, scandir '/external/alon/imported/2023'

[Nest] 7  - 08/28/2025, 4:33:42 PM   ERROR [Microservices:{"id":"0d50810d-adfc-4bd7-b3f4-3884065b0936"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08'

Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08'

[Nest] 7  - 08/28/2025, 4:33:42 PM   ERROR [Microservices:{"id":"8a7df0f7-0f61-4429-a6e0-9162a99cfbef"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/camera-roll/2007/2007-08-14'

I saw there were similar issues that were closed last year: https://github.com/immich-app/immich/issues/8592

I'm on server version: v1.139.2

The OS that Immich Server is running on

macOS (Docker Desktop)

Version of Immich Server

v1.139.2

Version of Immich Mobile App

v1.139.3

Platform with the issue

  • Server
  • Web
  • Mobile

Device make and model

No response

Your docker-compose.yml content

#
# WARNING: To install Immich, follow our guide: https://immich.app/docs/install/docker-compose
#
# Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - ${UPLOAD_LOCATION}:/data
      - /etc/localtime:/etc/localtime:ro
      - "/Volumes/Media/Photos/alon/camera_roll:/external/alon/camera-roll:ro"
      - "/Volumes/Media/Photos/alon/imported:/external/alon/imported:ro"
      - "/Volumes/Media/Photos/shared:/external/shared"
      - "/Volumes/Media/Photos/joanna/camera_roll:/external/joanna/camera-roll:ro"
    env_file:
      - .env
    ports:
      - '2283:2283'
    depends_on:
      - redis
      - database
    restart: always
    healthcheck:
      disable: false

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, rocm, openvino, rknn] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, rocm, openvino, openvino-wsl, rknn] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always
    healthcheck:
      disable: false

  redis:
    container_name: immich_redis
    image: docker.io/valkey/valkey:8-bookworm@sha256:a137a2b60aca1a75130022d6bb96af423fefae4eb55faf395732db3544803280
    healthcheck:
      test: redis-cli ping || exit 1
    restart: always

  database:
    container_name: immich_postgres
    image: ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:32324a2f41df5de9efe1af166b7008c3f55646f8d0e00d9550c16c9822366b4a
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
      # Uncomment the DB_STORAGE_TYPE: 'HDD' var if your database isn't stored on SSDs
      # DB_STORAGE_TYPE: 'HDD'
    volumes:
      # Do not edit the next line. If you want to change the database storage location on your system, edit the value of DB_DATA_LOCATION in the .env file
      - ${DB_DATA_LOCATION}:/var/lib/postgresql/data
    shm_size: 128mb
    restart: always

volumes:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library

# The location where your database files are stored. Network shares are not supported for the database
DB_DATA_LOCATION=./postgres

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
# TZ=America/New_York

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=postgres

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

Reproduction steps

  1. Scanned my external library via Immich Web UI

...

Relevant log output


Error: EMFILE: too many open files, scandir '/external/alon/imported/2023'

[Nest] 7  - 08/28/2025, 4:33:42 PM   ERROR [Microservices:{"id":"0d50810d-adfc-4bd7-b3f4-3884065b0936"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08'

Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08'

[Nest] 7  - 08/28/2025, 4:33:42 PM   ERROR [Microservices:{"id":"8a7df0f7-0f61-4429-a6e0-9162a99cfbef"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/camera-roll/2007/2007-08-14'

Additional information

No response

Originally created by @ghost on GitHub (Aug 28, 2025). ### I have searched the existing issues, both open and closed, to make sure this is not a duplicate report. - [x] Yes ### The bug Scanning an external library that has about 18.5k files - seeing an error in the logs: ``` 30a1579cb204"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/imported/2023' Error: EMFILE: too many open files, scandir '/external/alon/imported/2023' [Nest] 7 - 08/28/2025, 4:33:42 PM ERROR [Microservices:{"id":"0d50810d-adfc-4bd7-b3f4-3884065b0936"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08' Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08' [Nest] 7 - 08/28/2025, 4:33:42 PM ERROR [Microservices:{"id":"8a7df0f7-0f61-4429-a6e0-9162a99cfbef"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/camera-roll/2007/2007-08-14' ``` I saw there were similar issues that were closed last year: https://github.com/immich-app/immich/issues/8592 I'm on server version: v1.139.2 ### The OS that Immich Server is running on macOS (Docker Desktop) ### Version of Immich Server v1.139.2 ### Version of Immich Mobile App v1.139.3 ### Platform with the issue - [x] Server - [ ] Web - [ ] Mobile ### Device make and model _No response_ ### Your docker-compose.yml content ```YAML # # WARNING: To install Immich, follow our guide: https://immich.app/docs/install/docker-compose # # Make sure to use the docker-compose.yml of the current release: # # https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml # # The compose file on main may not be compatible with the latest release. name: immich services: immich-server: container_name: immich_server image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} # extends: # file: hwaccel.transcoding.yml # service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding volumes: # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file - ${UPLOAD_LOCATION}:/data - /etc/localtime:/etc/localtime:ro - "/Volumes/Media/Photos/alon/camera_roll:/external/alon/camera-roll:ro" - "/Volumes/Media/Photos/alon/imported:/external/alon/imported:ro" - "/Volumes/Media/Photos/shared:/external/shared" - "/Volumes/Media/Photos/joanna/camera_roll:/external/joanna/camera-roll:ro" env_file: - .env ports: - '2283:2283' depends_on: - redis - database restart: always healthcheck: disable: false immich-machine-learning: container_name: immich_machine_learning # For hardware acceleration, add one of -[armnn, cuda, rocm, openvino, rknn] to the image tag. # Example tag: ${IMMICH_VERSION:-release}-cuda image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release} # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration # file: hwaccel.ml.yml # service: cpu # set to one of [armnn, cuda, rocm, openvino, openvino-wsl, rknn] for accelerated inference - use the `-wsl` version for WSL2 where applicable volumes: - model-cache:/cache env_file: - .env restart: always healthcheck: disable: false redis: container_name: immich_redis image: docker.io/valkey/valkey:8-bookworm@sha256:a137a2b60aca1a75130022d6bb96af423fefae4eb55faf395732db3544803280 healthcheck: test: redis-cli ping || exit 1 restart: always database: container_name: immich_postgres image: ghcr.io/immich-app/postgres:14-vectorchord0.4.3-pgvectors0.2.0@sha256:32324a2f41df5de9efe1af166b7008c3f55646f8d0e00d9550c16c9822366b4a environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} POSTGRES_INITDB_ARGS: '--data-checksums' # Uncomment the DB_STORAGE_TYPE: 'HDD' var if your database isn't stored on SSDs # DB_STORAGE_TYPE: 'HDD' volumes: # Do not edit the next line. If you want to change the database storage location on your system, edit the value of DB_DATA_LOCATION in the .env file - ${DB_DATA_LOCATION}:/var/lib/postgresql/data shm_size: 128mb restart: always volumes: model-cache: ``` ### Your .env content ```Shell # You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables # The location where your uploaded files are stored UPLOAD_LOCATION=./library # The location where your database files are stored. Network shares are not supported for the database DB_DATA_LOCATION=./postgres # To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List # TZ=America/New_York # The Immich version to use. You can pin this to a specific version like "v1.71.0" IMMICH_VERSION=release # Connection secret for postgres. You should change it to a random password # Please use only the characters `A-Za-z0-9`, without special characters or spaces DB_PASSWORD=postgres # The values below this line do not need to be changed ################################################################################### DB_USERNAME=postgres DB_DATABASE_NAME=immich ``` ### Reproduction steps 1. Scanned my external library via Immich Web UI 2. 3. ... ### Relevant log output ```30a1579cb204"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/imported/2023' Error: EMFILE: too many open files, scandir '/external/alon/imported/2023' [Nest] 7 - 08/28/2025, 4:33:42 PM ERROR [Microservices:{"id":"0d50810d-adfc-4bd7-b3f4-3884065b0936"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08' Error: EMFILE: too many open files, scandir '/external/joanna/camera-roll/2020/2020-08-08' [Nest] 7 - 08/28/2025, 4:33:42 PM ERROR [Microservices:{"id":"8a7df0f7-0f61-4429-a6e0-9162a99cfbef"}] Unable to run job handler (LibrarySyncFilesQueueAll): Error: EMFILE: too many open files, scandir '/external/alon/camera-roll/2007/2007-08-14' ``` ### Additional information _No response_
OVERLORD commented 2026-02-05 12:42:56 +03:00
Author
Owner
Copy Link

@bo0tzz commented on GitHub (Aug 28, 2025):

@etnoy what do you think? To me this seems like the system limits should just be upped?

@bo0tzz commented on GitHub (Aug 28, 2025): @etnoy what do you think? To me this seems like the system limits should just be upped?
OVERLORD commented 2026-02-05 12:42:57 +03:00
Author
Owner
Copy Link

@ghost commented on GitHub (Aug 28, 2025):

@etnoy what do you think? To me this seems like the system limits should just be upped?

FWIW:

docker exec -it immich_server bash
root@55b5fdc58c92:/usr/src/app# ulimit -n
1048576
root@55b5fdc58c92:/usr/src/app# exit
exit
@ghost commented on GitHub (Aug 28, 2025): > [@etnoy](https://github.com/etnoy) what do you think? To me this seems like the system limits should just be upped? FWIW: ``` docker exec -it immich_server bash root@55b5fdc58c92:/usr/src/app# ulimit -n 1048576 root@55b5fdc58c92:/usr/src/app# exit exit ```
OVERLORD commented 2026-02-05 12:42:58 +03:00
Author
Owner
Copy Link

@etnoy commented on GitHub (Aug 28, 2025):

Can you confirm if the experimental library watcher is enabled or not?

@etnoy commented on GitHub (Aug 28, 2025): Can you confirm if the experimental library watcher is enabled or not?
OVERLORD commented 2026-02-05 12:42:58 +03:00
Author
Owner
Copy Link

@ghost commented on GitHub (Aug 28, 2025):

Currently, off.

Image
@ghost commented on GitHub (Aug 28, 2025): Currently, off. <img width="992" height="667" alt="Image" src="https://github.com/user-attachments/assets/55b7757f-210b-46db-a976-988676d1cec9" />
OVERLORD commented 2026-02-05 12:42:58 +03:00
Author
Owner
Copy Link

@ghost commented on GitHub (Aug 31, 2025):

Not sure it's related but ever since I started seeing this error, no new photos that are added to my external library folder are showing up in Immich, despite rerunning the scan multiple times, validating import paths, etc.

@ghost commented on GitHub (Aug 31, 2025): Not sure it's related but ever since I started seeing this error, no new photos that are added to my external library folder are showing up in Immich, despite rerunning the scan multiple times, validating import paths, etc.
OVERLORD commented 2026-02-05 12:42:59 +03:00
Author
Owner
Copy Link

@jesperordrup commented on GitHub (Nov 29, 2025):

I get

[Nest] 35 - 11/29/2025, 5:27:26 PM ERROR [Api:ErrorInterceptor~phhl7i19] Unknown error: Error: EMFILE: too many open files, mkdir '/data/upload/b55b9580-11d3-4906-b90e-f11f2fe4d0e2/5b/8d'

while uploading using api with immich-go on a freshinstalled 231

@jesperordrup commented on GitHub (Nov 29, 2025): I get `[Nest] 35 - 11/29/2025, 5:27:26 PM ERROR [Api:ErrorInterceptor~phhl7i19] Unknown error: Error: EMFILE: too many open files, mkdir '/data/upload/b55b9580-11d3-4906-b90e-f11f2fe4d0e2/5b/8d'` while uploading using api with immich-go on a freshinstalled 231
OVERLORD commented 2026-02-05 12:42:59 +03:00
Author
Owner
Copy Link

@etnoy commented on GitHub (Nov 29, 2025):

Try raising the watcher limit

https://docs.immich.app/features/libraries/#troubleshooting-1

@etnoy commented on GitHub (Nov 29, 2025): Try raising the watcher limit https://docs.immich.app/features/libraries/#troubleshooting-1
OVERLORD commented 2026-02-05 12:42:59 +03:00
Author
Owner
Copy Link

@jesperordrup commented on GitHub (Dec 1, 2025):

Its set to 4m / 4000000

cat /proc/sys/fs/inotify/max_user_watches
4000000
@jesperordrup commented on GitHub (Dec 1, 2025): Its set to 4m / 4000000 ``` cat /proc/sys/fs/inotify/max_user_watches 4000000
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
accessibility
changelog:enhancement
changelog:security
changelog:skip
changelog:translation
cli
date-time
dependencies
documentation
external-library
format
good first issue
mobile-beta
mobile-beta
mobile-beta
needs-answer
nice to have
pull-request
Mirrored from GitHub Pull Request
 sharing
tech-debt
📱mobile
🖥️web
🗄️server
🧠machine-learning
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
OVERLORD
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#7008
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?