Cannot import 150GB worth of pictures using external library managment #2762

Closed
opened 2026-02-05 06:59:52 +03:00 by OVERLORD · 5 comments
Owner

Originally created by @Rashoooodi on GitHub (Apr 5, 2024).

The bug

Basically, I am trying to add my Camera Roll (From OneDrive (150GB Approximately)) but it is stuck at 0 bytes and 0 assets

The OS that Immich Server is running on

OpenMediaVault (Debian)

Version of Immich Server

v1.1.0

Version of Immich Mobile App

v1.1.0

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: ['start.sh', 'immich']
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https:/>
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl>
    command: ['start.sh', 'microservices']
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    depends_on:
      - redis
      - database
    restart: always

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the ima>
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https:/>
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for >
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  redis:
    container_name: immich_redis
    image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:51d6c56749a4>
    restart: always

  database:
    container_name: immich_postgres
    image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90>
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

volumes:
  pgdata:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://imm>

# The location where your uploaded files are stored
UPLOAD_LOCATION=./library

# The Immich version to use. You can pin this to a specific version like "v1.71>
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
DB_PASSWORD=eastereggforgithub

# The values below this line do not need to be changed
###############################################################################>
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

Reproduction steps

1. Added my Camera Roll (From OneDrive) folder to Immich's docker container, 
2. Went and added it using the "External Library Managment" 
3. You will see that it at 0 assets and 0 bytes
4. Trying to refresh it won't do anything
5. Tried to force-rescan but dosen't work

Additional information

Nothing at all

Originally created by @Rashoooodi on GitHub (Apr 5, 2024). ### The bug Basically, I am trying to add my Camera Roll (From OneDrive (150GB Approximately)) but it is stuck at 0 bytes and 0 assets ### The OS that Immich Server is running on OpenMediaVault (Debian) ### Version of Immich Server v1.1.0 ### Version of Immich Mobile App v1.1.0 ### Platform with the issue - [X] Server - [X] Web - [ ] Mobile ### Your docker-compose.yml content ```YAML name: immich services: immich-server: container_name: immich_server image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} command: ['start.sh', 'immich'] volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro env_file: - .env ports: - 2283:3001 depends_on: - redis - database restart: always immich-microservices: container_name: immich_microservices image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} # extends: # uncomment this section for hardware acceleration - see https:/> # file: hwaccel.transcoding.yml # service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl> command: ['start.sh', 'microservices'] volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro env_file: - .env depends_on: - redis - database restart: always immich-machine-learning: container_name: immich_machine_learning # For hardware acceleration, add one of -[armnn, cuda, openvino] to the ima> # Example tag: ${IMMICH_VERSION:-release}-cuda image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release} # extends: # uncomment this section for hardware acceleration - see https:/> # file: hwaccel.ml.yml # service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for > volumes: - model-cache:/cache env_file: - .env restart: always redis: container_name: immich_redis image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:51d6c56749a4> restart: always database: container_name: immich_postgres image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90> environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} volumes: - pgdata:/var/lib/postgresql/data restart: always volumes: pgdata: model-cache: ``` ### Your .env content ```Shell # You can find documentation for all the supported env variables at https://imm> # The location where your uploaded files are stored UPLOAD_LOCATION=./library # The Immich version to use. You can pin this to a specific version like "v1.71> IMMICH_VERSION=release # Connection secret for postgres. You should change it to a random password DB_PASSWORD=eastereggforgithub # The values below this line do not need to be changed ###############################################################################> DB_HOSTNAME=immich_postgres DB_USERNAME=postgres DB_DATABASE_NAME=immich REDIS_HOSTNAME=immich_redis ``` ### Reproduction steps ```bash 1. Added my Camera Roll (From OneDrive) folder to Immich's docker container, 2. Went and added it using the "External Library Managment" 3. You will see that it at 0 assets and 0 bytes 4. Trying to refresh it won't do anything 5. Tried to force-rescan but dosen't work ``` ### Additional information Nothing at all
Author
Owner

@bo0tzz commented on GitHub (Apr 5, 2024):

Do you have the files stored locally, or did you add the mounted onedrive folder directly? I wouldn't be surprised if the latter doesn't work, since onedrive then does some filesystem tricks to make it look like the files are there while actually just streaming them from the cloud.

Need this fixed ASAP

This is inappropriate. We're all volunteers contributing to Immich in our free time, not paid support workers here to fix your problems as fast as possible.

@bo0tzz commented on GitHub (Apr 5, 2024): Do you have the files stored locally, or did you add the mounted onedrive folder directly? I wouldn't be surprised if the latter doesn't work, since onedrive then does some filesystem tricks to make it look like the files are there while actually just streaming them from the cloud. > Need this fixed ASAP This is inappropriate. We're all volunteers contributing to Immich in our free time, not paid support workers here to fix your problems as fast as possible.
Author
Owner

@Rashoooodi commented on GitHub (Apr 5, 2024):

Thanks @bo0tzz for the reply,

They are stored locally and not rcloned

This is inappropriate

I am really sorry about that, hope that didn't mess your day up or something

@Rashoooodi commented on GitHub (Apr 5, 2024): Thanks @bo0tzz for the reply, They are stored locally and not rcloned > This is inappropriate I am really sorry about that, hope that didn't mess your day up or something
Author
Owner

@bo0tzz commented on GitHub (Apr 5, 2024):

All good :)

In your compose file I don't see any mounts for an external library, are you sure you added it? Pointing UPLOAD_LOCATION at a folder with existing files won't work, the UPLOAD_LOCATION needs to be empty.

@bo0tzz commented on GitHub (Apr 5, 2024): All good :) In your compose file I don't see any mounts for an external library, are you sure you added it? Pointing UPLOAD_LOCATION at a folder with existing files won't work, the UPLOAD_LOCATION needs to be empty.
Author
Owner

@Rashoooodi commented on GitHub (Apr 5, 2024):

I mean that is what it says here so i dunno

and double checked after restarting

image

image image image
@Rashoooodi commented on GitHub (Apr 5, 2024): I mean that is what it says here so i dunno and double checked after restarting ![image](https://github.com/immich-app/immich/assets/76240202/062a0d51-b542-489b-ae07-3c4fb850aaee) <img width="1314" alt="image" src="https://github.com/immich-app/immich/assets/76240202/5f81e5b4-1ffb-4ce2-a3f7-e3c96de4191c"> <img width="346" alt="image" src="https://github.com/immich-app/immich/assets/76240202/19f2d1f5-c11a-46ec-95b8-700a6f8b9c14"> <img width="1355" alt="image" src="https://github.com/immich-app/immich/assets/76240202/cdeaf031-88c6-4ede-b8dd-3b2109f25621">
Author
Owner

@bo0tzz commented on GitHub (Apr 5, 2024):

You also need to mount the files into the container. Did you read the docs and guide?

@bo0tzz commented on GitHub (Apr 5, 2024): You also need to mount the files into the container. Did you read the [docs](https://immich.app/docs/features/libraries) and [guide](https://immich.app/docs/guides/external-library/)?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#2762