Dupliactes showing one duplicate group of one #3448

Closed
opened 2026-02-05 08:29:44 +03:00 by OVERLORD · 5 comments
Owner

Originally created by @Joly0 on GitHub (Jun 11, 2024).

The bug

I think the screenshot speaks for itself. But i just updated to 1.106.1 and ran the duplicate checker job, and now i can see exactly one set of duplicates with one duplicate. Why is this?

The OS that Immich Server is running on

Unraid

Version of Immich Server

1.106.1

Version of Immich Mobile App

None

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

#
# WARNING: Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
#

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      - /mnt/user/nextcloud/joly0/files/Bilder:/Bilder/joly0:ro
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always
    extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/hardware-transcoding
      file: hwaccel.transcoding.yml
      service: nvenc # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-cuda
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities:
                - gpu
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always

  redis:
    container_name: immich_redis
    image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:84882e87b54734154586e5f8abd4dce69fe7311315e2fc6d67c29614c8de2672
    restart: always

  database:
    container_name: immich_postgres
    image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      - ${DB_DATA_LOCATION}:/var/lib/postgresql/data
    restart: always
    command: ["postgres", "-c" ,"shared_preload_libraries=vectors.so", "-c", 'search_path="$$user", public, vectors', "-c", "logging_collector=on", "-c", "max_wal_size=2GB", "-c", "shared_buffers=512MB", "-c", "wal_compression=on"]

volumes:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/mnt/user/immich
# The location where your database files are stored
DB_DATA_LOCATION=/mnt/cache/appdata/postgres-immich

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
DB_PASSWORD=somerandomstring

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

Reproduction steps

1. Update to 1.106.1
2. Run update checker
3. Check for duplicates
4. idk what else, didnt do anything else

Relevant log output

No response

Additional information

grafik

Originally created by @Joly0 on GitHub (Jun 11, 2024). ### The bug I think the screenshot speaks for itself. But i just updated to 1.106.1 and ran the duplicate checker job, and now i can see exactly one set of duplicates with one duplicate. Why is this? ### The OS that Immich Server is running on Unraid ### Version of Immich Server 1.106.1 ### Version of Immich Mobile App None ### Platform with the issue - [X] Server - [X] Web - [ ] Mobile ### Your docker-compose.yml content ```YAML # # WARNING: Make sure to use the docker-compose.yml of the current release: # # https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml # # The compose file on main may not be compatible with the latest release. # name: immich services: immich-server: container_name: immich_server image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro - /mnt/user/nextcloud/joly0/files/Bilder:/Bilder/joly0:ro env_file: - .env ports: - 2283:3001 depends_on: - redis - database restart: always extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/hardware-transcoding file: hwaccel.transcoding.yml service: nvenc # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding immich-machine-learning: container_name: immich_machine_learning # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag. # Example tag: ${IMMICH_VERSION:-release}-cuda image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-cuda deploy: resources: reservations: devices: - driver: nvidia count: 1 capabilities: - gpu volumes: - model-cache:/cache env_file: - .env restart: always redis: container_name: immich_redis image: registry.hub.docker.com/library/redis:6.2-alpine@sha256:84882e87b54734154586e5f8abd4dce69fe7311315e2fc6d67c29614c8de2672 restart: always database: container_name: immich_postgres image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0 environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} POSTGRES_INITDB_ARGS: '--data-checksums' volumes: - ${DB_DATA_LOCATION}:/var/lib/postgresql/data restart: always command: ["postgres", "-c" ,"shared_preload_libraries=vectors.so", "-c", 'search_path="$$user", public, vectors', "-c", "logging_collector=on", "-c", "max_wal_size=2GB", "-c", "shared_buffers=512MB", "-c", "wal_compression=on"] volumes: model-cache: ``` ### Your .env content ```Shell # You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables # The location where your uploaded files are stored UPLOAD_LOCATION=/mnt/user/immich # The location where your database files are stored DB_DATA_LOCATION=/mnt/cache/appdata/postgres-immich # The Immich version to use. You can pin this to a specific version like "v1.71.0" IMMICH_VERSION=release # Connection secret for postgres. You should change it to a random password DB_PASSWORD=somerandomstring # The values below this line do not need to be changed ################################################################################### DB_USERNAME=postgres DB_DATABASE_NAME=immich ``` ### Reproduction steps ```bash 1. Update to 1.106.1 2. Run update checker 3. Check for duplicates 4. idk what else, didnt do anything else ``` ### Relevant log output _No response_ ### Additional information ![grafik](https://github.com/immich-app/immich/assets/13993216/605a86e1-a686-4c05-beb7-3b5c0b719953)
OVERLORD added the 🗄️server label 2026-02-05 08:29:44 +03:00
Author
Owner

@bo0tzz commented on GitHub (Jun 11, 2024):

I can confirm I'm seeing this as well. Have you changed the "max detection distance" for duplicates at all?

@bo0tzz commented on GitHub (Jun 11, 2024): I can confirm I'm seeing this as well. Have you changed the "max detection distance" for duplicates at all?
Author
Owner

@Joly0 commented on GitHub (Jun 11, 2024):

I can confirm I'm seeing this as well. Have you changed the "max detection distance" for duplicates at all?

Didnt even know there was such a setting, so no, i havent

@Joly0 commented on GitHub (Jun 11, 2024): > I can confirm I'm seeing this as well. Have you changed the "max detection distance" for duplicates at all? Didnt even know there was such a setting, so no, i havent
Author
Owner

@j-seixas commented on GitHub (Jun 14, 2024):

I've also seen this issue a couple times on my end and didn't change detection distance as well

@j-seixas commented on GitHub (Jun 14, 2024): I've also seen this issue a couple times on my end and didn't change detection distance as well
Author
Owner

@phoenixxx-1 commented on GitHub (Jun 17, 2024):

I had exactly the same behaviour, but I think I have found a fix.

My scenario was as follows:

  1. I ran the "duplicate detection" job on v1.106.1
  2. I followed through the updates to v1.106.2 / v1.106.3 / v1.106.4 sequentially and in order.
  3. I had not adjusted any detection distance or other configuration in relation to this setting from the defaults

At this point only a single image was showing on the duplicate detection utility.

I re-ran the all "duplicate detection" job at v1.106.4 and the item which was previously showing alone, now shows duplicates correctly. Running the job just for "missing" did nothing.

I hope this is helpful.

@phoenixxx-1 commented on GitHub (Jun 17, 2024): I had exactly the same behaviour, but I think I have found a fix. My scenario was as follows: 1. I ran the "duplicate detection" job on v1.106.1 2. I followed through the updates to v1.106.2 / v1.106.3 / v1.106.4 sequentially and in order. 3. I had not adjusted any detection distance or other configuration in relation to this setting from the defaults At this point only a single image was showing on the duplicate detection utility. I re-ran the all "duplicate detection" job at v1.106.4 and the item which was previously showing alone, now shows duplicates correctly. Running the job just for "missing" did nothing. I hope this is helpful.
Author
Owner

@Joly0 commented on GitHub (Jun 17, 2024):

Hey @phoenixxx-1 thanks for you suggestion, that did indeed help

@Joly0 commented on GitHub (Jun 17, 2024): Hey @phoenixxx-1 thanks for you suggestion, that did indeed help
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#3448