hw acceleration machine learning errors: RuntimeException: [ONNXRuntimeError] : #2195

Closed
opened 2026-02-05 05:36:55 +03:00 by OVERLORD · 1 comment
Owner

Originally created by @titro on GitHub (Feb 20, 2024).

The bug

i try to use openvino hw acceleration for machine learning. i also saw #6871 but don't know is that error has something to do with that issue.
using default face recognition model buffalo_l
immich_machine_learning_logs.txt

running unraid with docker on a asrock N100M platform

The OS that Immich Server is running on

unraid

Version of Immich Server

v1.95.0

Version of Immich Mobile App

v1.95.0

Platform with the issue

  • Server
  • Web
  • Mobile

Your docker-compose.yml content

version: "3.8"

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION}

    command: [ "start.sh", "immich" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - stack.env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always

  immich-microservices:
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION}
    command: [ "start.sh", "microservices" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - stack.env
    depends_on:
      - redis
      - database
    restart: always

  immich-machine-learning:
    container_name: immich_machine_learning
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION}-openvino
    volumes:
      - /mnt/user/immich/model-cache:/cache
      - /dev/bus/usb:/dev/bus/usb
    env_file:
      - stack.env
    restart: always

    device_cgroup_rules:
      - "c 189:* rmw"
    devices:
      - /dev/dri:/dev/dri





 

  redis:
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3
    restart: always

  database:
    container_name: immich_postgres
    ports:
      - 5544:5432
    image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    env_file:
      - stack.env
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      PG_DATA: /var/lib/postgresql/data
    volumes:
      - /mnt/user/immich/postgres:/var/lib/postgresql/data
    restart: always

Your .env content

DB_HOSTNAME=*
DB_USERNAME=*
DB_PASSWORD=*
DB_DATABASE_NAME=immich
REDIS_HOSTNAME=immich_redis
UPLOAD_LOCATION=/mnt/user/immich/uploads
PUBLIC_LOGIN_PAGE_MESSAGE=
IMMICH_MACHINE_LEARNING_URL=http://immich-machine-learning:3003
IMMICH_VERSION=release
LOG_LEVEL=debug

Reproduction steps

1. upload a new photo
2. check logs of machine learning container

Additional information

No response

Originally created by @titro on GitHub (Feb 20, 2024). ### The bug i try to use openvino hw acceleration for machine learning. i also saw #6871 but don't know is that error has something to do with that issue. using default face recognition model buffalo_l [immich_machine_learning_logs.txt](https://github.com/immich-app/immich/files/14351072/immich_machine_learning_logs.txt) running unraid with docker on a asrock N100M platform ### The OS that Immich Server is running on unraid ### Version of Immich Server v1.95.0 ### Version of Immich Mobile App v1.95.0 ### Platform with the issue - [X] Server - [ ] Web - [ ] Mobile ### Your docker-compose.yml content ```YAML version: "3.8" services: immich-server: container_name: immich_server image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION} command: [ "start.sh", "immich" ] volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro env_file: - stack.env ports: - 2283:3001 depends_on: - redis - database restart: always immich-microservices: container_name: immich_microservices image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION} command: [ "start.sh", "microservices" ] volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro env_file: - stack.env depends_on: - redis - database restart: always immich-machine-learning: container_name: immich_machine_learning image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION}-openvino volumes: - /mnt/user/immich/model-cache:/cache - /dev/bus/usb:/dev/bus/usb env_file: - stack.env restart: always device_cgroup_rules: - "c 189:* rmw" devices: - /dev/dri:/dev/dri redis: container_name: immich_redis image: redis:6.2-alpine@sha256:70a7a5b641117670beae0d80658430853896b5ef269ccf00d1827427e3263fa3 restart: always database: container_name: immich_postgres ports: - 5544:5432 image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0 env_file: - stack.env environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} PG_DATA: /var/lib/postgresql/data volumes: - /mnt/user/immich/postgres:/var/lib/postgresql/data restart: always ``` ### Your .env content ```Shell DB_HOSTNAME=* DB_USERNAME=* DB_PASSWORD=* DB_DATABASE_NAME=immich REDIS_HOSTNAME=immich_redis UPLOAD_LOCATION=/mnt/user/immich/uploads PUBLIC_LOGIN_PAGE_MESSAGE= IMMICH_MACHINE_LEARNING_URL=http://immich-machine-learning:3003 IMMICH_VERSION=release LOG_LEVEL=debug ``` ### Reproduction steps ```bash 1. upload a new photo 2. check logs of machine learning container ``` ### Additional information _No response_
Author
Owner

@mertalev commented on GitHub (Feb 22, 2024):

Thanks for the report! This is being tracked in #7141

@mertalev commented on GitHub (Feb 22, 2024): Thanks for the report! This is being tracked in #7141
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#2195