Exception in FACE DETECTION when using OpenVINO #2225

New Issue

Closed

opened 2026-02-05 05:47:39 +03:00 by OVERLORD · 1 comment

OVERLORD commented 2026-02-05 05:47:39 +03:00

Owner

Copy Link

Originally created by @Jinghaoma on GitHub (Feb 22, 2024).

The bug

When I ran the FACE DETECTION Job, OpenVINO did not run correctly, and part of the log obtained was added to the Additional information.
It seems to be related to #6869 but the error seems to be different.
By the way, QSV works normally when I execute TRANSCODE VIDEOS

The OS that Immich Server is running on

Unraid 6.12.3

Version of Immich Server

v1.95.1

Version of Immich Mobile App

IOS 1.95.0

Platform with the issue

• Server
• Web
• Mobile

Your docker-compose.yml content

version: "3.8"

#
# WARNING: Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
#

name: immich

services:
  immich-server:
    user: "${PUID}:${PGID}"
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    command: [ "start.sh", "immich" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - 2283:3001
    depends_on:
      - redis
      - database
    restart: always

  immich-microservices:
    user: "${PUID}:${PGID}"
    container_name: immich_microservices
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/hardware-transcoding
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    devices:
      - /dev/dri:/dev/dri
    command: [ "start.sh", "microservices" ]
    volumes:
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
      - ${APPDATA_IMMICH}/geocoding:${REVERSE_GEOCODING_DUMP_DIRECTORY}
    env_file:
      - .env
    depends_on:
      - redis
      - database
    restart: always

  immich-machine-learning:
    user: "${PUID}:${PGID}"
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-openvino
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    device_cgroup_rules:
      - "c 189:* rmw"
    devices:
      - /dev/dri:/dev/dri
    volumes:
      - /dev/bus/usb:/dev/bus/usb
      - ${APPDATA_IMMICH}/model-cache:/cache
    env_file:
      - .env
    restart: always

  redis:
    user: "${PUID}:${PGID}"
    container_name: immich_redis
    image: redis:6.2-alpine@sha256:51d6c56749a4243096327e3fb964a48ed92254357108449cb6e23999c37773c5
    restart: always
    volumes:
      - ${APPDATA_IMMICH}/redis_data:/data

  database:
    user: "${PUID}:${PGID}"
    container_name: immich_postgres
    image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - ${APPDATA_IMMICH}/pgdata:/var/lib/postgresql/data
    restart: always

volumes:
  pgdata:
  model-cache:

Your .env content

TZ="Asia/Tokyo"
PUID=1000
PGID=100
APPDATA_IMMICH=/mnt/user/appdata/immich

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=/mnt/user/Photo/immich

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
DB_PASSWORD=postgres11235813

REVERSE_GEOCODING_DUMP_DIRECTORY=/usr/src/app/geocoding

LOG_LEVEL=debug

# The values below this line do not need to be changed
###################################################################################
DB_HOSTNAME=immich_postgres
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

REDIS_HOSTNAME=immich_redis

Reproduction steps

1.Launch FACE DETECTION Job

Additional information

immich_machine_learning  | [02/22/24 22:54:35] ERROR    Exception in ASGI application                      
immich_machine_learning  |                                                                                 
immich_machine_learning  |                              ╭─────── Traceback (most recent call last) ───────╮
immich_machine_learning  |                              │ /usr/src/app/main.py:106 in predict             │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   103 │   except orjson.JSONDecodeError:        │
immich_machine_learning  |                              │   104 │   │   raise HTTPException(400, f"Invali │
immich_machine_learning  |                              │   105 │                                         │
immich_machine_learning  |                              │ ❱ 106 │   model = await load(await model_cache. │
immich_machine_learning  |                              │   107 │   model.configure(**kwargs)             │
immich_machine_learning  |                              │   108 │   outputs = await run(model.predict, in │
immich_machine_learning  |                              │   109 │   return ORJSONResponse(outputs)        │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │      image = UploadFile(filename='blob',    │ │
immich_machine_learning  |                              │ │              size=409344,                   │ │
immich_machine_learning  |                              │ │              headers=Headers({'content-dis… │ │
immich_machine_learning  |                              │ │              'form-data; name="image";      │ │
immich_machine_learning  |                              │ │              filename="blob"',              │ │
immich_machine_learning  |                              │ │              'content-type':                │ │
immich_machine_learning  |                              │ │              'application/octet-stream'}))  │ │
immich_machine_learning  |                              │ │     inputs = b'\xff\xd8\xff\xe2\x01\xf0ICC… │ │
immich_machine_learning  |                              │ │              \x00\x00mntrRGB XYZ            │ │
immich_machine_learning  |                              │ │              \x07\xe2\x00\x03\x00\x14\x00\… │ │
immich_machine_learning  |                              │ │     kwargs = {                              │ │
immich_machine_learning  |                              │ │              │   'minScore': 0.7,           │ │
immich_machine_learning  |                              │ │              │   'maxDistance': 0.6,        │ │
immich_machine_learning  |                              │ │              │   'minFaces': 3              │ │
immich_machine_learning  |                              │ │              }                              │ │
immich_machine_learning  |                              │ │ model_name = 'antelopev2'                   │ │
immich_machine_learning  |                              │ │ model_type = <ModelType.FACIAL_RECOGNITION: │ │
immich_machine_learning  |                              │ │              'facial-recognition'>          │ │
immich_machine_learning  |                              │ │    options = '{"minScore":0.7,"maxDistance… │ │
immich_machine_learning  |                              │ │       text = None                           │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/main.py:127 in load                │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   124 │   │   │   model.load()                  │
immich_machine_learning  |                              │   125 │                                         │
immich_machine_learning  |                              │   126 │   try:                                  │
immich_machine_learning  |                              │ ❱ 127 │   │   await run(_load, model)           │
immich_machine_learning  |                              │   128 │   │   return model                      │
immich_machine_learning  |                              │   129 │   except (OSError, InvalidProtobuf, Bad │
immich_machine_learning  |                              │   130 │   │   log.warning(                      │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ _load = <function load.<locals>._load at    │ │
immich_machine_learning  |                              │ │         0x14eb2a5292d0>                     │ │
immich_machine_learning  |                              │ │ model = <app.models.facial_recognition.Fac… │ │
immich_machine_learning  |                              │ │         object at 0x14eb2f7fff10>           │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/main.py:115 in run                 │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   112 async def run(func: Callable[..., Any], i │
immich_machine_learning  |                              │   113 │   if thread_pool is None:               │
immich_machine_learning  |                              │   114 │   │   return func(inputs)               │
immich_machine_learning  |                              │ ❱ 115 │   return await asyncio.get_running_loop │
immich_machine_learning  |                              │   116                                           │
immich_machine_learning  |                              │   117                                           │
immich_machine_learning  |                              │   118 async def load(model: InferenceModel) ->  │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │   func = <function load.<locals>._load at   │ │
immich_machine_learning  |                              │ │          0x14eb2a5292d0>                    │ │
immich_machine_learning  |                              │ │ inputs = <app.models.facial_recognition.Fa… │ │
immich_machine_learning  |                              │ │          object at 0x14eb2f7fff10>          │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/lib/python3.10/concurrent/futures/thread.p │
immich_machine_learning  |                              │ y:58 in run                                     │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/main.py:124 in _load               │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   121 │                                         │
immich_machine_learning  |                              │   122 │   def _load(model: InferenceModel) -> N │
immich_machine_learning  |                              │   123 │   │   with lock:                        │
immich_machine_learning  |                              │ ❱ 124 │   │   │   model.load()                  │
immich_machine_learning  |                              │   125 │                                         │
immich_machine_learning  |                              │   126 │   try:                                  │
immich_machine_learning  |                              │   127 │   │   await run(_load, model)           │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ model = <app.models.facial_recognition.Fac… │ │
immich_machine_learning  |                              │ │         object at 0x14eb2f7fff10>           │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/models/base.py:55 in load          │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │    52 │   │   │   return                        │
immich_machine_learning  |                              │    53 │   │   self.download()                   │
immich_machine_learning  |                              │    54 │   │   log.info(f"Loading {self.model_ty │
immich_machine_learning  |                              │       to memory")                               │
immich_machine_learning  |                              │ ❱  55 │   │   self._load()                      │
immich_machine_learning  |                              │    56 │   │   self.loaded = True                │
immich_machine_learning  |                              │    57 │                                         │
immich_machine_learning  |                              │    58 │   def predict(self, inputs: Any, **mode │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ self = <app.models.facial_recognition.Face… │ │
immich_machine_learning  |                              │ │        object at 0x14eb2f7fff10>            │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/models/facial_recognition.py:30 in │
immich_machine_learning  |                              │ _load                                           │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   27 │   │   super().__init__(clean_name(model_ │
immich_machine_learning  |                              │   28 │                                          │
immich_machine_learning  |                              │   29 │   def _load(self) -> None:               │
immich_machine_learning  |                              │ ❱ 30 │   │   self.det_model = RetinaFace(sessio │
immich_machine_learning  |                              │   31 │   │   self.rec_model = ArcFaceONNX(      │
immich_machine_learning  |                              │   32 │   │   │   self.rec_file.with_suffix(".on │
immich_machine_learning  |                              │   33 │   │   │   session=self._make_session(sel │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ self = <app.models.facial_recognition.Face… │ │
immich_machine_learning  |                              │ │        object at 0x14eb2f7fff10>            │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/models/base.py:127 in              │
immich_machine_learning  |                              │ _make_session                                   │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   124 │   │   │   case ".armnn":                │
immich_machine_learning  |                              │   125 │   │   │   │   session = AnnSession(mode │
immich_machine_learning  |                              │   126 │   │   │   case ".onnx":                 │
immich_machine_learning  |                              │ ❱ 127 │   │   │   │   session = ort.InferenceSe │
immich_machine_learning  |                              │   128 │   │   │   │   │   model_path.as_posix() │
immich_machine_learning  |                              │   129 │   │   │   │   │   sess_options=self.ses │
immich_machine_learning  |                              │   130 │   │   │   │   │   providers=self.provid │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │  model_path = PosixPath('/cache/facial-rec… │ │
immich_machine_learning  |                              │ │        self = <app.models.facial_recogniti… │ │
immich_machine_learning  |                              │ │               object at 0x14eb2f7fff10>     │ │
immich_machine_learning  |                              │ │ static_path = PosixPath('/cache/facial-rec… │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /opt/venv/lib/python3.10/site-packages/onnxrunt │
immich_machine_learning  |                              │ ime/capi/onnxruntime_inference_collection.py:38 │
immich_machine_learning  |                              │ 8 in __init__                                   │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   385 │   │   disabled_optimizers = kwargs["dis │
immich_machine_learning  |                              │       kwargs else None                          │
immich_machine_learning  |                              │   386 │   │                                     │
immich_machine_learning  |                              │   387 │   │   try:                              │
immich_machine_learning  |                              │ ❱ 388 │   │   │   self._create_inference_sessio │
immich_machine_learning  |                              │       disabled_optimizers)                      │
immich_machine_learning  |                              │   389 │   │   except (ValueError, RuntimeError) │
immich_machine_learning  |                              │   390 │   │   │   if self._enable_fallback:     │
immich_machine_learning  |                              │   391 │   │   │   │   try:                      │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ disabled_optimizers = None                  │ │
immich_machine_learning  |                              │ │              kwargs = {}                    │ │
immich_machine_learning  |                              │ │       path_or_bytes = '/cache/facial-recog… │ │
immich_machine_learning  |                              │ │    provider_options = [                     │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │   'device_id':  │ │
immich_machine_learning  |                              │ │                       'GPU'                 │ │
immich_machine_learning  |                              │ │                       │   },                │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │                 │ │
immich_machine_learning  |                              │ │                       'arena_extend_strate… │ │
immich_machine_learning  |                              │ │                       'kSameAsRequested'    │ │
immich_machine_learning  |                              │ │                       │   }                 │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │           providers = [                     │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'OpenVINOExecutionPr… │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'CPUExecutionProvide… │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │                self = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb3236f880>       │ │
immich_machine_learning  |                              │ │        sess_options = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb2faa5fb0>       │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /opt/venv/lib/python3.10/site-packages/onnxrunt │
immich_machine_learning  |                              │ ime/capi/onnxruntime_inference_collection.py:44 │
immich_machine_learning  |                              │ 0 in _create_inference_session                  │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   437 │   │   │   disabled_optimizers = set(dis │
immich_machine_learning  |                              │   438 │   │                                     │
immich_machine_learning  |                              │   439 │   │   # initialize the C++ InferenceSes │
immich_machine_learning  |                              │ ❱ 440 │   │   sess.initialize_session(providers │
immich_machine_learning  |                              │   441 │   │                                     │
immich_machine_learning  |                              │   442 │   │   self._sess = sess                 │
immich_machine_learning  |                              │   443 │   │   self._sess_options = self._sess.s │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ available_providers = [                     │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'OpenVINOExecutionPr… │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'CPUExecutionProvide… │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │ disabled_optimizers = set()                 │ │
immich_machine_learning  |                              │ │    provider_options = [                     │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │   'device_id':  │ │
immich_machine_learning  |                              │ │                       'GPU'                 │ │
immich_machine_learning  |                              │ │                       │   },                │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │                 │ │
immich_machine_learning  |                              │ │                       'arena_extend_strate… │ │
immich_machine_learning  |                              │ │                       'kSameAsRequested'    │ │
immich_machine_learning  |                              │ │                       │   }                 │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │           providers = [                     │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'OpenVINOExecutionPr… │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'CPUExecutionProvide… │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │                self = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb3236f880>       │ │
immich_machine_learning  |                              │ │                sess = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb2a548a30>       │ │
immich_machine_learning  |                              │ │     session_options = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb2faa5fb0>       │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              ╰─────────────────────────────────────────────────╯
immich_machine_learning  |                              RuntimeException: [ONNXRuntimeError] : 6 :         
immich_machine_learning  |                              RUNTIME_EXCEPTION : Exception during               
immich_machine_learning  |                              initialization:                                    
immich_machine_learning  |                              /home/onnxruntimedev/onnxruntime/onnxruntime/core/p
immich_machine_learning  |                              roviders/openvino/ov_interface.cc:53               
immich_machine_learning  |                              onnxruntime::openvino_ep::OVExeNetwork             
immich_machine_learning  |                              onnxruntime::openvino_ep::OVCore::LoadNetwork(const
immich_machine_learning  |                              string&, std::string&, ov::AnyMap&, std::string)   
immich_machine_learning  |                              [OpenVINO-EP]  Exception while Loading Network for 
immich_machine_learning  |                              graph:                                             
immich_machine_learning  |                              OpenVINOExecutionProvider_OpenVINO-EP-subgraph_248_
immich_machine_learning  |                              0Check 'false' failed at                           
immich_machine_learning  |                              src/inference/src/core.cpp:149:                    
immich_machine_learning  |                              invalid external data:                             
immich_machine_learning  |                              ExternalDataInfo(data_full_path: 643, offset: 0,   
immich_machine_learning  |                              data_length: 1806336)                              
immich_machine_learning  |                                                                                 
immich_machine_learning  |                                                                                 
immich_machine_learning  | [02/22/24 22:54:35] INFO     Loading facial recognition model 'antelopev2' to   
immich_machine_learning  |                              memory                                             
immich_machine_learning  | 2024-02-22 22:54:35.728848596 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '500' source:{2,10} target:{800,10}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.728891853 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '497' source:{2,4} target:{800,4}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.728923056 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '494' source:{2,1} target:{800,1}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.728989122 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '477' source:{2,10} target:{3200,10}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.729015796 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '474' source:{2,4} target:{3200,4}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.729047246 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '471' source:{2,1} target:{3200,1}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.729108030 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '454' source:{2,10} target:{12800,10}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.729136250 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '451' source:{2,4} target:{12800,4}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.729166641 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '448' source:{2,1} target:{12800,1}. Falling back to lenient merge.
immich_machine_learning  | 2024-02-22 22:54:35.759923230 [E:onnxruntime:, inference_session.cc:1754 operator()] Exception during initialization: /home/onnxruntimedev/onnxruntime/onnxruntime/core/providers/openvino/ov_interface.cc:53 onnxruntime::openvino_ep::OVExeNetwork onnxruntime::openvino_ep::OVCore::LoadNetwork(const string&, std::string&, ov::AnyMap&, std::string) [OpenVINO-EP]  Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_249_0Check 'false' failed at src/inference/src/core.cpp:149:
immich_machine_learning  | invalid external data: ExternalDataInfo(data_full_path: 643, offset: 0, data_length: 1806336)
immich_machine_learning  | 
immich_machine_learning  | 
immich_machine_learning  | [02/22/24 22:54:35] ERROR    Exception in ASGI application                      
immich_machine_learning  |                                                                                 
immich_machine_learning  |                              ╭─────── Traceback (most recent call last) ───────╮
immich_machine_learning  |                              │ /usr/src/app/main.py:106 in predict             │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   103 │   except orjson.JSONDecodeError:        │
immich_machine_learning  |                              │   104 │   │   raise HTTPException(400, f"Invali │
immich_machine_learning  |                              │   105 │                                         │
immich_machine_learning  |                              │ ❱ 106 │   model = await load(await model_cache. │
immich_machine_learning  |                              │   107 │   model.configure(**kwargs)             │
immich_machine_learning  |                              │   108 │   outputs = await run(model.predict, in │
immich_machine_learning  |                              │   109 │   return ORJSONResponse(outputs)        │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │      image = UploadFile(filename='blob',    │ │
immich_machine_learning  |                              │ │              size=574143,                   │ │
immich_machine_learning  |                              │ │              headers=Headers({'content-dis… │ │
immich_machine_learning  |                              │ │              'form-data; name="image";      │ │
immich_machine_learning  |                              │ │              filename="blob"',              │ │
immich_machine_learning  |                              │ │              'content-type':                │ │
immich_machine_learning  |                              │ │              'application/octet-stream'}))  │ │
immich_machine_learning  |                              │ │     inputs = b'\xff\xd8\xff\xe2\x01\xf0ICC… │ │
immich_machine_learning  |                              │ │              \x00\x00mntrRGB XYZ            │ │
immich_machine_learning  |                              │ │              \x07\xe2\x00\x03\x00\x14\x00\… │ │
immich_machine_learning  |                              │ │     kwargs = {                              │ │
immich_machine_learning  |                              │ │              │   'minScore': 0.7,           │ │
immich_machine_learning  |                              │ │              │   'maxDistance': 0.6,        │ │
immich_machine_learning  |                              │ │              │   'minFaces': 3              │ │
immich_machine_learning  |                              │ │              }                              │ │
immich_machine_learning  |                              │ │ model_name = 'antelopev2'                   │ │
immich_machine_learning  |                              │ │ model_type = <ModelType.FACIAL_RECOGNITION: │ │
immich_machine_learning  |                              │ │              'facial-recognition'>          │ │
immich_machine_learning  |                              │ │    options = '{"minScore":0.7,"maxDistance… │ │
immich_machine_learning  |                              │ │       text = None                           │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/main.py:127 in load                │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   124 │   │   │   model.load()                  │
immich_machine_learning  |                              │   125 │                                         │
immich_machine_learning  |                              │   126 │   try:                                  │
immich_machine_learning  |                              │ ❱ 127 │   │   await run(_load, model)           │
immich_machine_learning  |                              │   128 │   │   return model                      │
immich_machine_learning  |                              │   129 │   except (OSError, InvalidProtobuf, Bad │
immich_machine_learning  |                              │   130 │   │   log.warning(                      │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ _load = <function load.<locals>._load at    │ │
immich_machine_learning  |                              │ │         0x14eb2f7d95a0>                     │ │
immich_machine_learning  |                              │ │ model = <app.models.facial_recognition.Fac… │ │
immich_machine_learning  |                              │ │         object at 0x14eb2f7fff10>           │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/main.py:115 in run                 │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   112 async def run(func: Callable[..., Any], i │
immich_machine_learning  |                              │   113 │   if thread_pool is None:               │
immich_machine_learning  |                              │   114 │   │   return func(inputs)               │
immich_machine_learning  |                              │ ❱ 115 │   return await asyncio.get_running_loop │
immich_machine_learning  |                              │   116                                           │
immich_machine_learning  |                              │   117                                           │
immich_machine_learning  |                              │   118 async def load(model: InferenceModel) ->  │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │   func = <function load.<locals>._load at   │ │
immich_machine_learning  |                              │ │          0x14eb2f7d95a0>                    │ │
immich_machine_learning  |                              │ │ inputs = <app.models.facial_recognition.Fa… │ │
immich_machine_learning  |                              │ │          object at 0x14eb2f7fff10>          │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/lib/python3.10/concurrent/futures/thread.p │
immich_machine_learning  |                              │ y:58 in run                                     │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/main.py:124 in _load               │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   121 │                                         │
immich_machine_learning  |                              │   122 │   def _load(model: InferenceModel) -> N │
immich_machine_learning  |                              │   123 │   │   with lock:                        │
immich_machine_learning  |                              │ ❱ 124 │   │   │   model.load()                  │
immich_machine_learning  |                              │   125 │                                         │
immich_machine_learning  |                              │   126 │   try:                                  │
immich_machine_learning  |                              │   127 │   │   await run(_load, model)           │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ model = <app.models.facial_recognition.Fac… │ │
immich_machine_learning  |                              │ │         object at 0x14eb2f7fff10>           │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/models/base.py:55 in load          │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │    52 │   │   │   return                        │
immich_machine_learning  |                              │    53 │   │   self.download()                   │
immich_machine_learning  |                              │    54 │   │   log.info(f"Loading {self.model_ty │
immich_machine_learning  |                              │       to memory")                               │
immich_machine_learning  |                              │ ❱  55 │   │   self._load()                      │
immich_machine_learning  |                              │    56 │   │   self.loaded = True                │
immich_machine_learning  |                              │    57 │                                         │
immich_machine_learning  |                              │    58 │   def predict(self, inputs: Any, **mode │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ self = <app.models.facial_recognition.Face… │ │
immich_machine_learning  |                              │ │        object at 0x14eb2f7fff10>            │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/models/facial_recognition.py:30 in │
immich_machine_learning  |                              │ _load                                           │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   27 │   │   super().__init__(clean_name(model_ │
immich_machine_learning  |                              │   28 │                                          │
immich_machine_learning  |                              │   29 │   def _load(self) -> None:               │
immich_machine_learning  |                              │ ❱ 30 │   │   self.det_model = RetinaFace(sessio │
immich_machine_learning  |                              │   31 │   │   self.rec_model = ArcFaceONNX(      │
immich_machine_learning  |                              │   32 │   │   │   self.rec_file.with_suffix(".on │
immich_machine_learning  |                              │   33 │   │   │   session=self._make_session(sel │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ self = <app.models.facial_recognition.Face… │ │
immich_machine_learning  |                              │ │        object at 0x14eb2f7fff10>            │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /usr/src/app/models/base.py:127 in              │
immich_machine_learning  |                              │ _make_session                                   │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   124 │   │   │   case ".armnn":                │
immich_machine_learning  |                              │   125 │   │   │   │   session = AnnSession(mode │
immich_machine_learning  |                              │   126 │   │   │   case ".onnx":                 │
immich_machine_learning  |                              │ ❱ 127 │   │   │   │   session = ort.InferenceSe │
immich_machine_learning  |                              │   128 │   │   │   │   │   model_path.as_posix() │
immich_machine_learning  |                              │   129 │   │   │   │   │   sess_options=self.ses │
immich_machine_learning  |                              │   130 │   │   │   │   │   providers=self.provid │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │  model_path = PosixPath('/cache/facial-rec… │ │
immich_machine_learning  |                              │ │        self = <app.models.facial_recogniti… │ │
immich_machine_learning  |                              │ │               object at 0x14eb2f7fff10>     │ │
immich_machine_learning  |                              │ │ static_path = PosixPath('/cache/facial-rec… │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /opt/venv/lib/python3.10/site-packages/onnxrunt │
immich_machine_learning  |                              │ ime/capi/onnxruntime_inference_collection.py:38 │
immich_machine_learning  |                              │ 8 in __init__                                   │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   385 │   │   disabled_optimizers = kwargs["dis │
immich_machine_learning  |                              │       kwargs else None                          │
immich_machine_learning  |                              │   386 │   │                                     │
immich_machine_learning  |                              │   387 │   │   try:                              │
immich_machine_learning  |                              │ ❱ 388 │   │   │   self._create_inference_sessio │
immich_machine_learning  |                              │       disabled_optimizers)                      │
immich_machine_learning  |                              │   389 │   │   except (ValueError, RuntimeError) │
immich_machine_learning  |                              │   390 │   │   │   if self._enable_fallback:     │
immich_machine_learning  |                              │   391 │   │   │   │   try:                      │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ disabled_optimizers = None                  │ │
immich_machine_learning  |                              │ │              kwargs = {}                    │ │
immich_machine_learning  |                              │ │       path_or_bytes = '/cache/facial-recog… │ │
immich_machine_learning  |                              │ │    provider_options = [                     │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │   'device_id':  │ │
immich_machine_learning  |                              │ │                       'GPU'                 │ │
immich_machine_learning  |                              │ │                       │   },                │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │                 │ │
immich_machine_learning  |                              │ │                       'arena_extend_strate… │ │
immich_machine_learning  |                              │ │                       'kSameAsRequested'    │ │
immich_machine_learning  |                              │ │                       │   }                 │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │           providers = [                     │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'OpenVINOExecutionPr… │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'CPUExecutionProvide… │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │                self = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb34393eb0>       │ │
immich_machine_learning  |                              │ │        sess_options = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb2faa5fb0>       │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ /opt/venv/lib/python3.10/site-packages/onnxrunt │
immich_machine_learning  |                              │ ime/capi/onnxruntime_inference_collection.py:44 │
immich_machine_learning  |                              │ 0 in _create_inference_session                  │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │   437 │   │   │   disabled_optimizers = set(dis │
immich_machine_learning  |                              │   438 │   │                                     │
immich_machine_learning  |                              │   439 │   │   # initialize the C++ InferenceSes │
immich_machine_learning  |                              │ ❱ 440 │   │   sess.initialize_session(providers │
immich_machine_learning  |                              │   441 │   │                                     │
immich_machine_learning  |                              │   442 │   │   self._sess = sess                 │
immich_machine_learning  |                              │   443 │   │   self._sess_options = self._sess.s │
immich_machine_learning  |                              │                                                 │
immich_machine_learning  |                              │ ╭────────────────── locals ───────────────────╮ │
immich_machine_learning  |                              │ │ available_providers = [                     │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'OpenVINOExecutionPr… │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'CPUExecutionProvide… │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │ disabled_optimizers = set()                 │ │
immich_machine_learning  |                              │ │    provider_options = [                     │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │   'device_id':  │ │
immich_machine_learning  |                              │ │                       'GPU'                 │ │
immich_machine_learning  |                              │ │                       │   },                │ │
immich_machine_learning  |                              │ │                       │   {                 │ │
immich_machine_learning  |                              │ │                       │   │                 │ │
immich_machine_learning  |                              │ │                       'arena_extend_strate… │ │
immich_machine_learning  |                              │ │                       'kSameAsRequested'    │ │
immich_machine_learning  |                              │ │                       │   }                 │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │           providers = [                     │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'OpenVINOExecutionPr… │ │
immich_machine_learning  |                              │ │                       │                     │ │
immich_machine_learning  |                              │ │                       'CPUExecutionProvide… │ │
immich_machine_learning  |                              │ │                       ]                     │ │
immich_machine_learning  |                              │ │                self = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb34393eb0>       │ │
immich_machine_learning  |                              │ │                sess = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb2a56e870>       │ │
immich_machine_learning  |                              │ │     session_options = <onnxruntime.capi.on… │ │
immich_machine_learning  |                              │ │                       object at             │ │
immich_machine_learning  |                              │ │                       0x14eb2faa5fb0>       │ │
immich_machine_learning  |                              │ ╰─────────────────────────────────────────────╯ │
immich_machine_learning  |                              ╰─────────────────────────────────────────────────╯
immich_machine_learning  |                              RuntimeException: [ONNXRuntimeError] : 6 :         
immich_machine_learning  |                              RUNTIME_EXCEPTION : Exception during               
immich_machine_learning  |                              initialization:                                    
immich_machine_learning  |                              /home/onnxruntimedev/onnxruntime/onnxruntime/core/p
immich_machine_learning  |                              roviders/openvino/ov_interface.cc:53               
immich_machine_learning  |                              onnxruntime::openvino_ep::OVExeNetwork             
immich_machine_learning  |                              onnxruntime::openvino_ep::OVCore::LoadNetwork(const
immich_machine_learning  |                              string&, std::string&, ov::AnyMap&, std::string)   
immich_machine_learning  |                              [OpenVINO-EP]  Exception while Loading Network for 
immich_machine_learning  |                              graph:                                             
immich_machine_learning  |                              OpenVINOExecutionProvider_OpenVINO-EP-subgraph_249_
immich_machine_learning  |                              0Check 'false' failed at                           
immich_machine_learning  |                              src/inference/src/core.cpp:149:                    
immich_machine_learning  |                              invalid external data:                             
immich_machine_learning  |                              ExternalDataInfo(data_full_path: 643, offset: 0,   
immich_machine_learning  |                              data_length: 1806336)                              
immich_machine_learning  |                                                       

Originally created by @Jinghaoma on GitHub (Feb 22, 2024). ### The bug When I ran the FACE DETECTION Job, OpenVINO did not run correctly, and part of the log obtained was added to the Additional information. It seems to be related to #6869 but the error seems to be different. By the way, QSV works normally when I execute TRANSCODE VIDEOS ### The OS that Immich Server is running on Unraid 6.12.3 ### Version of Immich Server v1.95.1 ### Version of Immich Mobile App IOS 1.95.0 ### Platform with the issue - [X] Server - [ ] Web - [ ] Mobile ### Your docker-compose.yml content ```YAML version: "3.8" # # WARNING: Make sure to use the docker-compose.yml of the current release: # # https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml # # The compose file on main may not be compatible with the latest release. # name: immich services: immich-server: user: "${PUID}:${PGID}" container_name: immich_server image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} command: [ "start.sh", "immich" ] volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro env_file: - .env ports: - 2283:3001 depends_on: - redis - database restart: always immich-microservices: user: "${PUID}:${PGID}" container_name: immich_microservices image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release} # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/hardware-transcoding # file: hwaccel.transcoding.yml # service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding devices: - /dev/dri:/dev/dri command: [ "start.sh", "microservices" ] volumes: - ${UPLOAD_LOCATION}:/usr/src/app/upload - /etc/localtime:/etc/localtime:ro - ${APPDATA_IMMICH}/geocoding:${REVERSE_GEOCODING_DUMP_DIRECTORY} env_file: - .env depends_on: - redis - database restart: always immich-machine-learning: user: "${PUID}:${PGID}" container_name: immich_machine_learning # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag. # Example tag: ${IMMICH_VERSION:-release}-cuda image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}-openvino # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration # file: hwaccel.ml.yml # service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable device_cgroup_rules: - "c 189:* rmw" devices: - /dev/dri:/dev/dri volumes: - /dev/bus/usb:/dev/bus/usb - ${APPDATA_IMMICH}/model-cache:/cache env_file: - .env restart: always redis: user: "${PUID}:${PGID}" container_name: immich_redis image: redis:6.2-alpine@sha256:51d6c56749a4243096327e3fb964a48ed92254357108449cb6e23999c37773c5 restart: always volumes: - ${APPDATA_IMMICH}/redis_data:/data database: user: "${PUID}:${PGID}" container_name: immich_postgres image: tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0 environment: POSTGRES_PASSWORD: ${DB_PASSWORD} POSTGRES_USER: ${DB_USERNAME} POSTGRES_DB: ${DB_DATABASE_NAME} volumes: - ${APPDATA_IMMICH}/pgdata:/var/lib/postgresql/data restart: always volumes: pgdata: model-cache: ``` ### Your .env content ```Shell TZ="Asia/Tokyo" PUID=1000 PGID=100 APPDATA_IMMICH=/mnt/user/appdata/immich # You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables # The location where your uploaded files are stored UPLOAD_LOCATION=/mnt/user/Photo/immich # The Immich version to use. You can pin this to a specific version like "v1.71.0" IMMICH_VERSION=release # Connection secret for postgres. You should change it to a random password DB_PASSWORD=postgres11235813 REVERSE_GEOCODING_DUMP_DIRECTORY=/usr/src/app/geocoding LOG_LEVEL=debug # The values below this line do not need to be changed ################################################################################### DB_HOSTNAME=immich_postgres DB_USERNAME=postgres DB_DATABASE_NAME=immich REDIS_HOSTNAME=immich_redis ``` ### Reproduction steps ```bash 1.Launch FACE DETECTION Job ``` ### Additional information ``` immich_machine_learning | [02/22/24 22:54:35] ERROR Exception in ASGI application immich_machine_learning | immich_machine_learning | ╭─────── Traceback (most recent call last) ───────╮ immich_machine_learning | │ /usr/src/app/main.py:106 in predict │ immich_machine_learning | │ │ immich_machine_learning | │ 103 │ except orjson.JSONDecodeError: │ immich_machine_learning | │ 104 │ │ raise HTTPException(400, f"Invali │ immich_machine_learning | │ 105 │ │ immich_machine_learning | │ ❱ 106 │ model = await load(await model_cache. │ immich_machine_learning | │ 107 │ model.configure(**kwargs) │ immich_machine_learning | │ 108 │ outputs = await run(model.predict, in │ immich_machine_learning | │ 109 │ return ORJSONResponse(outputs) │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ image = UploadFile(filename='blob', │ │ immich_machine_learning | │ │ size=409344, │ │ immich_machine_learning | │ │ headers=Headers({'content-dis… │ │ immich_machine_learning | │ │ 'form-data; name="image"; │ │ immich_machine_learning | │ │ filename="blob"', │ │ immich_machine_learning | │ │ 'content-type': │ │ immich_machine_learning | │ │ 'application/octet-stream'})) │ │ immich_machine_learning | │ │ inputs = b'\xff\xd8\xff\xe2\x01\xf0ICC… │ │ immich_machine_learning | │ │ \x00\x00mntrRGB XYZ │ │ immich_machine_learning | │ │ \x07\xe2\x00\x03\x00\x14\x00\… │ │ immich_machine_learning | │ │ kwargs = { │ │ immich_machine_learning | │ │ │ 'minScore': 0.7, │ │ immich_machine_learning | │ │ │ 'maxDistance': 0.6, │ │ immich_machine_learning | │ │ │ 'minFaces': 3 │ │ immich_machine_learning | │ │ } │ │ immich_machine_learning | │ │ model_name = 'antelopev2' │ │ immich_machine_learning | │ │ model_type = <ModelType.FACIAL_RECOGNITION: │ │ immich_machine_learning | │ │ 'facial-recognition'> │ │ immich_machine_learning | │ │ options = '{"minScore":0.7,"maxDistance… │ │ immich_machine_learning | │ │ text = None │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/main.py:127 in load │ immich_machine_learning | │ │ immich_machine_learning | │ 124 │ │ │ model.load() │ immich_machine_learning | │ 125 │ │ immich_machine_learning | │ 126 │ try: │ immich_machine_learning | │ ❱ 127 │ │ await run(_load, model) │ immich_machine_learning | │ 128 │ │ return model │ immich_machine_learning | │ 129 │ except (OSError, InvalidProtobuf, Bad │ immich_machine_learning | │ 130 │ │ log.warning( │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ _load = <function load.<locals>._load at │ │ immich_machine_learning | │ │ 0x14eb2a5292d0> │ │ immich_machine_learning | │ │ model = <app.models.facial_recognition.Fac… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/main.py:115 in run │ immich_machine_learning | │ │ immich_machine_learning | │ 112 async def run(func: Callable[..., Any], i │ immich_machine_learning | │ 113 │ if thread_pool is None: │ immich_machine_learning | │ 114 │ │ return func(inputs) │ immich_machine_learning | │ ❱ 115 │ return await asyncio.get_running_loop │ immich_machine_learning | │ 116 │ immich_machine_learning | │ 117 │ immich_machine_learning | │ 118 async def load(model: InferenceModel) -> │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ func = <function load.<locals>._load at │ │ immich_machine_learning | │ │ 0x14eb2a5292d0> │ │ immich_machine_learning | │ │ inputs = <app.models.facial_recognition.Fa… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/lib/python3.10/concurrent/futures/thread.p │ immich_machine_learning | │ y:58 in run │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/main.py:124 in _load │ immich_machine_learning | │ │ immich_machine_learning | │ 121 │ │ immich_machine_learning | │ 122 │ def _load(model: InferenceModel) -> N │ immich_machine_learning | │ 123 │ │ with lock: │ immich_machine_learning | │ ❱ 124 │ │ │ model.load() │ immich_machine_learning | │ 125 │ │ immich_machine_learning | │ 126 │ try: │ immich_machine_learning | │ 127 │ │ await run(_load, model) │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ model = <app.models.facial_recognition.Fac… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/models/base.py:55 in load │ immich_machine_learning | │ │ immich_machine_learning | │ 52 │ │ │ return │ immich_machine_learning | │ 53 │ │ self.download() │ immich_machine_learning | │ 54 │ │ log.info(f"Loading {self.model_ty │ immich_machine_learning | │ to memory") │ immich_machine_learning | │ ❱ 55 │ │ self._load() │ immich_machine_learning | │ 56 │ │ self.loaded = True │ immich_machine_learning | │ 57 │ │ immich_machine_learning | │ 58 │ def predict(self, inputs: Any, **mode │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ self = <app.models.facial_recognition.Face… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/models/facial_recognition.py:30 in │ immich_machine_learning | │ _load │ immich_machine_learning | │ │ immich_machine_learning | │ 27 │ │ super().__init__(clean_name(model_ │ immich_machine_learning | │ 28 │ │ immich_machine_learning | │ 29 │ def _load(self) -> None: │ immich_machine_learning | │ ❱ 30 │ │ self.det_model = RetinaFace(sessio │ immich_machine_learning | │ 31 │ │ self.rec_model = ArcFaceONNX( │ immich_machine_learning | │ 32 │ │ │ self.rec_file.with_suffix(".on │ immich_machine_learning | │ 33 │ │ │ session=self._make_session(sel │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ self = <app.models.facial_recognition.Face… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/models/base.py:127 in │ immich_machine_learning | │ _make_session │ immich_machine_learning | │ │ immich_machine_learning | │ 124 │ │ │ case ".armnn": │ immich_machine_learning | │ 125 │ │ │ │ session = AnnSession(mode │ immich_machine_learning | │ 126 │ │ │ case ".onnx": │ immich_machine_learning | │ ❱ 127 │ │ │ │ session = ort.InferenceSe │ immich_machine_learning | │ 128 │ │ │ │ │ model_path.as_posix() │ immich_machine_learning | │ 129 │ │ │ │ │ sess_options=self.ses │ immich_machine_learning | │ 130 │ │ │ │ │ providers=self.provid │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ model_path = PosixPath('/cache/facial-rec… │ │ immich_machine_learning | │ │ self = <app.models.facial_recogniti… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ │ static_path = PosixPath('/cache/facial-rec… │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /opt/venv/lib/python3.10/site-packages/onnxrunt │ immich_machine_learning | │ ime/capi/onnxruntime_inference_collection.py:38 │ immich_machine_learning | │ 8 in __init__ │ immich_machine_learning | │ │ immich_machine_learning | │ 385 │ │ disabled_optimizers = kwargs["dis │ immich_machine_learning | │ kwargs else None │ immich_machine_learning | │ 386 │ │ │ immich_machine_learning | │ 387 │ │ try: │ immich_machine_learning | │ ❱ 388 │ │ │ self._create_inference_sessio │ immich_machine_learning | │ disabled_optimizers) │ immich_machine_learning | │ 389 │ │ except (ValueError, RuntimeError) │ immich_machine_learning | │ 390 │ │ │ if self._enable_fallback: │ immich_machine_learning | │ 391 │ │ │ │ try: │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ disabled_optimizers = None │ │ immich_machine_learning | │ │ kwargs = {} │ │ immich_machine_learning | │ │ path_or_bytes = '/cache/facial-recog… │ │ immich_machine_learning | │ │ provider_options = [ │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ 'device_id': │ │ immich_machine_learning | │ │ 'GPU' │ │ immich_machine_learning | │ │ │ }, │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ │ │ immich_machine_learning | │ │ 'arena_extend_strate… │ │ immich_machine_learning | │ │ 'kSameAsRequested' │ │ immich_machine_learning | │ │ │ } │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ providers = [ │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'OpenVINOExecutionPr… │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'CPUExecutionProvide… │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ self = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb3236f880> │ │ immich_machine_learning | │ │ sess_options = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb2faa5fb0> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /opt/venv/lib/python3.10/site-packages/onnxrunt │ immich_machine_learning | │ ime/capi/onnxruntime_inference_collection.py:44 │ immich_machine_learning | │ 0 in _create_inference_session │ immich_machine_learning | │ │ immich_machine_learning | │ 437 │ │ │ disabled_optimizers = set(dis │ immich_machine_learning | │ 438 │ │ │ immich_machine_learning | │ 439 │ │ # initialize the C++ InferenceSes │ immich_machine_learning | │ ❱ 440 │ │ sess.initialize_session(providers │ immich_machine_learning | │ 441 │ │ │ immich_machine_learning | │ 442 │ │ self._sess = sess │ immich_machine_learning | │ 443 │ │ self._sess_options = self._sess.s │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ available_providers = [ │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'OpenVINOExecutionPr… │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'CPUExecutionProvide… │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ disabled_optimizers = set() │ │ immich_machine_learning | │ │ provider_options = [ │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ 'device_id': │ │ immich_machine_learning | │ │ 'GPU' │ │ immich_machine_learning | │ │ │ }, │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ │ │ immich_machine_learning | │ │ 'arena_extend_strate… │ │ immich_machine_learning | │ │ 'kSameAsRequested' │ │ immich_machine_learning | │ │ │ } │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ providers = [ │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'OpenVINOExecutionPr… │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'CPUExecutionProvide… │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ self = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb3236f880> │ │ immich_machine_learning | │ │ sess = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb2a548a30> │ │ immich_machine_learning | │ │ session_options = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb2faa5fb0> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | ╰─────────────────────────────────────────────────╯ immich_machine_learning | RuntimeException: [ONNXRuntimeError] : 6 : immich_machine_learning | RUNTIME_EXCEPTION : Exception during immich_machine_learning | initialization: immich_machine_learning | /home/onnxruntimedev/onnxruntime/onnxruntime/core/p immich_machine_learning | roviders/openvino/ov_interface.cc:53 immich_machine_learning | onnxruntime::openvino_ep::OVExeNetwork immich_machine_learning | onnxruntime::openvino_ep::OVCore::LoadNetwork(const immich_machine_learning | string&, std::string&, ov::AnyMap&, std::string) immich_machine_learning | [OpenVINO-EP] Exception while Loading Network for immich_machine_learning | graph: immich_machine_learning | OpenVINOExecutionProvider_OpenVINO-EP-subgraph_248_ immich_machine_learning | 0Check 'false' failed at immich_machine_learning | src/inference/src/core.cpp:149: immich_machine_learning | invalid external data: immich_machine_learning | ExternalDataInfo(data_full_path: 643, offset: 0, immich_machine_learning | data_length: 1806336) immich_machine_learning | immich_machine_learning | immich_machine_learning | [02/22/24 22:54:35] INFO Loading facial recognition model 'antelopev2' to immich_machine_learning | memory immich_machine_learning | 2024-02-22 22:54:35.728848596 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '500' source:{2,10} target:{800,10}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.728891853 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '497' source:{2,4} target:{800,4}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.728923056 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '494' source:{2,1} target:{800,1}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.728989122 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '477' source:{2,10} target:{3200,10}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.729015796 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '474' source:{2,4} target:{3200,4}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.729047246 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '471' source:{2,1} target:{3200,1}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.729108030 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '454' source:{2,10} target:{12800,10}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.729136250 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '451' source:{2,4} target:{12800,4}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.729166641 [W:onnxruntime:, graph.cc:108 MergeShapeInfo] Error merging shape info for output. '448' source:{2,1} target:{12800,1}. Falling back to lenient merge. immich_machine_learning | 2024-02-22 22:54:35.759923230 [E:onnxruntime:, inference_session.cc:1754 operator()] Exception during initialization: /home/onnxruntimedev/onnxruntime/onnxruntime/core/providers/openvino/ov_interface.cc:53 onnxruntime::openvino_ep::OVExeNetwork onnxruntime::openvino_ep::OVCore::LoadNetwork(const string&, std::string&, ov::AnyMap&, std::string) [OpenVINO-EP] Exception while Loading Network for graph: OpenVINOExecutionProvider_OpenVINO-EP-subgraph_249_0Check 'false' failed at src/inference/src/core.cpp:149: immich_machine_learning | invalid external data: ExternalDataInfo(data_full_path: 643, offset: 0, data_length: 1806336) immich_machine_learning | immich_machine_learning | immich_machine_learning | [02/22/24 22:54:35] ERROR Exception in ASGI application immich_machine_learning | immich_machine_learning | ╭─────── Traceback (most recent call last) ───────╮ immich_machine_learning | │ /usr/src/app/main.py:106 in predict │ immich_machine_learning | │ │ immich_machine_learning | │ 103 │ except orjson.JSONDecodeError: │ immich_machine_learning | │ 104 │ │ raise HTTPException(400, f"Invali │ immich_machine_learning | │ 105 │ │ immich_machine_learning | │ ❱ 106 │ model = await load(await model_cache. │ immich_machine_learning | │ 107 │ model.configure(**kwargs) │ immich_machine_learning | │ 108 │ outputs = await run(model.predict, in │ immich_machine_learning | │ 109 │ return ORJSONResponse(outputs) │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ image = UploadFile(filename='blob', │ │ immich_machine_learning | │ │ size=574143, │ │ immich_machine_learning | │ │ headers=Headers({'content-dis… │ │ immich_machine_learning | │ │ 'form-data; name="image"; │ │ immich_machine_learning | │ │ filename="blob"', │ │ immich_machine_learning | │ │ 'content-type': │ │ immich_machine_learning | │ │ 'application/octet-stream'})) │ │ immich_machine_learning | │ │ inputs = b'\xff\xd8\xff\xe2\x01\xf0ICC… │ │ immich_machine_learning | │ │ \x00\x00mntrRGB XYZ │ │ immich_machine_learning | │ │ \x07\xe2\x00\x03\x00\x14\x00\… │ │ immich_machine_learning | │ │ kwargs = { │ │ immich_machine_learning | │ │ │ 'minScore': 0.7, │ │ immich_machine_learning | │ │ │ 'maxDistance': 0.6, │ │ immich_machine_learning | │ │ │ 'minFaces': 3 │ │ immich_machine_learning | │ │ } │ │ immich_machine_learning | │ │ model_name = 'antelopev2' │ │ immich_machine_learning | │ │ model_type = <ModelType.FACIAL_RECOGNITION: │ │ immich_machine_learning | │ │ 'facial-recognition'> │ │ immich_machine_learning | │ │ options = '{"minScore":0.7,"maxDistance… │ │ immich_machine_learning | │ │ text = None │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/main.py:127 in load │ immich_machine_learning | │ │ immich_machine_learning | │ 124 │ │ │ model.load() │ immich_machine_learning | │ 125 │ │ immich_machine_learning | │ 126 │ try: │ immich_machine_learning | │ ❱ 127 │ │ await run(_load, model) │ immich_machine_learning | │ 128 │ │ return model │ immich_machine_learning | │ 129 │ except (OSError, InvalidProtobuf, Bad │ immich_machine_learning | │ 130 │ │ log.warning( │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ _load = <function load.<locals>._load at │ │ immich_machine_learning | │ │ 0x14eb2f7d95a0> │ │ immich_machine_learning | │ │ model = <app.models.facial_recognition.Fac… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/main.py:115 in run │ immich_machine_learning | │ │ immich_machine_learning | │ 112 async def run(func: Callable[..., Any], i │ immich_machine_learning | │ 113 │ if thread_pool is None: │ immich_machine_learning | │ 114 │ │ return func(inputs) │ immich_machine_learning | │ ❱ 115 │ return await asyncio.get_running_loop │ immich_machine_learning | │ 116 │ immich_machine_learning | │ 117 │ immich_machine_learning | │ 118 async def load(model: InferenceModel) -> │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ func = <function load.<locals>._load at │ │ immich_machine_learning | │ │ 0x14eb2f7d95a0> │ │ immich_machine_learning | │ │ inputs = <app.models.facial_recognition.Fa… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/lib/python3.10/concurrent/futures/thread.p │ immich_machine_learning | │ y:58 in run │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/main.py:124 in _load │ immich_machine_learning | │ │ immich_machine_learning | │ 121 │ │ immich_machine_learning | │ 122 │ def _load(model: InferenceModel) -> N │ immich_machine_learning | │ 123 │ │ with lock: │ immich_machine_learning | │ ❱ 124 │ │ │ model.load() │ immich_machine_learning | │ 125 │ │ immich_machine_learning | │ 126 │ try: │ immich_machine_learning | │ 127 │ │ await run(_load, model) │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ model = <app.models.facial_recognition.Fac… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/models/base.py:55 in load │ immich_machine_learning | │ │ immich_machine_learning | │ 52 │ │ │ return │ immich_machine_learning | │ 53 │ │ self.download() │ immich_machine_learning | │ 54 │ │ log.info(f"Loading {self.model_ty │ immich_machine_learning | │ to memory") │ immich_machine_learning | │ ❱ 55 │ │ self._load() │ immich_machine_learning | │ 56 │ │ self.loaded = True │ immich_machine_learning | │ 57 │ │ immich_machine_learning | │ 58 │ def predict(self, inputs: Any, **mode │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ self = <app.models.facial_recognition.Face… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/models/facial_recognition.py:30 in │ immich_machine_learning | │ _load │ immich_machine_learning | │ │ immich_machine_learning | │ 27 │ │ super().__init__(clean_name(model_ │ immich_machine_learning | │ 28 │ │ immich_machine_learning | │ 29 │ def _load(self) -> None: │ immich_machine_learning | │ ❱ 30 │ │ self.det_model = RetinaFace(sessio │ immich_machine_learning | │ 31 │ │ self.rec_model = ArcFaceONNX( │ immich_machine_learning | │ 32 │ │ │ self.rec_file.with_suffix(".on │ immich_machine_learning | │ 33 │ │ │ session=self._make_session(sel │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ self = <app.models.facial_recognition.Face… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /usr/src/app/models/base.py:127 in │ immich_machine_learning | │ _make_session │ immich_machine_learning | │ │ immich_machine_learning | │ 124 │ │ │ case ".armnn": │ immich_machine_learning | │ 125 │ │ │ │ session = AnnSession(mode │ immich_machine_learning | │ 126 │ │ │ case ".onnx": │ immich_machine_learning | │ ❱ 127 │ │ │ │ session = ort.InferenceSe │ immich_machine_learning | │ 128 │ │ │ │ │ model_path.as_posix() │ immich_machine_learning | │ 129 │ │ │ │ │ sess_options=self.ses │ immich_machine_learning | │ 130 │ │ │ │ │ providers=self.provid │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ model_path = PosixPath('/cache/facial-rec… │ │ immich_machine_learning | │ │ self = <app.models.facial_recogniti… │ │ immich_machine_learning | │ │ object at 0x14eb2f7fff10> │ │ immich_machine_learning | │ │ static_path = PosixPath('/cache/facial-rec… │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /opt/venv/lib/python3.10/site-packages/onnxrunt │ immich_machine_learning | │ ime/capi/onnxruntime_inference_collection.py:38 │ immich_machine_learning | │ 8 in __init__ │ immich_machine_learning | │ │ immich_machine_learning | │ 385 │ │ disabled_optimizers = kwargs["dis │ immich_machine_learning | │ kwargs else None │ immich_machine_learning | │ 386 │ │ │ immich_machine_learning | │ 387 │ │ try: │ immich_machine_learning | │ ❱ 388 │ │ │ self._create_inference_sessio │ immich_machine_learning | │ disabled_optimizers) │ immich_machine_learning | │ 389 │ │ except (ValueError, RuntimeError) │ immich_machine_learning | │ 390 │ │ │ if self._enable_fallback: │ immich_machine_learning | │ 391 │ │ │ │ try: │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ disabled_optimizers = None │ │ immich_machine_learning | │ │ kwargs = {} │ │ immich_machine_learning | │ │ path_or_bytes = '/cache/facial-recog… │ │ immich_machine_learning | │ │ provider_options = [ │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ 'device_id': │ │ immich_machine_learning | │ │ 'GPU' │ │ immich_machine_learning | │ │ │ }, │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ │ │ immich_machine_learning | │ │ 'arena_extend_strate… │ │ immich_machine_learning | │ │ 'kSameAsRequested' │ │ immich_machine_learning | │ │ │ } │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ providers = [ │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'OpenVINOExecutionPr… │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'CPUExecutionProvide… │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ self = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb34393eb0> │ │ immich_machine_learning | │ │ sess_options = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb2faa5fb0> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | │ │ immich_machine_learning | │ /opt/venv/lib/python3.10/site-packages/onnxrunt │ immich_machine_learning | │ ime/capi/onnxruntime_inference_collection.py:44 │ immich_machine_learning | │ 0 in _create_inference_session │ immich_machine_learning | │ │ immich_machine_learning | │ 437 │ │ │ disabled_optimizers = set(dis │ immich_machine_learning | │ 438 │ │ │ immich_machine_learning | │ 439 │ │ # initialize the C++ InferenceSes │ immich_machine_learning | │ ❱ 440 │ │ sess.initialize_session(providers │ immich_machine_learning | │ 441 │ │ │ immich_machine_learning | │ 442 │ │ self._sess = sess │ immich_machine_learning | │ 443 │ │ self._sess_options = self._sess.s │ immich_machine_learning | │ │ immich_machine_learning | │ ╭────────────────── locals ───────────────────╮ │ immich_machine_learning | │ │ available_providers = [ │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'OpenVINOExecutionPr… │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'CPUExecutionProvide… │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ disabled_optimizers = set() │ │ immich_machine_learning | │ │ provider_options = [ │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ 'device_id': │ │ immich_machine_learning | │ │ 'GPU' │ │ immich_machine_learning | │ │ │ }, │ │ immich_machine_learning | │ │ │ { │ │ immich_machine_learning | │ │ │ │ │ │ immich_machine_learning | │ │ 'arena_extend_strate… │ │ immich_machine_learning | │ │ 'kSameAsRequested' │ │ immich_machine_learning | │ │ │ } │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ providers = [ │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'OpenVINOExecutionPr… │ │ immich_machine_learning | │ │ │ │ │ immich_machine_learning | │ │ 'CPUExecutionProvide… │ │ immich_machine_learning | │ │ ] │ │ immich_machine_learning | │ │ self = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb34393eb0> │ │ immich_machine_learning | │ │ sess = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb2a56e870> │ │ immich_machine_learning | │ │ session_options = <onnxruntime.capi.on… │ │ immich_machine_learning | │ │ object at │ │ immich_machine_learning | │ │ 0x14eb2faa5fb0> │ │ immich_machine_learning | │ ╰─────────────────────────────────────────────╯ │ immich_machine_learning | ╰─────────────────────────────────────────────────╯ immich_machine_learning | RuntimeException: [ONNXRuntimeError] : 6 : immich_machine_learning | RUNTIME_EXCEPTION : Exception during immich_machine_learning | initialization: immich_machine_learning | /home/onnxruntimedev/onnxruntime/onnxruntime/core/p immich_machine_learning | roviders/openvino/ov_interface.cc:53 immich_machine_learning | onnxruntime::openvino_ep::OVExeNetwork immich_machine_learning | onnxruntime::openvino_ep::OVCore::LoadNetwork(const immich_machine_learning | string&, std::string&, ov::AnyMap&, std::string) immich_machine_learning | [OpenVINO-EP] Exception while Loading Network for immich_machine_learning | graph: immich_machine_learning | OpenVINOExecutionProvider_OpenVINO-EP-subgraph_249_ immich_machine_learning | 0Check 'false' failed at immich_machine_learning | src/inference/src/core.cpp:149: immich_machine_learning | invalid external data: immich_machine_learning | ExternalDataInfo(data_full_path: 643, offset: 0, immich_machine_learning | data_length: 1806336) immich_machine_learning | ```

OVERLORD closed this issue 2026-02-05 05:47:45 +03:00

OVERLORD commented 2026-02-05 05:47:48 +03:00

Author

Owner

Copy Link

@mertalev commented on GitHub (Feb 22, 2024):

I believe this is the same issue as the linked discussion. We're waiting on a new release of onnxruntime-openvino to have it fixed.

@mertalev commented on GitHub (Feb 22, 2024): I believe this is the same issue as the linked discussion. We're waiting on a new release of onnxruntime-openvino to have it fixed.

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

fix/web-people-hidden-state

fix-filename-search-label

chore/yank-cloud-id

chore/oauth-labels

renovate/machine-learning

uhthomas/mobile-fix-app-bar-fade

feat/debug-schema

renovate/typescript-projects

fix/25803

feat/asset-file-apis

chore/translations

fix/web-switch-label-clickable

release/next

fix/timezones

fix/time-zone-upserts

midzelis/wip

push-zpwsovysllvn

push-nwxlpmyzkyrl

push-nvnkszuqwppm

renovate/github-actions

push-smstsuupsowp

refactor/adaptive_image

push-olwpzvrxnomt

push-lmxsupnmxspl

feat/web-chromecast-video-looping

feat/use-native-clients

renovate/flutter

fix/create-face-edited

fix/mobile-ios-mtls

docs/contributing

docs/mise-mobile

renovate/grafana-monorepo

feature/bottom-buttons-order

feat/immich-mobile-ui-showcase

refactor/consolidate-image-requests

renovate/connectivity_plus-7.x

renovate/major-vitest-monorepo

renovate/pypi-python-multipart-vulnerability

fix/mobile-people-query

sqlite_thumbs

feat/html-text

chore/no-macro-validation

refactor/purchase-store

uhthomas/mobile-fix-asset-jump

feat/pano-ocr

feat/shared-link-login

fix/database-backup-db-names

fix-keep-correct-ios-shared-album-asset

fix-memory-generation-and-display

feat/verify-permissions

refactor/album-service-small-tests

fix/ml-rocm-build

fix/flipped-dimensions-mobile

push-vpxwmwwxwnvw

fix-migration-width-height

refactor/more-queries

revert/prettier-translations

refactor/asset-service-queries

fix/locale-settings-desc

chore/add-debug-log

feat/edit-filters

shared-deep-link-handler

feat/mobile-editing

feat/thumbnail-native-clients

feat/platform-clients

feat/integrity-checks-izzy

fix/foreground-cloud-sync

feat/dynamic-layout

filter-by-person

feat/csp

refactor/sidebar

fix/disable-editing

fix/view-timeline-deeplink

image-zoom-on-slow-connection

fix-consider-dar-for-video-dimension

fix/merged-edited-assets

perf/optimize-album-sort

open-api-fix

feat/create-job-with-dto

use-toast-primary

feat/vitest-4

feat/ios-fastlane-match

match-signing

fix-update-time-update-timeline

chore/translation-keys

feat/modal-routes

feat/panorama-tiles

feature/mobile-view-asset-owner

feat/system-settings

feature/show-activity-count

better-info-in-asset-viewer

fix/all-people-count

feat/location-favorites

feature/rearrange-buttons-2

fix/download-storage-template

feat/kb-shortcuts-mobile

fix/people-count

push-qolzzzzxrvvn

chore/originals-in-asset-files

feat/asset-size-columns

ben/tree-a11y

new-search-filter-ui

refactor/expectSelectedReadonly

refactor/mobile-grdb

push-qvuktpxmkknu

feat/mobile-native-local-sync

refactor/timeline_ops

fix/scrubber_end

feat/version.txt

feat/context-menus

feat/server-chunked-uploads

refactor/virtualsegment

refactor/rename_daymonth_groups

fix/restrict-android-bg-worker

feat/android-periodic-worker

fix-remote-sync-clean-up

refactor/timeline_move_ops

renovate/mapbox-mapbox-gl-rtl-text-0.x

fix/timeline_split_selectable

feat/keyboard_actions_help_modal

feat/static_frontend

feat/notification-warnign-android

feat/plugins2

feat/plugins

test/create-workflow-token-action

fix/docs-force

debug/search-result-similarity

debug/cf-chunked-uploads

feat/eslint_rule

feat/search-filter-album/web

refactor/timeline_photostream

refactor/timelineasset_asset

feat/session-permissions

feat/timeline_photostream_assetnav

feat/timeline_minor_optimize

feat/timeline_perf_nocomp

feat/timeline_search_results_actions

feat/timeline_search_results_page

fix/timeline_padding

fix/timeline_search_reactivity_warnings

feat/timeline_scrollbar

feat/timeline_stream_withviewer

fix/timeline_back_forth_nav

refactor/timeline_photostream_component

fix/generated-files-checks

fix/locate-button-local

chore/base-image-mimalloc

refactor/timeline_assetlayout

refactor/timeline_selectable

refactor/timeline_aware_actions

refactor/timeline_monthsegment

feat/remove-old-pages

chore/deps-gradle

tmp_photostream

tmp/lcms

feat/mobile-dynamic-thumbnails

fix/mobile-finer-thumbnail-concurrency

refactor/timeline1

refactor/extract_photostream

refactor/rename_load_api

refactor/timeline2

refactor/timeline3

feat/multi-select-asset-viewer

feat-no-thumbhash-cache

refactor/asset_grid

feat/faster-access-checks

fix/18991

fix/19543

chore/temp-remove

fix/21419

feat/mobile-hdr-images

chore/update-mise-lockfile

feat/mise-server-checks

feat/mise-ci

feat/windows-2025

feat/dev_cli

refactor/mobile-migrate-clients

fix/map-theme

fix/require-checkbox

chore/use_swc

feat/efficient-thumbnail-decoding

refactor/mobile-thumbhash

refactor/mobile-thumbhash-new

fix/mobile-uncached-zoom

feat/beta-background-upload

fix/beta-timeline-memories-setting

fix/failed-uploads-not-removed

feat/mobile-shared-album

feat/groups

drift-map-page

drift-auth-user-sync

fix/disable-memory

feat/add-to-album-action

edit-date-time-action

drift-people-page

sqlite-remove-isIn

feat/inline-storage-columns

chore/required-reviewers

refact/asset-manager

fix/folder-sort

pnpm

feat/widget-multiple-server-urls

chore/medium-tests-dbname

fix/web-no-iterator-find

fix/map-pan-interruption

track-livephotos

timeline_events

chore/oxlint-migration

feat/maintenance-worker

feat/dav

chore/demo-snapshot

refactor/server-side-dedupe

feat/integrity-checks

dev/recognition-eval

lighter_buckets_test

perf/postgres-queue

postgres-queue

focus_rings

refactor/web-stores-1

refactor/add-to-taken

feat/sort-places

feat/sidecar-asset-file

vet

tmp/demo-snapshot-preview

fix/server-migration-file-extension

refactor/mobile-v2

fix/asset-update-race-condition

rknn-toolkit-lite2

refactor/mobile-split-up-search-page

feature/Add-rocm-support-for-machine-learning

feat/rocm

chore/async-hash-file

feat/shared-link-view-count

feat/rotation

feat/graphql

feat/job-ids

feat/ignore-library-permission-error

feat/docker-compose-builder

feat/kysely-typeorm

mobile/onboarding

no-video-player

fix/server-qsv-output-format

chore/server-geodata-tweaks

mobile/native-video-player-no-hero

feat/xxhash

fix/docs-concurrency

feat/preload-ml-textual-model

feat/local-tileserver

refactor/exif-orientation

original-path-infix

refactor/mobile/login-form-1

feat/server-editor-endpoints

fix/server-qsv-vbr

fix-mobile-db-problems

feat/ml-armnn-conversion

feat/mobile/backup-with-album-info

feat/fast-initial-sync-1

chore/handle-output_dims

feat/server-more-robust-generation

feat/unassign-faces

feat/shortcuts-on-asset-grid

feat/background-upload

feat/capacitor-mobile-app-poc

feat/server-nvenc-hw-decoding

release/v1.105

fix/mobile-fetch-non-archive

feat/fine-grained-access-controls

web/automation-ui

feat/mobile-server-endpoint-save-dropdown

feat/blurhash-thumbnail

object-storage

feat/memories-animations

dev/metrics

ml/tflite

feat/ml-export-cli

v2.5.3

v2.5.2

v2.5.1

v2.5.0

v2.4.1

v2.4.0

v2.3.1

v2.3.0

v2.2.3

v2.2.2

v2.2.1

v2.2.0

v2.1.0

v2.0.1

v2.0.0

v1.144.1

v1.144.0

v1.143.1

v1.143.0

v1.142.1

v1.142.0

v1.141.1

v1.141.0

v1.140.1

v1.140.0

v1.139.4

v1.139.3

v1.139.2

v1.139.1

v1.139.0

v1.138.1

v1.138.0

v1.137.3

v1.137.2

v1.137.1

v1.137.0

v1.136.0

v1.135.3

v1.135.2

v1.135.1

v1.135.0

v1.134.0

v1.133.1

v1.133.0

v1.132.3

v1.132.2

v1.132.1

v1.132.0

v1.131.3

v1.131.2

v1.131.1

v1.131.0

v1.130.3

v1.130.2

v1.130.1

v1.130.0

v1.129.0

v1.128.0

v1.127.0

v1.126.1

v1.126.0

v1.125.7

v1.125.6

v1.125.5

v1.125.4

v1.125.3

v1.125.2

v1.125.1

v1.125.0

v1.124.2

v1.124.1

v1.124.0

v1.123.0

v1.122.3

v1.122.2

v1.122.1

v1.122.0

v1.121.0

v1.120.2

v1.120.1

v1.120.0

v1.119.1

v1.119.0

v1.118.2

v1.118.1

v1.118.0

v1.117.0

v1.116.2

v1.116.1

v1.116.0

v1.115.0

v1.114.0

v1.113.1

v1.113.0

v1.112.1

v1.112.0

v1.111.0

v1.110.0

v1.109.2

v1.109.1

v1.109.0

v1.108.0

v1.107.2

v1.107.1

v1.107.0

v1.106.4

v1.106.3

v1.106.2

v1.106.1

v1.106.0

v1.105.1

v1.105.0

v1.104.0

v1.103.1

v1.103.0

v1.102.3

v1.102.2

v1.102.1

v1.102.0

v1.101.0

v1.100.0

v1.99.0

v1.98.2

v1.98.1

v1.98.0

v1.97.0

v1.96.0

v1.95.1

v1.95.0

v1.94.1

v1.94.0

v1.93.3

v1.93.2

v1.93.1

v1.93.0

v1.92.1

v1.92.0

v1.91.4

v1.91.3

v1.91.2

v1.91.1

v1.91.0

v1.90.2

v1.90.1

v1.90.0

v1.89.0

v1.88.2

v1.88.1

v1.88.0

v1.87.0

v1.86.0

v1.85.0

v1.84.0

v1.83.0

v1.82.1

v1.82.0

v1.81.1

v1.81.0

v1.80.0

v1.79.1

v1.79.0

v1.78.1

v1.78.0

v1.77.0

v1.76.1

v1.76.0

v1.75.2

v1.75.1

v1.75.0

v1.74.0

v1.73.0

v1.72.2

v1.72.1

v1.72.0

v1.71.0

v1.70.0

v1.69.0

v1.68.0

v1.67.2

v1.67.1

v1.67.0

v1.66.1

v1.66.0

v1.65.0

v1.64.0

v1.63.2

v1.63.1

v1.63.0

v1.62.1

v1.62.0

v1.61.0

v1.60.0

v1.59.1

v1.59.0

v1.58.0

v1.57.1

v1.57.0

v1.56.2

v1.56.1

v1.56.0

v1.55.1

v1.55.0

v1.54.1

v1.54.0

v1.53.0

v1.52.1

v1.52.0

v1.51.2

v1.51.1

v1.51.0

v1.50.1

v1.50.0

v1.49.0

v1.48.1

v1.48.0

v1.47.3

v1.47.2

v1.47.1

v1.47.0

v1.46.1

v1.46.0

v1.45.0

v1.44.0

v1.43.1

v1.43.0

v1.42.0_65-dev

v1.41.1_64-dev

v1.41.0_64-dev

v1.40.1_63-dev

v1.40.0_63-dev

v1.39.0_61-dev

v1.38.2_60-dev

v1.38.1_60-dev

v1.38.0_60-dev

v1.37.0_58-dev

v1.36.2_56-dev

v1.36.1_55-dev

v1.36.0_55-dev

v1.35.0_54-dev

v1.34.0_53-dev

v1.33.1_52-dev

v1.33.0_52-dev

v1.32.1_51-dev

v1.32.0_50-dev

v1.31.1_49-dev

v1.31.0_49-dev

v1.30.2_48-dev

v1.30.0_46-dev

v1.29.6_45-dev

v1.29.6_44-dev

v1.29.5_44-dev

v1.29.4_44-dev

v1.29.3_43-dev

v1.29.2_43-dev

v1.29.1_43-dev

v1.29.0_42-dev

v1.28.4_41-dev

v1.28.4_42-dev

v1.28.3_41-dev

v1.28.2_40-dev

v1.28.1_39-dev

v1.28.0_38-dev

v1.27.0_37-dev

v1.26.0_36-dev

v1.25.0_35-dev

v1.24.0_34-dev

v1.23.0_33-dev

v1.22.0_32-dev

v1.21.1_31-dev

v1.21.0_31-dev

v1.20.3_30-dev

v1.20.2_30-dev

v1.20.1_30-dev

v1.20.0_30-dev

v1.19.1_29-dev

v1.19.0_29-dev

v1.18.0_27-dev

v1.17.0_25-dev

v1.16.0_23-dev

v1.15.1_21-dev

v1.15.0_21-dev

v1.14.0_21-dev

v1.13.0_20-dev

v1.12.0_18-dev

v1.11.0_17-dev

v1.10.0_15-dev

v1.9.1_14-dev

v1.9.0_13-dev

v1.8.0_12-dev

v1.7.0_11-dev

v1.6.0_10-dev

v1.5.1+9-dev

v1.5.0+8-dev

v1.4.0+7-dev

v1.4.0+6-dev

v1.4.0-dev

v1.3.0-dev

v1.3.1-dev

v0.6-dev

v0.5-dev

v0.4-dev

v0.3-dev

v0.2-dev

first-android-release

Labels

Clear labels

accessibility

changelog:enhancement

changelog:security

changelog:skip

changelog:translation

cli

date-time

documentation

external-library

format

good first issue

needs-answer

nice to have

sharing

tech-debt

📱mobile

🖥️web

🗄️server

🧠machine-learning

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

OVERLORD

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: immich-app/immich#2225