api/assets take 10000 crashes server with out of memory (64gb system) #3052

New Issue

OVERLORD · 2026-02-05T07:33:44+03:00

OVERLORD commented

2026-02-05 07:33:44 +03:00

Originally created by @Dankni95 on GitHub (May 3, 2024).

The bug

api/asset?skip=10000&take=10000&updatedBefore=2024-05-03T07%3A53%3A04.610024Z&userId=xxxx

Crashes my server,

if i run api call with take 5000 my server does not crash api/asset?skip=10000&take=5000&updatedBefore=2024-05-03T07%3A53%3A04.610024Z&userId=xxxx

It seems to me like JSON.stringify is running out of memory when stringifying too many objects.

More info from other places i have posted this issue:

Im getting this error that crashes immich_server when building the timeline.

04/23/2024
11:06:53 PM
<--- Last few GCs --->
04/23/2024
11:06:53 PM
04/23/2024
11:06:53 PM
[6:0x5d52e330000]   917559 ms: Scavenge (reduce) 2044.8 (2081.5) -> 2044.1 (2081.8) MB, 7.28 / 0.00 ms  (average mu = 0.338, current mu = 0.325) allocation failure; 
04/23/2024
11:06:53 PM
[6:0x5d52e330000]   917618 ms: Scavenge (reduce) 2044.9 (2081.8) -> 2044.2 (2081.8) MB, 5.81 / 0.00 ms  (average mu = 0.338, current mu = 0.325) allocation failure; 
04/23/2024
11:06:53 PM
[6:0x5d52e330000]   917681 ms: Scavenge (reduce) 2045.0 (2081.8) -> 2044.4 (2082.0) MB, 4.54 / 0.00 ms  (average mu = 0.338, current mu = 0.325) allocation failure; 
04/23/2024
11:06:53 PM
04/23/2024
11:06:53 PM
04/23/2024
11:06:53 PM
<--- JS stacktrace --->
04/23/2024
11:06:53 PM
04/23/2024
11:06:53 PM
FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
04/23/2024
11:06:53 PM
----- Native stack trace -----
04/23/2024
11:06:53 PM
04/23/2024
11:06:53 PM
 1: 0xb84bd6 node::OOMErrorHandler(char const*, v8::OOMDetails const&) [immich_server]
04/23/2024
11:06:53 PM
 2: 0xefeb90 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [immich_server]
04/23/2024
11:06:53 PM
 3: 0xefee77 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [immich_server]
04/23/2024
11:06:53 PM
 4: 0x1110885  [immich_server]
04/23/2024
11:06:53 PM
 5: 0x1110e14 v8::internal::Heap::RecomputeLimits(v8::internal::GarbageCollector) [immich_server]
04/23/2024
11:06:53 PM
 6: 0x1127d04 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::internal::GarbageCollectionReason, char const*) [immich_server]
04/23/2024
11:06:53 PM
 7: 0x112851c v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [immich_server]
04/23/2024
11:06:53 PM
 8: 0x112a67a v8::internal::Heap::HandleGCRequest() [immich_server]
04/23/2024
11:06:53 PM
 9: 0x1095ce7 v8::internal::StackGuard::HandleInterrupts() [immich_server]
04/23/2024
11:06:53 PM
10: 0x1537542 v8::internal::Runtime_StackGuardWithGap(int, unsigned long*, v8::internal::Isolate*) [immich_server]
04/23/2024
11:06:53 PM
11: 0x7fc429e99ef6

Server crashes before reaching 4.3 gb of ram, when i added- NODE_OPTIONS="--max-old-space-size=24000" it now reaches 8gb on my 64gb system.

With the env variable i got this error:

Nest] 7  - 04/22/2024, 5:51:27 PM   ERROR [ExceptionsHandler] Invalid string length
04/22/2024
07:51:27 PM
RangeError: Invalid string length
04/22/2024
07:51:27 PM
    at JSON.stringify (<anonymous>)
04/22/2024
07:51:27 PM
    at stringify (/usr/src/app/node_modules/express/lib/response.js:1159:12)
04/22/2024
07:51:27 PM
    at ServerResponse.json (/usr/src/app/node_modules/express/lib/response.js:272:14)
04/22/2024
07:51:27 PM
    at ExpressAdapter.reply (/usr/src/app/node_modules/@nestjs/platform-express/adapters/express-adapter.js:62:62)
04/22/2024
07:51:27 PM
    at RouterResponseController.apply (/usr/src/app/node_modules/@nestjs/core/router/router-response-controller.js:15:36)
04/22/2024
07:51:27 PM
    at /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:176:48
04/22/2024
07:51:27 PM
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
04/22/2024
07:51:27 PM
    at async /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:47:13
04/22/2024
07:51:27 PM
    at async /usr/src/app/node_modules/@nestjs/core/router/router-proxy.js:9:17

This is only for 18k photos for this user, total 30k, 64gb allocated.
Help much appreciated.

The OS that Immich Server is running on

Ubuntu 22.10

Version of Immich Server

latest

Version of Immich Mobile App

latest

Platform with the issue

Server
Web
Mobile

Your docker-compose.yml content

Can post if really needed

Your .env content

no env

Reproduction steps

1. upload 15k assets on web
2. try to build timeline on ios/android
3. or call api `api/asset?skip=10000&take=10000&updatedBefore=2024-05-03T07%3A53%3A04.610024Z&userId=xxxx`
...

Relevant log output

Nest] 7  - 04/22/2024, 5:51:27 PM   ERROR [ExceptionsHandler] Invalid string length
04/22/2024
07:51:27 PM
RangeError: Invalid string length
04/22/2024
07:51:27 PM
    at JSON.stringify (<anonymous>)
04/22/2024
07:51:27 PM
    at stringify (/usr/src/app/node_modules/express/lib/response.js:1159:12)
04/22/2024
07:51:27 PM
    at ServerResponse.json (/usr/src/app/node_modules/express/lib/response.js:272:14)
04/22/2024
07:51:27 PM
    at ExpressAdapter.reply (/usr/src/app/node_modules/@nestjs/platform-express/adapters/express-adapter.js:62:62)
04/22/2024
07:51:27 PM
    at RouterResponseController.apply (/usr/src/app/node_modules/@nestjs/core/router/router-response-controller.js:15:36)
04/22/2024
07:51:27 PM
    at /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:176:48
04/22/2024
07:51:27 PM
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
04/22/2024
07:51:27 PM
    at async /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:47:13
04/22/2024
07:51:27 PM
    at async /usr/src/app/node_modules/@nestjs/core/router/router-proxy.js:9:17

Additional information

No response

Originally created by @Dankni95 on GitHub (May 3, 2024). ### The bug `` api/asset?skip=10000&take=10000&updatedBefore=2024-05-03T07%3A53%3A04.610024Z&userId=xxxx `` Crashes my server, if i run api call with take 5000 my server does not crash `api/asset?skip=10000&take=5000&updatedBefore=2024-05-03T07%3A53%3A04.610024Z&userId=xxxx` It seems to me like JSON.stringify is running out of memory when stringifying too many objects. More info from other places i have posted this issue: Im getting this error that crashes immich_server when building the timeline. ``` 04/23/2024 11:06:53 PM <--- Last few GCs ---> 04/23/2024 11:06:53 PM 04/23/2024 11:06:53 PM [6:0x5d52e330000] 917559 ms: Scavenge (reduce) 2044.8 (2081.5) -> 2044.1 (2081.8) MB, 7.28 / 0.00 ms (average mu = 0.338, current mu = 0.325) allocation failure; 04/23/2024 11:06:53 PM [6:0x5d52e330000] 917618 ms: Scavenge (reduce) 2044.9 (2081.8) -> 2044.2 (2081.8) MB, 5.81 / 0.00 ms (average mu = 0.338, current mu = 0.325) allocation failure; 04/23/2024 11:06:53 PM [6:0x5d52e330000] 917681 ms: Scavenge (reduce) 2045.0 (2081.8) -> 2044.4 (2082.0) MB, 4.54 / 0.00 ms (average mu = 0.338, current mu = 0.325) allocation failure; 04/23/2024 11:06:53 PM 04/23/2024 11:06:53 PM 04/23/2024 11:06:53 PM <--- JS stacktrace ---> 04/23/2024 11:06:53 PM 04/23/2024 11:06:53 PM FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory 04/23/2024 11:06:53 PM ----- Native stack trace ----- 04/23/2024 11:06:53 PM 04/23/2024 11:06:53 PM 1: 0xb84bd6 node::OOMErrorHandler(char const*, v8::OOMDetails const&) [immich_server] 04/23/2024 11:06:53 PM 2: 0xefeb90 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [immich_server] 04/23/2024 11:06:53 PM 3: 0xefee77 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [immich_server] 04/23/2024 11:06:53 PM 4: 0x1110885 [immich_server] 04/23/2024 11:06:53 PM 5: 0x1110e14 v8::internal::Heap::RecomputeLimits(v8::internal::GarbageCollector) [immich_server] 04/23/2024 11:06:53 PM 6: 0x1127d04 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::internal::GarbageCollectionReason, char const*) [immich_server] 04/23/2024 11:06:53 PM 7: 0x112851c v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [immich_server] 04/23/2024 11:06:53 PM 8: 0x112a67a v8::internal::Heap::HandleGCRequest() [immich_server] 04/23/2024 11:06:53 PM 9: 0x1095ce7 v8::internal::StackGuard::HandleInterrupts() [immich_server] 04/23/2024 11:06:53 PM 10: 0x1537542 v8::internal::Runtime_StackGuardWithGap(int, unsigned long*, v8::internal::Isolate*) [immich_server] 04/23/2024 11:06:53 PM 11: 0x7fc429e99ef6 ``` Server crashes before reaching 4.3 gb of ram, when i added```- NODE_OPTIONS="--max-old-space-size=24000"``` it now reaches 8gb on my 64gb system. With the env variable i got this error: ``` Nest] 7 - 04/22/2024, 5:51:27 PM ERROR [ExceptionsHandler] Invalid string length 04/22/2024 07:51:27 PM RangeError: Invalid string length 04/22/2024 07:51:27 PM at JSON.stringify (<anonymous>) 04/22/2024 07:51:27 PM at stringify (/usr/src/app/node_modules/express/lib/response.js:1159:12) 04/22/2024 07:51:27 PM at ServerResponse.json (/usr/src/app/node_modules/express/lib/response.js:272:14) 04/22/2024 07:51:27 PM at ExpressAdapter.reply (/usr/src/app/node_modules/@nestjs/platform-express/adapters/express-adapter.js:62:62) 04/22/2024 07:51:27 PM at RouterResponseController.apply (/usr/src/app/node_modules/@nestjs/core/router/router-response-controller.js:15:36) 04/22/2024 07:51:27 PM at /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:176:48 04/22/2024 07:51:27 PM at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 04/22/2024 07:51:27 PM at async /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:47:13 04/22/2024 07:51:27 PM at async /usr/src/app/node_modules/@nestjs/core/router/router-proxy.js:9:17 ``` This is only for 18k photos for this user, total 30k, 64gb allocated. Help much appreciated. ### The OS that Immich Server is running on Ubuntu 22.10 ### Version of Immich Server latest ### Version of Immich Mobile App latest ### Platform with the issue - [X] Server - [X] Web - [X] Mobile ### Your docker-compose.yml content ```YAML Can post if really needed ``` ### Your .env content ```Shell no env ``` ### Reproduction steps ```bash 1. upload 15k assets on web 2. try to build timeline on ios/android 3. or call api `api/asset?skip=10000&take=10000&updatedBefore=2024-05-03T07%3A53%3A04.610024Z&userId=xxxx` ... ``` ### Relevant log output ```shell Nest] 7 - 04/22/2024, 5:51:27 PM ERROR [ExceptionsHandler] Invalid string length 04/22/2024 07:51:27 PM RangeError: Invalid string length 04/22/2024 07:51:27 PM at JSON.stringify (<anonymous>) 04/22/2024 07:51:27 PM at stringify (/usr/src/app/node_modules/express/lib/response.js:1159:12) 04/22/2024 07:51:27 PM at ServerResponse.json (/usr/src/app/node_modules/express/lib/response.js:272:14) 04/22/2024 07:51:27 PM at ExpressAdapter.reply (/usr/src/app/node_modules/@nestjs/platform-express/adapters/express-adapter.js:62:62) 04/22/2024 07:51:27 PM at RouterResponseController.apply (/usr/src/app/node_modules/@nestjs/core/router/router-response-controller.js:15:36) 04/22/2024 07:51:27 PM at /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:176:48 04/22/2024 07:51:27 PM at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 04/22/2024 07:51:27 PM at async /usr/src/app/node_modules/@nestjs/core/router/router-execution-context.js:47:13 04/22/2024 07:51:27 PM at async /usr/src/app/node_modules/@nestjs/core/router/router-proxy.js:9:17 ``` ### Additional information _No response_

OVERLORD closed this issue

2026-02-05 07:33:47 +03:00

OVERLORD commented

2026-02-05 07:33:50 +03:00

@bo0tzz commented on GitHub (May 3, 2024):

I don't know if there's anything we can do to make take=10000 possible, I'm inclined to just say "don't do that" :P Maybe we should limit that parameter to an amount that won't crash things though.

@bo0tzz commented on GitHub (May 3, 2024): I don't know if there's anything we can do to make `take=10000` possible, I'm inclined to just say "don't do that" :P Maybe we should limit that parameter to an amount that won't crash things though.

OVERLORD referenced this issue

2026-02-05 14:11:31 +03:00

[PR #3052] fix(server): h264 and hevc not respecting max bitrate #9833

Sign in to join this conversation.

Branches Tags

main

chore/translations

fix/partner-ownership-contention

renovate/machine-learning

renovate/pypi-pillow-vulnerability

renovate/pypi-pydantic-settings-vulnerability

renovate/java-25.x

renovate/mobile

chore/harden-mobile-openapi-gen

renovate/java-21.x

fix/min-faces

refactor/asset-update

feat/merge-people-mobile

chore/face-cluster-abstraction

refactor/search-v3/pr-2a

fcast

fix/android-local-album-date

fix/24545-sync-retry-cx

fix/android-locked-folder-delete

make-sure-memory-widget-render

chore/freezed-example

fix/clamp-local-date-time-to-valid-value

fix/datetime-max-limit

fix/viewer-long-image-aspect

feat/native-core

feat/yucca-integration

refactor/mobile-actions

fix/ws-reconnect-battery

renovate/sharp

renovate/pigeon-27.x

refactor/auto-trash-sync

feat/release-source-branch

refactor/session-repository

fix/library-map-live-bounds-updates

renovate/permission_handler-12.x

renovate/node-24.x

fix/mobile-scroll-velocity-placeholders

fix/library-map-loading-flash

agg23/appbar-experiments

renovate/pep621-lock-file-maintenance-machine-learning

refactor/undo-actions

refactor/actions

feat/restore-action

feat/delete-action

fix/29853-thumbnail-decode-size

bugfix/live-photo-stuck

feature/load-previews

chore/pub-upgrade

custom-app-logo

fix/failed-sync-blocks-resume

feat/ml-hwaccel-testing

feat/workflow-logs

feat/server-chunked-uploads

feat/upload-action

fix-29727

feat/download-tag-action

feat/share-action

feat/album-actions

fix/android-cr3-save

feat/browser-profile-action

feat/cast-slideshow-action

feat/locked-folder-action

fix/unauthorized-memory-creation

feat/context-actions

refactor/action-class

feat/memories-view

refactor/asset-action-filter

feat/archive-action

feat/stack-action

feat/mobile-hls-player

refactor/stack-actions

feat/workflow-asset-tags

fix/timeline-drag-select-stops

fix/featured-photo-thumbnail-cache

fix/album-timeline-date-ordering

chore/album-remove-assets

feat/partner-table-permissions

fix/ocr-after-edit

fix/re-enable-pruning

refactor/delete-restore-actions

apk-build-deployment

edit-photo-stacking

fix/mise-lockfile

feat/web-hls-hover

refactor/store-cleanup

fix/hash-mismatch

refactor/app-metadata

refactor/advanced-settings

refactor/current-user

fix/dedupe-integrity-missing-paths

chore/albums-select

fix/fdroid-meta

refactor/per-asset-backup-flag

fix/av1-threads

fix/pass-secrets

fix/download-progress-stuck

fix/negative-backup-remainder

feat/map-asset-number

test-bump-prerelease

fix/handle-unlinking-motion-photos

fix/date-range-formatting

fix/mobile-album-action-msg

asset-add-to-album-trigger

refactor/face-editor-decoupling

feat/zoom-aware-face-editing

refactor/adaptive-image-dimensions

fix-face-editor-video-preview

fix-stack-face-tag-selection

fix/face-boxes-edit-panel

workflow-webhook-step

feat/hero_view_transitions

fix/map-sidepanel-queries

feat/dart-openapi-generator

claude/share-quality-5d7Gn

drag-drop-ghost-target

refactor/workflow-page

refactor/mobile-upload

fix-scroll-flicker-2

update-mise-lock-file

feat/kysely-0.29

release-candidate-flow-1

fix/mobile-22522-sqlite-2067

fix/job-lock

release-candidate-flow-3

release-candidate-flow-2

show-in-timeline-toggle

fix/mise-windows

plan-local-image-display

fix/remote-thumbnail-fallback

chore/riverpod-update

album-order-per-user

fix/web-timeline-dom-node-retention

chore/svelte-enable-state-referenced-locally

feat/favorite-albums

feat/patch-release-from-branch

fix/oauth-linking

feat/timeline_scroll_buffer

panorama-face-overlay

push-txxyuusptoru

push-zpwsovysllvn

chore/queue-endpoint-migration

fix/remove-from-album

chore/thumbnail-histogram

fix/video-thumbnail-bindthis-regression

fix/scrubber-drag-edge-cases

fix/timeline_layout_row_height

refactor-cancellable-task

uhthomas/fix-mobile-use-timer

uhthomas/fix-mobile-video-controls-key

uhthomas/chore-mobile-search-declarative

owner-role-album-user

feat/livephoto-editing

favorite-albums

uhthomas/fix-mobile-isolate-auth

fix/library-watcher-excludes

chore/library-e2e-to-medium

push-ynllunsvrpxy

fix/dont-delete-offline-library-files

push-zvwwxmvkrspv

push-kywsnvvkwzts

push-xxnxokokzrou

push-voozlrlkxsnu

view-in-timeline-transition

push-uymvmlknxpmx

push-qslzsplnusoz

fix/mobile-video-stall

uhthomas/draft-mobile-image-cache-cancel

push-yquostpqnkxp

feat/vitest-4

claude/offload-icloud-hashing-bI3GZ

midzelis/wip

uhthomas/fix-server-fsync-all

feat/mobile-widget-shared-client

push-lnyuzsutzkqq

push-vqqqxxvkunru

push-wvnmqoswptww

push-nwxlpmyzkyrl

fix/map-webgl-error

fix/mobile-player-fit

feat/panorama-tiles

csp-policy

push-rsywxvptwxuv

refactor/restores-file-interceptor

postgres-socketio

claude/auto-screenshot-web-changes-Y7efI

visual-review/pr-26535

push-lvyturrtwkrq

feat/library-offline-count

fix/mobile-video-aspect-ratio

uhthomas/fix-mobile-search-results

uhthomas/feat-sort-smart-search

uhthomas/chore-mobile-maplibre

uhthomas/mobile-fix-asset-details-album-pop

feat/crawl-wrapper

push-skvzqoozqkpl

feat/edit-filters

feat/pg-queue

refactor/asset-upload

better-project-structure

uhthomas/mobile-feat-asset-viewer-details

fix/ml-rocm-build

feat/asset-file-apis

feature/bottom-buttons-order

sqlite_thumbs

fix-keep-correct-ios-shared-album-asset

push-vpxwmwwxwnvw

fix-migration-width-height

shared-deep-link-handler

feat/thumbnail-native-clients

feat/platform-clients

fix/foreground-cloud-sync

filter-by-person

refactor/sidebar

fix/merged-edited-assets

feat/create-job-with-dto

feat/ios-fastlane-match

match-signing

fix-update-time-update-timeline

feat/modal-routes

feature/mobile-view-asset-owner

feat/system-settings

feature/show-activity-count

feat/location-favorites

feature/rearrange-buttons-2

fix/download-storage-template

chore/originals-in-asset-files

ben/tree-a11y

new-search-filter-ui

refactor/expectSelectedReadonly

refactor/mobile-grdb

feat/mobile-native-local-sync

refactor/timeline_ops

fix/scrubber_end

refactor/virtualsegment

refactor/rename_daymonth_groups

fix-remote-sync-clean-up

debug/cf-chunked-uploads

feat/search-filter-album/web

feat/session-permissions

feat/mobile-dynamic-thumbnails

refactor/extract_photostream

refactor/rename_load_api

refactor/timeline2

refactor/timeline3

feat-no-thumbhash-cache

feat/mobile-hdr-images

feat/beta-background-upload

fix/beta-timeline-memories-setting

fix/failed-uploads-not-removed

feat/groups

drift-map-page

feat/add-to-album-action

track-livephotos

feat/maintenance-worker

refactor/server-side-dedupe

feat/integrity-checks

dev/recognition-eval

lighter_buckets_test

perf/postgres-queue

tmp/demo-snapshot-preview

fix/server-migration-file-extension

rknn-toolkit-lite2

feature/Add-rocm-support-for-machine-learning

chore/async-hash-file

feat/shared-link-view-count

feat/graphql

no-video-player

fix/server-qsv-output-format

chore/server-geodata-tweaks

mobile/native-video-player-no-hero

feat/local-tileserver

feat/ml-armnn-conversion

chore/handle-output_dims

feat/capacitor-mobile-app-poc

feat/server-nvenc-hw-decoding

web/automation-ui

object-storage

ml/tflite

feat/ml-export-cli

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: immich-app/immich#3052