immich-app/immich
1
0
Fork 0
mirror of https://github.com/immich-app/immich.git synced 2026-02-05 00:30:57 +03:00
Code Issues 13 Packages Projects Releases 10 Wiki Activity

Hardware acceleration transcoding option for videos #534

New Issue
Closed
opened 2026-02-04 21:13:00 +03:00 by OVERLORD · 10 comments
OVERLORD commented 2026-02-04 21:13:00 +03:00
Owner
Copy Link

Originally created by @Daniel-Cloud23 on GitHub (Dec 30, 2022).

Feature detail

Could you add an option to harness the integrated hardware transcoding capabilities in most modern CPUs (and GPUs) for video transcoding? This would significantly reduce the load on the server when transcoding video files.

An option could be added under the ffmpeg settings in the administration area to select the transcoding method (software vs. hardware)

You would need to pass through the transcoding device into the docker. For details or as an example you can see how PhotoPrism does that. For details see:
https://docs.photoprism.app/getting-started/advanced/transcoding/

Best

Daniel

Platform

Server

Originally created by @Daniel-Cloud23 on GitHub (Dec 30, 2022). ### Feature detail Could you add an option to harness the integrated hardware transcoding capabilities in most modern CPUs (and GPUs) for video transcoding? This would significantly reduce the load on the server when transcoding video files. An option could be added under the ffmpeg settings in the administration area to select the transcoding method (software vs. hardware) You would need to pass through the transcoding device into the docker. For details or as an example you can see how PhotoPrism does that. For details see: [https://docs.photoprism.app/getting-started/advanced/transcoding/](https://docs.photoprism.app/getting-started/advanced/transcoding/) Best Daniel ### Platform Server
OVERLORD commented 2026-02-04 21:13:13 +03:00
Author
Owner
Copy Link

@bo0tzz commented on GitHub (Dec 30, 2022):

Duplicate of #203

@bo0tzz commented on GitHub (Dec 30, 2022): Duplicate of #203
OVERLORD commented 2026-02-04 21:13:22 +03:00
Author
Owner
Copy Link

@Snuupy commented on GitHub (Jan 28, 2023):

Can this issue be reopened? https://github.com/immich-app/immich/issues/203 is marked as merged but does not include hardware accelerated transcoding.

@Snuupy commented on GitHub (Jan 28, 2023): Can this issue be reopened? https://github.com/immich-app/immich/issues/203 is marked as merged but does not include hardware accelerated transcoding.
OVERLORD commented 2026-02-04 21:13:26 +03:00
Author
Owner
Copy Link

@dpnvektor commented on GitHub (Jun 8, 2023):

Would like to second reopening this issue; presently transcoding has been crushing my 16 core vps for days to encode just a few hundred videos into vp9.

@dpnvektor commented on GitHub (Jun 8, 2023): Would like to second reopening this issue; presently transcoding has been crushing my 16 core vps for days to encode just a few hundred videos into vp9.
OVERLORD commented 2026-02-04 21:13:31 +03:00
Author
Owner
Copy Link

@dpnvektor commented on GitHub (Jun 9, 2023):

Thanks for re-opening! Just for a baseline bit of info, un-accelerated Immich has managed to consume all cores of a 16 core VPS for 36 hours and has only managed to encode approx 100 videos (all around a couple minutes in length). At this rate, it should have the rest of the library encoded in a couple years. 😂

I'm not much of a dev, but I think to enable the most basic CPU/iGPU level acceleration all we may need to do here is to add the following to the ffmpeg options:

-hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format

and the following to the Docker:
devices:
- /dev/dri:/dev/dri

Not sure what it would take to add NV or AMD acceleration, but above might be enough to get most people happy. Thank you again for such a wonderful platform!

@dpnvektor commented on GitHub (Jun 9, 2023): Thanks for re-opening! Just for a baseline bit of info, un-accelerated Immich has managed to consume all cores of a 16 core VPS for 36 hours and has only managed to encode approx 100 videos (all around a couple minutes in length). At this rate, it should have the rest of the library encoded in a couple years. 😂 I'm not much of a dev, but I think to enable the most basic CPU/iGPU level acceleration all we may need to do here is to add the following to the ffmpeg options: -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format <something> and the following to the Docker: devices: - /dev/dri:/dev/dri Not sure what it would take to add NV or AMD acceleration, but above might be enough to get most people happy. Thank you again for such a wonderful platform!
OVERLORD commented 2026-02-04 21:13:37 +03:00
Author
Owner
Copy Link

@jrasm91 commented on GitHub (Jun 9, 2023):

Just for a baseline bit of info, un-accelerated Immich has managed to consume all cores of a 16 core VPS for 36 hours and has only managed to encode approx 100 videos (all around a couple minutes in length).

To be fair, this sounds like a bug/setup issue. If the CPU is maxed out, it might be context switching a lot and not getting very much work actually done.

@jrasm91 commented on GitHub (Jun 9, 2023): >Just for a baseline bit of info, un-accelerated Immich has managed to consume all cores of a 16 core VPS for 36 hours and has only managed to encode approx 100 videos (all around a couple minutes in length). To be fair, this sounds like a bug/setup issue. If the CPU is maxed out, it might be context switching a lot and not getting very much work actually done.
OVERLORD commented 2026-02-04 21:13:50 +03:00
Author
Owner
Copy Link

@dpnvektor commented on GitHub (Jun 9, 2023):

Hmm, possibly! My experiences with transcoding (which is largely limited to Plex) is that it can be comically slow when not hardware accelerated, but I wouldn't rule out that there is something else going on. Presently it looks like a whole lot of individual low-priority threads (30+?) of ffmpeg all crunching on the same file:
Screenshot_20230609_113610

The complete command shown by htop is:

/usr/bin/ffmpeg -i upload/library/admin/2018/2018-08-03/IMG_0193+1.MOV -y -vcodec hevc -acodec opus -strict experimental -movflags faststart -preset medium -threads 12 -x265-params "pools=none" -x265-params "frame-threads=12" -crf 23 upload/encoded-video/384624b8-7600-4fa5-9ac8-1cc2675808d2/bc9d7e80-4d8c-46d7-a6b2-4b431246efa5.mp4

@dpnvektor commented on GitHub (Jun 9, 2023): Hmm, possibly! My experiences with transcoding (which is largely limited to Plex) is that it can be comically slow when not hardware accelerated, but I wouldn't rule out that there is something else going on. Presently it looks like a whole lot of individual low-priority threads (30+?) of ffmpeg all crunching on the same file: ![Screenshot_20230609_113610](https://github.com/immich-app/immich/assets/7376297/328f3048-62b1-4830-a299-56b68d9b30b5) The complete command shown by htop is: /usr/bin/ffmpeg -i upload/library/admin/2018/2018-08-03/IMG_0193+1.MOV -y -vcodec hevc -acodec opus -strict experimental -movflags faststart -preset medium -threads 12 -x265-params "pools=none" -x265-params "frame-threads=12" -crf 23 upload/encoded-video/384624b8-7600-4fa5-9ac8-1cc2675808d2/bc9d7e80-4d8c-46d7-a6b2-4b431246efa5.mp4
OVERLORD commented 2026-02-04 21:13:54 +03:00
Author
Owner
Copy Link

@jrasm91 commented on GitHub (Jun 9, 2023):

Looks like normal ffmpeg mutli-threading to process a single video and using all available resources.

@jrasm91 commented on GitHub (Jun 9, 2023): Looks like normal ffmpeg mutli-threading to process a single video and using all available resources.
OVERLORD commented 2026-02-04 21:14:03 +03:00
Author
Owner
Copy Link

@lucienn3 commented on GitHub (Jun 10, 2023):

Hey guys,

very interesting topic would just like to highlight that there are complete projects just focusing on transcoding: https://github.com/HaveAGitGat/Tdarr

Maybe an integration with a well-supported toll might yield the best results?

@lucienn3 commented on GitHub (Jun 10, 2023): Hey guys, very interesting topic would just like to highlight that there are complete projects just focusing on transcoding: https://github.com/HaveAGitGat/Tdarr Maybe an integration with a well-supported toll might yield the best results?
OVERLORD commented 2026-02-04 21:14:08 +03:00
Author
Owner
Copy Link

@cibernox commented on GitHub (Jul 9, 2023):

I wonder if a possible easy change would be to, inside the the FFmpeg Settings section, add a text field for setting any arbitrary arguments to be forwarded to FFmpeg when compressing videos. That way users can try different options like hwaccel to see what works (and eventually that knowledge could be solidified in the docs)

@cibernox commented on GitHub (Jul 9, 2023): I wonder if a possible easy change would be to, inside the the FFmpeg Settings section, add a text field for setting any arbitrary arguments to be forwarded to FFmpeg when compressing videos. That way users can try different options like `hwaccel` to see what works (and eventually that knowledge could be solidified in the docs)
OVERLORD commented 2026-02-04 21:14:14 +03:00
Author
Owner
Copy Link

@jrasm91 commented on GitHub (Jul 9, 2023):

I believe ffmpeg has to be compiled with flags to enable hardware acceleration first, before any arguments would have an effect.

@jrasm91 commented on GitHub (Jul 9, 2023): I _believe_ ffmpeg has to be compiled with flags to enable hardware acceleration first, before any arguments would have an effect.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
accessibility
changelog:enhancement
changelog:security
changelog:translation
cli
date-time
documentation
external-library
format
good first issue
needs-answer
nice to have
sharing
tech-debt
📱mobile
🖥️web
🗄️server
🧠machine-learning
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
OVERLORD
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: immich-app/immich#534
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?