**last updated 19-10-2019**
– updated the manual (new driver 440.26 and ffnvcodec version)
How to get FFmpeg to export the needed symbols on (K)ubuntu cosmic/disco (and similar distros) so OBS and MPV can use NVENC and NVDEC (formerly called CUVID) on Fermi, Maxwell, Kepler, Pascal, Volta and Turing architectures and how to use hardware-acceleration in Chromium © 2018 - 2019 oMeN23. This guide aims at the more modern cards compatible with NVENC and NVDEC – but there's also some instructions for cards using legacy drivers. (378, 390 and 396)
Supported cards: https://developer.nvidia.com/video-encode-decode-gpu-support-matrix
sudo apt install ppa-purge # for safety
sudo add-apt-repository ppa:graphics-drivers/ppa
# please check the support plan for your GPU – nvidia-driver-{390,396,410,415,418,430,435,440} available so your display server doesn't fail!
# we will use 440.26
# maybe you need the 32-bit versions of some libraries add ":i386" to the package name (i.e.: libnvidia-gl-430:i386)
sudo apt install nvidia-driver-440 xserver-xorg-video-nvidia-440 nvidia-utils-440 nvidia-kernel-source-440 nvidia-kernel-common-440 nvidia-dkms-440 nvidia-compute-utils-440 libnvidia-ifr1-440 libnvidia-gl-440 libnvidia-fbc1-440 libnvidia-encode-440 libnvidia-decode-440 libnvidia-cfg1-440 libnvidia-compute-440
sudo apt install make git
mkdir ~/devel/ && cd ~/devel/
git clone https://git.videolan.org/git/ffmpeg/nv-codec-headers.git
cd nv-codec-headers
# change to older SDK branch here if you use a legacy driver — one of: git checkout sdk/8.{0,1,2}
make && sudo make install
Most recent version of the Video Codec SDK is 9.0.x. but below is a list of the older SDK branches for legacy drivers.
FFmpeg version of headers required to interface with Nvidias codec APIs.
Corresponds to Video Codec SDK version 9.1.23.
Minimum required driver versions:
Linux: 435.21 or newer
Windows: 436.15 or newer
- List of git branches for the legacy drivers
If you use legacy drivers, here are the branches for them – after you clone the git repository cd into it and enter one of the three following lines before installing (entering make && sudo make install).
Curious what will happen if you use the newest SDK headers with a legacy driver? The linker/loader will not find the entrypoint or function (pointer) or header and your application will fail.
All of these three branches support optional CUDA 10 features starting with driver 410.48 on Linux and 411.31 on Windows.
git checkout sdk/8.2 # for Linux 396.24 or newer | for Windows 397.93 or newer
git checkout sdk/8.1 # for Linux 390.25 or newer | for Windows 390.77 or newer
git checkout sdk/8.0 # for Linux 378.13 or newer | for Windows 378.66 or newer
FFmpeg will automatically detect the ffnvcodec-headers — extract from ./configure --help:
The following libraries provide various hardware acceleration features:
--disable-amf disable AMF video encoding code [autodetect]
--disable-audiotoolbox disable Apple AudioToolbox code [autodetect]
--enable-cuda-sdk enable CUDA features that require the CUDA SDK [no]
--disable-cuvid disable Nvidia CUVID support [autodetect]
--disable-d3d11va disable Microsoft Direct3D 11 video acceleration code [autodetect]
--disable-dxva2 disable Microsoft DirectX 9 video acceleration code [autodetect]
--disable-ffnvcodec disable dynamically linked Nvidia code [autodetect]
--enable-libdrm enable DRM code (Linux) [no]
--enable-libmfx enable Intel MediaSDK (AKA Quick Sync Video) code via libmfx [no]
--enable-libnpp enable Nvidia Performance Primitives-based code [no]
--enable-mmal enable Broadcom Multi-Media Abstraction Layer (Raspberry Pi) via MMAL [no]
--disable-nvdec disable Nvidia video decoding acceleration (via hwaccel) [autodetect]
--disable-nvenc disable Nvidia video encoding code [autodetect]
--enable-omx enable OpenMAX IL code [no]
--enable-omx-rpi enable OpenMAX IL code for Raspberry Pi [no]
--enable-rkmpp enable Rockchip Media Process Platform code [no]
--disable-v4l2-m2m disable V4L2 mem2mem code [autodetect]
--disable-vaapi disable Video Acceleration API (mainly Unix/Intel) code [autodetect]
--disable-vdpau disable Nvidia Video Decode and Presentation API for Unix code [autodetect]
--disable-videotoolbox disable VideoToolbox code [autodetect]
Should the standard compilation not fit your needs (you have the need to link in specific libraries/don't need some libraries or you want to enable/disable specific features) then you can change the build-rules in ~/devel/ffmpeg/ffmpeg-4.1.3/debian/rules.
The headers installed in 1. Install the nv-codec-headers package will enable ffnvcodec vdpau nvenc nvdec cuda cuvid (NVDEC is just a rebranding of CUVID). CUDA does not mean the CUDA-SDK code – just hardware-acceleration via CUDA.
sudo apt build-dep ffmpeg
mkdir -p ~/devel/ffmpeg
cd ~/devel/ffmpeg
sudo apt source ffmpeg
sudo chown -hR $USER: * # atleast my distro has problems when unpacking source – so we change ownership
cd ffmpeg-4.1.3 # cd ffmpeg-x.x.x [x.x.x represents the version number]
debuild -b --no-sign --jobs-try=$((`nproc`/2))
cd ..
rm -f libavcodec-extra* libavfilter-extra*
sudo dpkg -i *.deb
sudo apt-mark hold ffmpeg ffmpeg-doc libavcodec-dev libavcodec58 libavfilter7 libavfilter-dev libavformat58 libavformat-dev libavresample4 libavresample-dev libavutil-dev libavutil56 libavdevice58 libavdevice-dev libswscale5 libswscale-dev libswresample3 libswresample-dev libpostproc55 libpostproc-dev
- Testing:
ffmpeg -hide_banner -encoders | grep nvenc
V..... h264_nvenc NVIDIA NVENC H.264 encoder (codec h264)
V..... nvenc NVIDIA NVENC H.264 encoder (codec h264)
V..... nvenc_h264 NVIDIA NVENC H.264 encoder (codec h264)
V..... nvenc_hevc NVIDIA NVENC hevc encoder (codec hevc)
V..... hevc_nvenc NVIDIA NVENC hevc encoder (codec hevc)
ffmpeg -hide_banner -decoders | grep cuvid
V..... h264_cuvid Nvidia CUVID H264 decoder (codec h264)
V..... hevc_cuvid Nvidia CUVID HEVC decoder (codec hevc)
V..... mjpeg_cuvid Nvidia CUVID MJPEG decoder (codec mjpeg)
V..... mpeg1_cuvid Nvidia CUVID MPEG1VIDEO decoder (codec mpeg1video)
V..... mpeg2_cuvid Nvidia CUVID MPEG2VIDEO decoder (codec mpeg2video)
V..... mpeg4_cuvid Nvidia CUVID MPEG4 decoder (codec mpeg4)
V..... vc1_cuvid Nvidia CUVID VC1 decoder (codec vc1)
V..... vp8_cuvid Nvidia CUVID VP8 decoder (codec vp8)
V..... vp9_cuvid Nvidia CUVID VP9 decoder (codec vp9)
ffmpeg -hide_banner -hwaccels
Hardware acceleration methods:
vdpau
cuda
vaapi
drm
cuvid
OBS detects if FFmpeg (libavcodec) exports h264_nvenc dynamically at runtime startup if GPU-acceleration was not disabled at build-time.
sudo add-apt-repository ppa:obsproject/obs-studio
sudo apt update
sudo apt install obs-studio
NOW you should have a fully functional OBS with hardware-acceleration! The rest of this guide is optional (for people who want to get the most out of their GPU).
sudo apt build-dep mpv
mkdir -p ~/devel/mpv
cd ~/devel/mpv
sudo apt source mpv
sudo chown -hR $USER: *
cd mpv-0.29.1 # cd mpv-x.x.x [x.x.x represents version]
debuild -b --no-sign --jobs-try=$((`nproc`/2))
cd ..
sudo dpkg -i mpv*.deb # we dont need libmpv{-dev}
sudo apt-mark hold mpv
mpv --hwdec=nvdec <input> # --hwdec=yes or auto will work too – just tweak your configuration file
# e.g.
cat /etc/mpv/mpv.conf
stop-screensaver = "yes" # so neither xscreensaver nor session-lock (on KDE) kicks in (auto disables if you press pause)
hwdec=yes # use best hw-decoding method (legacy cards will use hardware VDPAU decoding instead of nvdec)
# if you compiled FFmpeg with libfdk_aac and want to use it (idk why people think it is soo much better than FFmpeg's AAC decoder)
# ad=libfdk_aac I got this line commented out as I don't hear a better sound quality when playing back or encoding audio with libfdk_aac
mpv Some.Home.Movie.mkv
Playing: Some.Home.Movie.mkv
(+) Video --vid=1 (*) (h264 1280x720 29.970fps)
(+) Audio --aid=1 (*) (aac 2ch 44100Hz)
Using hardware decoding (nvdec). # this line is very important, you can turn on debug output with --v
AO: [pulse] 44100Hz stereo 2ch float
VO: [gpu] 1280x720 => 1710x720 cuda[nv12]
mplayer Some.Home.Movie.mkv -vc ffh264vdpau # for legacy cards/some people claim VDPAU has superior image quality than NVDEC and other benefits NVDEC is lacking
MPlayer 1.3.0 (Debian), built with gcc-8 (C) 2000-2016 MPlayer Team
do_connect: could not connect to socket
connect: No such file or directory
Failed to open LIRC support. You will not be able to use your remote control.
Playing Some.Home.Movie.mkv.
libavformat version 58.20.100 (external)
Mismatching header version 58.12.100
libavformat file format detected.
[lavf] stream 0: video (h264), -vid 0
[lavf] stream 1: audio (aac), -aid 0
VIDEO: [H264] 1280x720 0bpp 29.970 fps 0.0 kbps ( 0.0 kbyte/s)
==========================================================================
Forced video codec: ffh264vdpau
Opening video decoder: [ffmpeg] FFmpeg's libavcodec codec family
libavcodec version 58.35.100 (external)
Mismatching header version 58.18.100
Selected video codec: [ffh264vdpau] vfm: ffmpeg (FFmpeg H.264 (VDPAU))
==========================================================================
Clip info:
COMPATIBLE_BRANDS: isomiso2avc1mp41
MAJOR_BRAND: isom
MINOR_VERSION: 512
ENCODER: Lavf58.20.100
Load subtitles in ./
==========================================================================
Opening audio decoder: [ffmpeg] FFmpeg/libavcodec audio decoders
AUDIO: 44100 Hz, 2 ch, floatle, 0.0 kbit/0.00% (ratio: 0->352800)
Selected audio codec: [ffaac] afm: ffmpeg (FFmpeg AAC (MPEG-2/MPEG-4 Audio))
==========================================================================
AO: [pulse] 44100Hz 2ch floatle (4 bytes per sample)
Starting playback...
Movie-Aspect is 2.38:1 - prescaling to correct movie aspect.
VO: [vdpau] 1280x720 => 1710x720 H.264 VDPAU acceleration
For mplayer to always use VDPAU hardware decoding you need to add
vo=vdpau,
vc=ffh264vdpau,ffmpeg12vdpau,ffodivxvdpau,ffwmv3vdpau,ffvc1vdpau,ffhevcvdpau
to the bottom of /etc/mplayer/mplayer.conf But beware some files work with VLC's VDPAU hardware decoding but might fail with mplayer – the file will not be playable and you will see a message that your system is too slow to play the file but maybe this bug has been fixed, I personally was a mplayer user until I discovered mpv which is now my media player of choice because it is most versatile and has youtube-dl (ability to play streams) built in. No downloading and waiting – just find the link and watch the movie (if the server is fast enough).
mpv would choose VDPAU hardware decoding automatically if the config file (/etc/mpv/mpv.conf) has --hwdec=auto/yes/vdpau in it and nvdec is not supported.
Maybe you need to add the codec names to mpv's config file but I think that is only necessary for mplayer and mpv auto detects and selects the best hardware decoding method.
You would add this line to your mpv config file, but like I said – I don't think it is necessary. ONLY for mplayer!
vd=ffh264vdpau,ffmpeg12vdpau,ffodivxvdpau,ffwmv3vdpau,ffvc1vdpau,ffhevcvdpau # I guess only mplayer needs the codec names
On my test systems adding just --hwdec=yes to the configuration file or commandline was enough for mpv to use the best hardware decoding method available.
Oh.. ahd btw. VLC will use VDPAU if you have hardware decoding enabled. (if you run vlc via a pty you can see it uses the Nvidia VDPAU shared libary)
Protip: use mpv to play youtube videos with NVDEC VP9 decoding.
Add youtube-dl to your system, so mpv can use it to play streams (it is best you read the man page of mpv, you can even choose the format mpv will play because it has hooks for youtube-dl and even it's own protocol: yt-dl://
sudo add-apt-repository ppa:nilarimogard/webupd8
sudo apt update
sudo apt install youtube-dl
youtube-dl -U
Now you can watch youtube videos and livestreams (e.g. twitch.tv) with hardware-acceleration too — use mpv URL ...
Thanks to Saikrishna Arcot who patched chromium against VAAPI there is hardware-acceleration for Intel and Nvidia GPUs (you'll need the patched vdpau-va-driver).
https://www.linuxuprising.com/2018/08/how-to-enable-hardware-accelerated.html (The article is a little outdated – my manual has all the latest changes covered too)
sudo add-apt-repository ppa:saiarcot895/chromium-dev
sudo apt update
sudo apt install vdpau-va-driver chromium-browser vdpauinfo vainfo
Then in chromium type in the adressbar chrome://flags/#enable-accelerated-video and chrome://flags/#ignore-gpu-blacklist and enable it and maybe zero-copy too etc.
Check out chrome://gpu or about:gpu to see what configuration works best for you (e.g. on my system out of process rasterization doesn't work well and GpuMemoryBuffers are only implemented in software as of now 09-03-2019).
Install the h264ify extension
(even you now have a system that can offload VP9 decoding to the video card – it is not implemented in any browser.)
- Checking if chromium actually uses the video card:
Go to chrome://media-internals or about:media-internals when h264ify is enabled (the video is delivered in avc1 not vp9 – you find that info in the Stats for nerds box when right clicking on a video), play a YouTube video and click on the box that says (PLAY) at the bottom right and in the Log you can search for properties – search for the video_decoder field and MojoVideoDecoder should be its value and to make sure is_platform_video_decoder which should be true. (in nvidia-settings Video Engine Utilization will rise if you play a video if everything is working) If the value of the field video_decoder is FFmpegVideoDecoder or VpxVideoDecoder you have an error somewhere. (check vainfo and vdpauinfo outputs for errors first...)
GpuVideoDecoder is deprecated now! MojoVideoDecoder has much better performance in utilizing the graphics cards Video Engine than GpuVideoDecoder on more recent cards! Welp, it's a complete rewrite of the video decoder…
Tested on a GeForce GTX 1070 system. If you have **ANY** questions regarding this manual or something doesn't work out of the box for you or you want a more detailed explanation of one of the topics/steps — just open a new issue.
If this manual helped you out in any way and you wanna support me by buying a cup of coffee or a little something donate here.
Thank you in advance!