Unable to transcode from prores or dnxhd to nvenc_hevc

[Michael Oliver]

Summary of the bug:

• Unable to transcode from input files that are encoded with prores or dnxhd to h265 using the hardware nvenc_hevc codec.
• file encoded with h264 transcode using nvenc_hevc just fine
• nvenc_x264 is able to transcode using the hw encoder for x264 and dnxhd or prores inputs

Full trace log here: ​http://pastebin.com/Q05KVbBS

How to reproduce:

% ffmpeg.exe -i input.mov -vcodec nvenc_hevc out.mov

ffmpeg version 2.8.5 Copyright (c) 2000-2016 the FFmpeg developers

built with gcc 5.3.0 (GCC)
configuration: --prefix=/home/moliver/FFmpeg/x86_64 --enable-small --disable-debug --disable-doc --arch=x86_64 --cc='ccache x86_64-w64-mingw32-gcc' --cross-prefix=x86_64-w64-mingw32- --enable-cross-compile --target-os=mingw32 --enable-libfdk-aac --enable-libmp3lame --enable-libopus --enable-libspeex --enable-libx264 --enable-libx265 --enable-libmfx --enable-nvenc --enable-libopenh264 --enable-gpl --enable-nonfree
libavutil 54. 31.100 / 54. 31.100
libavcodec 56. 60.100 / 56. 60.100
libavformat 56. 40.101 / 56. 40.101
libavdevice 56. 4.100 / 56. 4.100
libavfilter 5. 40.101 / 5. 40.101
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 2.101 / 1. 2.101
libpostproc 53. 3.100 / 53. 3.100

[Michael Oliver]

Trace log of failed nvenc_hevc transcode

[Carl Eugen Hoyos]

Is the problem reproducible with current FFmpeg git head?

[Carl Eugen Hoyos]

And please add information about your NVidia driver version.