UT Video Decoder Broken

[Nick]

Summary of the bug: Sometime after 3/28/2013, the UT Video decoder was broken.
How to reproduce:
This happens with any UT Video source I tried. You can use FFmpeg to make a new one...that causes the problem too. Encoding is fine...if I encode with current FFmpeg and decode with the version I have from 3/28, the output is correct.

ffmpeg -i utenc.mkv -f matroska NUL -y
ffmpeg version N-53959-g0f88a98 Copyright (c) 2000-2013 the FFmpeg developers
  built on Jun 11 2013 02:29:26 with gcc 4.7.3 (GCC)
  configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-av
isynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enab
le-iconv --enable-libass --enable-libbluray --enable-libcaca --enable-libfreetyp
e --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --ena
ble-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-l
ibopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libsp
eex --enable-libtheora --enable-libtwolame --enable-libvo-aacenc --enable-libvo-
amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxavs --
enable-libxvid --enable-zlib
  libavutil      52. 35.100 / 52. 35.100
  libavcodec     55. 15.100 / 55. 15.100
  libavformat    55.  8.102 / 55.  8.102
  libavdevice    55.  2.100 / 55.  2.100
  libavfilter     3. 75.101 /  3. 75.101
  libswscale      2.  3.100 /  2.  3.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  3.100 / 52.  3.100
Input #0, matroska,webm, from 'utenc.mkv':
  Metadata:
    ENCODER         : Lavf55.8.102
  Duration: 00:00:05.01, start: 0.000000, bitrate: 569716 kb/s
    Stream #0:0: Video: utvideo (ULY0 / 0x30594C55), yuv420p, 1920x1080, SAR 1:1
 DAR 16:9, 59.94 fps, 59.94 tbr, 1k tbn, 1k tbc (default)
[libx264 @ 02883340] using SAR=1/1
[libx264 @ 02883340] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
[libx264 @ 02883340] profile High, level 4.2
[libx264 @ 02883340] 264 - core 133 r2334 a3ac64b - H.264/MPEG-4 AVC codec - Cop
yleft 2003-2013 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deb
lock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 m
e_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chro
ma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 i
nterlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1
b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenec
ut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=
0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, matroska, to 'NUL':
  Metadata:
    encoder         : Lavf55.8.102
    Stream #0:0: Video: h264 (libx264) (H264 / 0x34363248), yuv420p, 1920x1080 [
SAR 1:1 DAR 16:9], q=-1--1, 1k tbn, 59.94 tbc (default)
Stream mapping:
  Stream #0:0 -> #0:0 (utvideo -> libx264)
Press [q] to stop, [?] for help
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
    Last message repeated 1 times
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
Last message repeated 1 times1  times
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Too long VLC (28) in init_vlc
Error while decoding stream #0:0: Invalid data found when processing input
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
    Last message repe    at    LastedLa st message repeated 1 times
message repeated 1 times
 1 times
Too long VLC (28) in init_vlc
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Too long VLC (28) in init_vlc
     Last   Cannot build Huffman codes
1    Last message repeated 2 timesepeated times
 times
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
    Last message repeated 2 times
    Last messag  Too long VLC (28) in init_vlc
e      La streLa st mepemessage atssagrepe edeated 2repe at1  tedtimes
imesimes
[utvideo @ 09a5c4a0] Too long VLC (28) in init_vlc
Cannot build Huffman codes
[utvideo @ 09a5c4a0]  Cannot build Huffman codes
    Last message repeated 1    Last  times
message repeated 1 times
Error while decoding stream #0:0: Invalid data found when processing input
Too long VLC (28) in init_vlc
[utvideo @ 09a5c4a0] Cannot build Huffman codes
Error while decoding stream #0:0: Invalid data found when processing input
   Last message repeated 2 timeses
Too long VLC (28) in init_vlc times
       La stLa   Lasst t message repeamessagmessae trepeatege d 2 edreti mes2 pt
imes

    Last mess[utvideo @ 09a5c4a0] a[utvideo @ 09a5c4a0] Cannot build Huffman cod
es
ge Cannot build Huffman codes
repeated 1 times  1me stisamege s
Error while decoding stream #0:0: Invalid data found when processing input
mes  La s t  Lamest ssmeagsse agree pereatpeedat e1 d ti1 metis

[Carl Eugen Hoyos]

Please provide a failing sample.

[Nick]

As I said in the description, I see the issue with any UT video encoded clip I try.

I tried to upload a small sample per the instructions on the FFmpeg page, but the FTP server rejected me saying too many connection attempts.

Here it is on my Google Drive:
​https://docs.google.com/file/d/0B3bL9ErYm7mVbVNTRkZmRXRLU3M/edit?usp=sharing

You can use this to create a UT Video source that will exhibit the problem when you try to decode it with the following command:
ffmpeg -i "UT Video Decoder Problems Ticket 2661.mkv" -c:v utvideo "Source for Ticket 2661.mkv"

Then try to decode it using the following command to see the errors:
ffmpeg -i "Source for Ticket 2661.mkv" -f rawvideo NUL -y

[Carl Eugen Hoyos]

Regression since fb3e380

$ ffmpeg -i utvideo.avi -f framecrc -
ffmpeg version N-53976-g1163910 Copyright (c) 2000-2013 the FFmpeg developers
  built on Jun 12 2013 03:27:52 with gcc 4.7 (SUSE Linux)
  configuration: --enable-gpl --disable-indev=jack
  libavutil      52. 35.101 / 52. 35.101
  libavcodec     55. 16.100 / 55. 16.100
  libavformat    55.  8.102 / 55.  8.102
  libavdevice    55.  2.100 / 55.  2.100
  libavfilter     3. 75.101 /  3. 75.101
  libswscale      2.  3.100 /  2.  3.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  3.100 / 52.  3.100
Input #0, avi, from 'utvideo.avi':
  Metadata:
    encoder         : Lavf55.8.102
  Duration: 00:00:00.03, start: 0.000000, bitrate: 593571 kb/s
    Stream #0:0: Video: utvideo (ULY0 / 0x30594C55), yuv420p, 1920x1080, SAR 1:1 DAR 16:9, 59.94 tbr, 59.94 tbn, 59.94 tbc
#tb 0: 317/19001
Output #0, framecrc, to 'pipe:':
  Metadata:
    encoder         : Lavf55.8.102
    Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 59.94 tbn, 59.94 tbc
Stream mapping:
  Stream #0:0 -> #0:0 (utvideo -> rawvideo)
Press [q] to stop, [?] for help
Too long VLC (28) in init_vlc
[utvideo @ 0x2366f20] Cannot build Huffman codes
0,          0,          0,        1,  3110400, 0x0da7eb6b
frame=    1 fps=0.0 q=0.0 Lsize=       0kB time=00:00:00.01 bitrate=  36.0kbits/s
video:3038kB audio:0kB subtitle:0 global headers:0kB muxing overhead -99.997589%

[Michael Niedermayer]

Fixed in 79cd5d39ba11cbad9ca4b965cbede480f19cb839

[Nick]

Replying to michael:

Fixed in 79cd5d39ba11cbad9ca4b965cbede480f19cb839

It works fine now. Thanks everyone!

[fluff]

It is damn hard to get ahold of the developers. AFAIK, both @Daemon404 and @compn have confirmed that the Ut Video decoder is now broken again. Please fix.

[Carl Eugen Hoyos]

Patch sent:
​http://thread.gmane.org/gmane.comp.video.ffmpeg.devel/178313

[fluff]

Just FYI for anyone reading the mailing list, I tested the official decoder and it works fine. Assuming a build with this patch decodes properly on the sample clips where previous builds do not, I'll consider it fixed. Many thanks, Carl.

[Carl Eugen Hoyos]

Committed in 673716c5

For future issues: Please consider sending an email to ffmpeg-user or opening a report on trac, as you found out reports on irc are not necessarily a good idea.

[fluff]

Thanks. I tested the decoder and so far I am not getting any problems.