avcodec/mjpegdec: change error return value to be outside the 16bit range
Fixes part of Ticket2965
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>