Commit 9c026dd9 authored by Michael Niedermayer's avatar Michael Niedermayer

avcodec/fitsdec: Use lrint()

Fixes: fate-fitsdec-bitpix-64

Possibly Fixes: -nan is outside the range of representable values of type 'unsigned short'
Possibly Fixes: 17769/clusterfuzz-testcase-minimized-ffmpeg_AV_CODEC_ID_FITS_fuzzer-5678314672357376

Found-by: continuous fuzzing process https://github.com/google/oss-fuzz/tree/master/projects/ffmpegSigned-off-by: 's avatarMichael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit 37f31f4e)
Signed-off-by: 's avatarMichael Niedermayer <michael@niedermayer.cc>
parent 0667c14a
......@@ -279,7 +279,7 @@ static int fits_decode_frame(AVCodecContext *avctx, void *data, int *got_frame,
for (j = 0; j < avctx->width; j++) { \
t = rd; \
if (!header.blank_found || t != header.blank) { \
*dst++ = ((t - header.data_min) * ((1 << (sizeof(type) * 8)) - 1)) * scale; \
*dst++ = lrint(((t - header.data_min) * ((1 << (sizeof(type) * 8)) - 1)) * scale); \
} else { \
*dst++ = fitsctx->blank_val; \
} \
......
......@@ -3,4 +3,4 @@
#codec_id 0: rawvideo
#dimensions 0: 102x109
#sar 0: 0/1
0, 0, 0, 1, 22236, 0x34490902
0, 0, 0, 1, 22236, 0x24634517
......@@ -3,4 +3,4 @@
#codec_id 0: rawvideo
#dimensions 0: 77x173
#sar 0: 0/1
0, 0, 0, 1, 26642, 0x0ad2a46a
0, 0, 0, 1, 26642, 0xa9eec634
......@@ -3,4 +3,4 @@
#codec_id 0: rawvideo
#dimensions 0: 256x256
#sar 0: 0/1
0, 0, 0, 1, 131072, 0x7fb22427
0, 0, 0, 1, 131072, 0x3ecd0739
......@@ -3,4 +3,4 @@
#codec_id 0: rawvideo
#dimensions 0: 512x512
#sar 0: 0/1
0, 0, 0, 1, 524288, 0xc327ed23
0, 0, 0, 1, 524288, 0x6567ecb3
......@@ -3,4 +3,4 @@
#codec_id 0: rawvideo
#dimensions 0: 128x128
#sar 0: 0/1
0, 0, 0, 1, 16384, 0xd788a2d2
0, 0, 0, 1, 16384, 0x353dbacd
......@@ -3,7 +3,7 @@ ed9fd697d0d782df6201f6a2db184552 *./tests/data/lavf/graylavf.fits
./tests/data/lavf/graylavf.fits CRC=0xbacf446c
48e6caf6a59e32f9a8a39979c9183a7f *./tests/data/lavf/gray16belavf.fits
10368000 ./tests/data/lavf/gray16belavf.fits
./tests/data/lavf/gray16belavf.fits CRC=0xae2b58d4
./tests/data/lavf/gray16belavf.fits CRC=0xce89ed97
be2f7112fd193c9a909304c81e662769 *./tests/data/lavf/gbrplavf.fits
15408000 ./tests/data/lavf/gbrplavf.fits
./tests/data/lavf/gbrplavf.fits CRC=0x04ed3828
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment