topic Re: VPU MJPEG encode 8192x8192 in i.MX Processors

VPU MJPEG encode 8192x8192

PeterBergin — Wed, 25 Mar 2015 08:44:54 GMT

I am trying to test the VPU capability to encode a picture to JPEG. The i.Mx6 manual and datasheets state that it is possible to encode pictures up to 8192x8192 pixels in the VPU. I want to verify this but has not succeded due to memory allocation problems. Can anyone give me a suggestion how to verify and test the capability of i.Mx6 to JPEG encode a picture of size 8192x8192 in the VPU?

I have tested on a Nitrogen6_max board with 4GB of RAM. I am running Yocto on current master branch (1.8 WIP) with 3.10.53 kernel. On this plattform I have tested gstreamer0.10, gstreamer1.0 and mxc_vpu_test with the same result. In Gstream 1.0 the maximum resolution into

imxvpuenc_mjpeg is 1920x1080, any reason for this constraint?

Gstreamer 0.10:

GST_DEBUG=vpuenc:5 gst-launch-0.10 -v videotestsrc num-buffers=1 ! video/x-raw-yuv,format=\(fourcc\)UYVY,width=8192,height=8192,framerate=1/1,color-matrix=hdtv ! ffmpegcolorspace ! video/x-raw-yuv,format=\(fourcc\)NV12,width=8192,height=8192,framerate=1/1 ! vpuenc codec=mjpg ! filesink location=sample.jpg

From stdout:

0:00:02.042111334   678  0x101fd20 ERROR                 vpuenc /home/sepbe/yocto/nitrogen_master/build/tmp/work/nitrogen6x-poky-linux-gnueabi/gst-fsl-plugin/4.0.2-r0/gst-fsl-plugins-4.0.2/src/video/vpu/src/vpuenc.c:325:vpuenc_core_mem_alloc_dma_buffer: func VPU_EncGetMem failed!!

From /var/log/messages:

mxc_vpu 2040000.vpu: Physical memory allocation error!

Mar 25 09:31:27 nitrogen6x user.err kernel: mxc_vpu 2040000.vpu: Physical memory allocation error!

mxc_vpu_test:

root@nitrogen6x:~# VPU_TEST_DBG=5 ./mxc_vpu_test.out -E "-i /home/root/sample_8192_8192.yuv -o /home/root/images/image-205_yuv444.jpg -f 7 -c 1 -w 8192 -h 8192"
[INFO] main.c:515 VPU test program built on Mar 25 2015 09:24:14
[INFO] Product Info: i.MX6Q/D/S
[INFO] main.c:538 VPU firmware version: 3.1.1_r46061
[INFO] main.c:540 VPU library version: 5.4.27
[INFO] utils.c:535 Format: STD_MJPG
[INFO] utils.c:411 Input file "/home/root/sample_8192_8192.yuv" opened.
[INFO] utils.c:435 Output file "/home/root/images/image-205_yuv444.jpg" opened.
[INFO] enc.c:980 Capture/Encode fps will be 30
[DEBUG] enc.c:400 minfb 0
[ERR] mem allocation failed!
Frame buffer allocation failure
[ERR] enc.c:507 failed to allocate single framebuf
root@nitrogen6x:~#

Regards,

/Peter

Re: VPU MJPEG encode 8192x8192

ZhongliHe — Fri, 10 Apr 2015 20:43:13 GMT

Hi, Peter,

Sorry for late reply !

Due to the limitation of allocating physically contiguous memory space, the 8Kx8K JPEG encode/decode has not been supported yet in our BSP. For example for YUV444 format, it needs 64x3=192Mbytes contiguous memory which is difficult to achieve. For "vpuenc" gst glugin, we currently support only up to 1080p resolution for JPEG. We are planning to increase the resolution but the maximum resolution has not been determined yet.

May I ask what is the use case for using the JPEG encode/decode at 8Kx8K resolution ?

Thanks

Jones

Re: VPU MJPEG encode 8192x8192

PeterBergin — Sun, 12 Apr 2015 19:20:19 GMT

Hi,

thanks for your reply and the information given. It confirms the results I have got.

The use case is to use the JPEG encoder inside i.Mx6 in a high quality still image camera with resolutions in the range 40-60 mexapixel resolution. The plan was to encode pictures of size 8192x6144 to JPEG, according to i.Mx6's datasheet this should be possible.

What is your feeling of the effort needed to develop a driver to Linux that can do JPEG encoding of 8192x6144 in i.Mx6 running Linux?

Best regards,

/Peter

Re: VPU MJPEG encode 8192x8192

PeterBergin — Tue, 21 Apr 2015 14:32:28 GMT

An update around my work to get JPEG encoding of high res pictures to work. Still no luck to get it working but I have come a bit further. A question that is still unanswered is if Freescale with any software ever verified the feature to encode 8192x8192 pictures to JPEG?

In order to avoid the memory allocation problem I have increased the CMA buffer inte the kernel. The problem I see right now is that I get a timeout from the VPU. I will describe and hope someone can give me some more input.

GST_DEBUG=vpuenc:5 VPU_LIB_DBG=5 gst-launch-0.10 -v videotestsrc num-buffers=1 ! video/x-raw-yuv,format=\(fourcc\)UYVY,width=6400,height=4800,framerate=1/1,color-matrix=hdtv ! ffmpegcolorspace ! video/x-raw-yuv,format=\(fourcc\)NV12,width=6400,height=4800,framerate=1/1 ! vpuenc codec=mjpg ! filesink location=sample.jpg

........

vpuenc versions

plugin: 4.0.3

wrapper: 1.0.58(VPUWRAPPER_ARM_LINUX Build on Apr 21 2015 15:40:06)

vpulib: 5.4.28

firmware: 3.1.1.46063

........

0:00:03.992470667 834 0x759f20 LOG vpuenc /home/sepbe/yocto/nitrogen_master/build/tmp/work/nitrogen6x-poky-linux-gnueabi/gst-fsl-plugin/4.0.3-r0/gst-fsl-plugins-4.0.3/src/video/vpu/src/vpuenc.c:1277:gst_vpuenc_chain: chain in with inbuffer size = 46080000 ts 0:00:00.000000000

vpu_lib.c:2068 enter vpu_EncGiveCommand()

vpu_lib.c:1523 enter vpu_EncStartOneFrame()