RPI-CAM-MIPI and i.MX93FRDM issues on BSP6.12.49

[Ryo_Aoki]

Hi NXP.

I'm trying to run RPI-CAM-MIPI on an i.MX93FRDM, but I'm having trouble getting it to work with the latest BSP 6.12.49.
With the BSP6.6.36 image, setting it up according to UM11933 allowed RPI-CAM-MIPI to work without any problems and display video.
However, with BSP6.12.49, even if I follow the same setup procedure and run the same commands, the video does not display.

If you find out the cause of this phenomenon or how to fix it, please let me know.

log:
root@imx93-11x11-lpddr4x-frdm:~# gst-launch-1.0 -v v4l2src device=/dev/video0 ! ""video/x-raw,format=YUY2,width=1280,height=800"" ! queue ! waylandsink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)800, framerate=(fraction)120/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)800, framerate=(fraction)120/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)800, framerate=(fraction)120/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)800, framerate=(fraction)120/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:src: caps = video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)800, framerate=(fraction)120/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709
/GstPipeline:pipeline0/GstWaylandSink:waylandsink0.GstPad:sink: caps = video/x-raw, format=(string)YUY2, width=(int)1280, height=(int)800, framerate=(fraction)120/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate required memory.
Additional debug info:
/usr/src/debug/gstreamer1.0-plugins-good/1.26.6.imx/sys/v4l2/gstv4l2src.c(957): gst_v4l2src_decide_allocation (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
Buffer pool activation failed
Execution ended after 0:00:00.017016750
Setting pipeline to NULL ...
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data stream error.
Additional debug info:
/usr/src/debug/gstreamer1.0/1.26.6.imx/libs/gst/base/gstbasesrc.c(3187): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason not-negotiated (-4)
Freeing pipeline ...
root@imx93-11x11-lpddr4x-frdm:~#"

Additional information:
UM11933 specifies that ap1302.fw should be placed in /lib/firmware/imx/camera.
However, when I tried the same thing with BPS 6.12.49, I got the following error:
$ dmesg | grep -E 'ap1302|mx8-img-md'
[ 11.642956] ap1302 2-003c: Direct firmware load for ap1302_ar0144_single_fw.bin failed with error -2
[ 11.642979] ap1302 2-003c: Falling back to sysfs fallback for: ap1302_ar0144_single_fw.bin

This error can be avoided by placing ap1302_ar0144_single_fw.bin in /lib/firmware, but this does not resolve the issue of the video not displaying.

[joanxie]

for the 6.12 bsp, you need to use media-ctl to create a link ,pls refer to the chapter 6.1.3.1.3 AP1302/AR0144 of reference manual 

https://www.nxp.com.cn/docs/en/reference-manual/RM00293.pdf

[Ryo_Aoki]

Thank you for your reply.

My understanding is that to run 6.1.3.1.3, I placed /lib/firmware/ap1302_ar0144_single_fw.bin and executed the following.

media-ctl -V "'ap1302 2-003c':2 [fmt:UYVY8_1X16/1920x1080 field:none]"
media-ctl -V "'csidev-4ae00000.csi':0 [fmt:UYVY8_1X16/1920x1080 field:none]"
media-ctl -V "'csidev-4ae00000.csi':1 [fmt:UYVY8_1X16/1920x1080 field:none]"
media-ctl -V "'crossbar':0 [fmt:UYVY8_1X16/1920x1080 field:none]"
media-ctl -V "'crossbar':2 [fmt:UYVY8_1X16/1920x1080 field:none]"
media-ctl -V "'mxc_isi.0':1 [fmt:YUV8_1X24/1920x1080 field:none]"

I then tried to display the video using this command, and although no errors occurred, the camera image did not appear on the screen.
gst-launch-1.0 v4l2src device=/dev/video0 ! "video/x-raw,format=YUY2,width=1920,height=1080,framerate=30/1" ! videoconvert ! autovideosink

Are there any plans to revise the procedure (4.3) for displaying camera images in UM11933 for the latest BSP?

[joanxie]

you can refer my document for this topic

https://community.nxp.com/t5/i-MX-Processors-Knowledge-Base/ov5640-support-on-i-mx93-with-6-12-20-bs...