What are available options for ISP on IMX95

[Rathore-pioneer]

Hi,

I am using IMX95 EVK with ox03c10 camera setup.
I am running 3 cameras with Maxim serdes I want to scale down the video using hardware accelerator.
This is the working camera pipeline for recording a file:

gst-launch-1.0 -v -e libcamerasrc camera-name="/base/soc/bus@42000000/i2c@42530000/max96724@27/i2c-mux/i2c@0/mx95mbcam@40" src::stream-role=view-finder ! video/x-raw,format=NV16,width=1920,height=1280,framerate=30/1 ! videoconvert ! v4l2h264enc ! h264parse ! mp4mux ! filesink location=/tmp/cam0_processed.mp4

From this pipeline, I wanted to remove dependency from cpu and wanted to use only the hardware accelerator.
Please suggest the changes.

[Rathore-pioneer]

Are there any gst plugins available for encoding, decoding, and scaling?

[JosephAtNXP]

Hi,

Thank you for your interest in NXP Semiconductor products,

This is the command advised for running multiple ox03c10 cameras.

gst-launch-1.0 imxcompositor_g2d name=comp \
> sink_0::xpos=0 sink_0::ypos=0 sink_0::width=640 sink_0::height=480 \
> sink_1::xpos=0 sink_1::ypos=480 sink_1::width=640 sink_1::height=480 \
> sink_2::xpos=640 sink_2::ypos=0 sink_2::width=640 sink_2::height=480 \
> sink_3::xpos=640 sink_3::ypos=480 sink_3::width=640 sink_3::height=480 ! \
> video/x-raw,format=BGRA ! autovideosink \
> v4l2src device=/dev/video15 ! video/x-raw,format=YUY2,framerate=30/1,width=1920,height=1280  !  comp.sink_0 \
> v4l2src device=/dev/video22 ! video/x-raw,format=YUY2,framerate=30/1,width=1920,height=1280  !  comp.sink_1 \
> v4l2src device=/dev/video28 ! video/x-raw,format=YUY2,framerate=30/1,width=1920,height=1280  !  comp.sink_2 \
> v4l2src device=/dev/video34 ! video/x-raw,format=YUY2,framerate=30/1,width=1920,height=1280  !  comp.sink_3

Make sure to use the Neo ISP library and review the GST plugins in Linux Users Guide. It advises disabling PipeWire.

systemctl --user stop pipewire ; systemctl --user mask pipewire

Regards

[Rathore-pioneer]

Currently, I connected only 3 cameras without a display.
I just need to store the camera feed in the file.
Exiting pipe line is not working for me.
Also, how will I get to know which video node is for which camera?

[JosephAtNXP]

Hi,

For the plugins, I found in Release Notes the downscale, encode and decode plugins.

• imxvideoconvert_g2d: GPU2D-based video convert plugin.
• imxvideoconvert_ipu: IPU-based video convert plugin.
• imxvideoconvert_pxp: PXP-based video convert plugin.
• imxvideoconvert_ocl: OpenCL-based video convert plugin.
• autovideoconvert: select the i.MX hardware based video convert plugins or other
video convert plugins according to the input and output format.
• v4l2convert: V4L2 memory-to-memory based convert plugin.

Note:
• For imxvideoconvert_ocl, rotation is not supported currently. CSC, deinterlace,
downscale, dewarp, video crop, and color range convertion are supported.
• For v4l2convert, it is automatically registered on the platforms with ISI memory-to-
memory supported.

• v4l2h264enc: VPU-based AVC/H.264 video encoder
• v4l2h265enc: VPU-based HEVC video encoder
• v4l2jpegenc: V4L2 JPEG encoder

For the camera topology, you can use the following commands to print the topology and identify the cameras.

−media-ctl  -d /dev/media8  --print-dot > media8.dot     (in i.MX95 EVK target board)

−dot  -Tpng media0.dot  -o  media0-ap1302.png   (in ubuntu PC)

Regards,

[Rathore-pioneer]

Here is the camera topology from my imx95 evk.

I can run the camera using this pipeline with libcamerasrc:

gst-launch-1.0 -e libcamerasrc camera-name="/base/soc/bus@42000000/i2c@42530000/max96724@27/i2c-mux/i2c@0/mx95mbcam@40" src::stream-role=view-finder ! video/x-raw,format=NV12,width=1920,height=1280,framerate=30/1 ! videoconvert ! v4l2h264enc ! h264parse ! mp4mux ! filesink location=/tmp/cam0_processed.mp4

How can I run my camera using v4l2src? Also, what is the plugin for scaling down the video without cropping the view to 1920*382 using a hardware accelerator?