i.MX ProcessorsのトピックRe: VPU interconnection on imx8mp

VPU interconnection on imx8mp

andrej_valek — Thu, 13 Feb 2025 09:54:50 GMT

Dear community!

I would like to ask you a question whether is possible to connect the endpoints of the ISP or Dewarp Engine directly to the VPU so that frames are automatically forwarded. I found something like "interconnects" on https://www.kernel.org/doc/Documentation/devicetree/bindings/soc/imx/fsl%2Cimx8mp-media-blk-ctrl.yaml but didn't find more info. Other location is https://www.kernel.org/doc/Documentation/devicetree/bindings/soc/imx/fsl%2Cimx8mm-vpu-blk-ctrl.yaml while it's for imx8mm, but anyway without any success.

So is it possible to do it? If yes, how?

Thank you,
Andy

Re: VPU interconnection on imx8mp

Bio_TICFSL — Thu, 13 Feb 2025 15:22:45 GMT

Hello,

Is better try this appnote:

https://www.nxp.com/docs/en/user-guide/iMX8MP_CAMERA_DISPLAY_GUIDE.pdf

Also this information from a third party:

https://developer.ridgerun.com/wiki/index.php/ISP_Architecture_i.MX8M_Plus_:_V4L2_Sensor_Drivers_Porting_Guide

Regards

Re: VPU interconnection on imx8mp

andrej_valek — Fri, 14 Feb 2025 10:24:09 GMT

Hello,

Does it mean that it's impossible, or ?

Just for a background, the current visualized pipeline looks like this:

# Start ISP Mediaserver in the background /opt/imx8-isp/bin/start_isp.sh & # Start GStreamer pipeline for image transmission via network gst-launch-1.0 v4l2src device=/dev/video3 \ ! video/x-raw,format=YUY2,width=1920,height=1080 \ ! vpuenc_hevc \ ! rtph265pay \ ! udpsink host=192.168.1.2 port=1234

The final application will not utilize GStreamer. Therefore, it is necessary to find an alternative method for passing frames to the VPU. Ideally, the endpoint of the Dewarp Engine can be directly connected to the VPU sink in the device tree.

So how to achieve something like that?

Andy