VPU interconnection on imx8mp

[andrej_valek]

Dear community!

I would like to ask you a question whether is possible to connect the endpoints of the ISP or Dewarp Engine directly to the VPU so that frames are automatically forwarded. I found something like "interconnects" on https://www.kernel.org/doc/Documentation/devicetree/bindings/soc/imx/fsl%2Cimx8mp-media-blk-ctrl.yam... but didn't find more info. Other location is https://www.kernel.org/doc/Documentation/devicetree/bindings/soc/imx/fsl%2Cimx8mm-vpu-blk-ctrl.yaml while it's for imx8mm, but anyway without any success.

So is it possible to do it? If yes, how?

Thank you,
Andy

[Bio_TICFSL]

Hello,

Is better try this appnote:

https://www.nxp.com/docs/en/user-guide/iMX8MP_CAMERA_DISPLAY_GUIDE.pdf

Also this information from a third party:

https://developer.ridgerun.com/wiki/index.php/ISP_Architecture_i.MX8M_Plus_:_V4L2_Sensor_Drivers_Por...

Regards

[andrej_valek]

Hello,

Does it mean that it's impossible, or ?

Just for a background, the current visualized pipeline looks like this:

# Start ISP Mediaserver in the background
/opt/imx8-isp/bin/start_isp.sh &

# Start GStreamer pipeline for image transmission via network
gst-launch-1.0 v4l2src device=/dev/video3 \
  ! video/x-raw,format=YUY2,width=1920,height=1080 \
  ! vpuenc_hevc \
  ! rtph265pay \
  ! udpsink host=192.168.1.2 port=1234

The final application will not utilize GStreamer. Therefore, it is necessary to find an alternative method for passing frames to the VPU. Ideally, the endpoint of the Dewarp Engine can be directly connected to the VPU sink in the device tree.

So how to achieve something like that?

Andy