Using the ISP to convert RAW to YUV on IMX8MP

nbi — Mon, 09 May 2022 10:42:44 GMT

Hi,

I'm are currently trying to setup a videostream from an image sensor which outputs RAW12 to the IMX8MP.

I've established that I need the ISP to convert the RAW input to YUV, however using VVCAM and V4L2 I'm still struggling to set up the "device chain" (Sensor -> MIPI-CSI2 -> ISP -> File).

The device tree enables the isp0, isp1, dewarp and the mipi_csi_0 is linked with the camera endpoint.

When looking at the media device I get the following:

root@imx8mpevk:~# media-ctl -p

Media controller API version 5.10.52

Media device information

------------------------

driver vvcam-video

model viv_media

serial

bus info

hw revision 0x0

driver version 5.10.52

Device topology

- entity 1: viv_v4l20 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/video2

pad0: Sink

<- "vvcam-isp.0":0 [ENABLED]

- entity 5: viv_v4l21 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/video3

pad0: Sink

<- "vvcam-isp.1":0 [ENABLED]

- entity 9: vvcam-dwe.0 (2 pads, 0 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev0

pad0: Source

pad1: Sink

- entity 12: vvcam-dwe.1 (2 pads, 0 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev2

pad0: Source

pad1: Sink

- entity 15: vvcam-isp.0 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev1

pad0: Source

-> "viv_v4l20":0 [ENABLED]

- entity 23: vvcam-isp.1 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev3

pad0: Source

-> "viv_v4l21":0 [ENABLED]

It seems that the isp is missing a pad with mipi_csi_0 as sink.

In the isp-imx-4.2.2.17.0.bin file, drivers for OS08A20 or the OV2775 are available, are the any example code to get a full "chain" running?

Furthermore I've seen the isp-media-server mentioned in other forum posts, is this needed to get the ISP working?

Best Regards

NBI

Re: Using the ISP to convert RAW to YUV on IMX8MP

khang_letruong — Mon, 09 May 2022 15:20:08 GMT

Hi @nbi ,

For single pipeline sensor -> MIPI-CSI2 -> ISP0--> DWE0 -> /dev/video2, mine is as below :

root@imx8mpevk:/opt/imx8-isp/bin# media-ctl -d 1 -p Media controller API version 5.10.52 Media device information ------------------------ driver vvcam-video model viv_media serial bus info hw revision 0x0 driver version 5.10.52 Device topology - entity 1: viv_v4l20 (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/video2 pad0: Sink <- "vvcam-isp.0":0 [ENABLED] - entity 5: vvcam-dwe.0 (2 pads, 0 link) type Node subtype V4L flags 0 device node name /dev/v4l-subdev2 pad0: Source pad1: Sink - entity 8: vvcam-isp.0 (1 pad, 1 link) type Node subtype V4L flags 0 device node name /dev/v4l-subdev3 pad0: Source -> "viv_v4l20":0 [ENABLED]

Regards,
Khang

topic Re: Using the ISP to convert RAW to YUV on IMX8MP in i.MX Processors

Using the ISP to convert RAW to YUV on IMX8MP

Re: Using the ISP to convert RAW to YUV on IMX8MP