Using the ISP to convert RAW to YUV on IMX8MP

[nbi]

Hi,

I'm are currently trying to setup a videostream from an image sensor which outputs RAW12 to the IMX8MP.

I've established that I need the ISP to convert the RAW input to YUV, however using VVCAM and V4L2 I'm still struggling to set up the "device chain" (Sensor -> MIPI-CSI2 -> ISP -> File).

The device tree enables the isp0, isp1, dewarp and the mipi_csi_0 is linked with the camera endpoint.

When looking at the media device I get the following:

root@imx8mpevk:~# media-ctl -p

Media controller API version 5.10.52

Media device information

------------------------

driver vvcam-video

model viv_media

serial

bus info

hw revision 0x0

driver version 5.10.52

Device topology

- entity 1: viv_v4l20 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/video2

pad0: Sink

<- "vvcam-isp.0":0 [ENABLED]

- entity 5: viv_v4l21 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/video3

pad0: Sink

<- "vvcam-isp.1":0 [ENABLED]

- entity 9: vvcam-dwe.0 (2 pads, 0 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev0

pad0: Source

pad1: Sink

- entity 12: vvcam-dwe.1 (2 pads, 0 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev2

pad0: Source

pad1: Sink

- entity 15: vvcam-isp.0 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev1

pad0: Source

-> "viv_v4l20":0 [ENABLED]

- entity 23: vvcam-isp.1 (1 pad, 1 link)

type Node subtype V4L flags 0

device node name /dev/v4l-subdev3

pad0: Source

-> "viv_v4l21":0 [ENABLED]

It seems that the isp is missing a pad with mipi_csi_0 as sink.

In the isp-imx-4.2.2.17.0.bin file, drivers for OS08A20 or the OV2775 are available, are the any example code to get a full "chain" running?

Furthermore I've seen the isp-media-server mentioned in other forum posts, is this needed to get the ISP working?

Best Regards

NBI

[khang_letruong]

Hi @nbi ,

For single pipeline sensor -> MIPI-CSI2 -> ISP0--> DWE0 -> /dev/video2, mine is as below :

root@imx8mpevk:/opt/imx8-isp/bin# media-ctl -d 1 -p
Media controller API version 5.10.52

Media device information
------------------------
driver vvcam-video
model viv_media
serial 
bus info 
hw revision 0x0
driver version 5.10.52

Device topology
- entity 1: viv_v4l20 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video2
pad0: Sink
<- "vvcam-isp.0":0 [ENABLED]

- entity 5: vvcam-dwe.0 (2 pads, 0 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev2
pad0: Source
pad1: Sink

- entity 8: vvcam-isp.0 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev3
pad0: Source
-> "viv_v4l20":0 [ENABLED]

Regards,
Khang