Using the ISP to convert RAW to YUV on IMX8MP

cancel
Showing results for 
Search instead for 
Did you mean: 

Using the ISP to convert RAW to YUV on IMX8MP

302 Views
nbi
Contributor I
Hi,

I'm are currently trying to setup a videostream from an image sensor which outputs RAW12 to the IMX8MP.
I've established that I need the ISP to convert the RAW input to YUV, however using VVCAM and V4L2 I'm still struggling to set up the "device chain" (Sensor -> MIPI-CSI2 -> ISP -> File).

The device tree enables the isp0, isp1, dewarp and the mipi_csi_0 is linked with the camera endpoint.

When looking at the media device I get the following:

root@imx8mpevk:~# media-ctl -p
Media controller API version 5.10.52

Media device information
------------------------
driver vvcam-video
model viv_media
serial
bus info
hw revision 0x0
driver version 5.10.52

Device topology
- entity 1: viv_v4l20 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video2
pad0: Sink
<- "vvcam-isp.0":0 [ENABLED]

- entity 5: viv_v4l21 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video3
pad0: Sink
<- "vvcam-isp.1":0 [ENABLED]

- entity 9: vvcam-dwe.0 (2 pads, 0 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev0
pad0: Source
pad1: Sink

- entity 12: vvcam-dwe.1 (2 pads, 0 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev2
pad0: Source
pad1: Sink

- entity 15: vvcam-isp.0 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev1
pad0: Source
-> "viv_v4l20":0 [ENABLED]

- entity 23: vvcam-isp.1 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev3
pad0: Source
-> "viv_v4l21":0 [ENABLED]


It seems that the isp is missing a pad with mipi_csi_0 as sink.

In the isp-imx-4.2.2.17.0.bin file, drivers for OS08A20 or the OV2775 are available, are the any example code to get a full "chain" running?
Furthermore I've seen the isp-media-server mentioned in other forum posts, is this needed to get the ISP working?

Best Regards

NBI


1 Reply

282 Views
khang_letruong
Senior Contributor III

Hi @nbi ,

For single pipeline sensor -> MIPI-CSI2 -> ISP0--> DWE0 -> /dev/video2, mine is as below :

root@imx8mpevk:/opt/imx8-isp/bin# media-ctl -d 1 -p
Media controller API version 5.10.52

Media device information
------------------------
driver vvcam-video
model viv_media
serial 
bus info 
hw revision 0x0
driver version 5.10.52

Device topology
- entity 1: viv_v4l20 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/video2
pad0: Sink
<- "vvcam-isp.0":0 [ENABLED]

- entity 5: vvcam-dwe.0 (2 pads, 0 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev2
pad0: Source
pad1: Sink

- entity 8: vvcam-isp.0 (1 pad, 1 link)
type Node subtype V4L flags 0
device node name /dev/v4l-subdev3
pad0: Source
-> "viv_v4l20":0 [ENABLED]

 

Regards,
Khang