IMX8M Plus ISP

[malik_cisse]

Hi,

I am trying to port a new sensor (sony-imx477) to IMX8M Plus and use the hardware ISP to get color pictures.

So far I have managed to get bayer images coming out of my Devkit (Phytec Pollux) but I struggle to make the hardware ISP work lack of correct instructions.

I know there is tons of official NXP doc here but its not really helpfull for me:

https://www.nxp.com/products/processors-and-microcontrollers/arm-processors/i-mx-applications-proces...

There is even " i.MX 8M Plus Camera Sensor Porting User Guide" there but this is too high level for the actual implementation. The other docs do not really help setting up a new sensor either. It rather helps understanding a working system.

Basler BCON cam example seems interesting but I am not using the official NXP devkit thus it does not seem the best way to start from.

What are the minimum steps to integrate a new sensor with the ISP.

Did someone manage to make the ISP work with another EVK than NXP?

In my opinion, NXP made the ISP architecture too complicated and spread over too many software components. This should be one single configurable entity like other complex modules such as video encoding etc.

Thank you for sharing your experience.

Malik

[SiddavatamVishnu]

Hi @malik_cisse 

Actually, we are working in a similar project but with imx415 camera and Yes the documentation to port the new camera sensor into ISP is as complicated as it can be.  We stuck to move further, we have the imx415.c driver, could you please share the process to integrate this into the ISP, the changes we need to do.

Thank you

Vishnu Siddavatam

[malik_cisse]

Hi
As you mentioned, the documentation for porting a new camera sensor into the ISP is not very practical. It does not provide a clear, step-by-step procedure, and as far as I know, such a document simply doesn’t exist.

The best references available are the following application notes:

• AN13712: 8MP ISP OS08A20 Sensor

• AN13713: 8MP ISP New Camera Porting

In practice, the components that need to be updated include the Device Tree, isp-vvcam, and isp-imx.

Device Tree (DT):
The sensor requires proper device-tree bindings, including CSI configuration.

isp-vvcam:
This is where you need to add the imx415.c driver.

isp-imx:
You need to add both IMX415.c and the corresponding IMX415.xml configuration file.

The most effective starting point is to look at an existing, similar sensor for which a working driver is already provided.

Unfortunately, the process remains quite tedious despite these references.

[Bio_TICFSL]

Hello malik_cisse,

The basler camera is the Third party cameras with NXP, you can create a ticket for our professional services since there is no more documentation about ISP.

https://www.nxp.com/support/support/nxp-engineering-services/professional-engineering-services:PROFE...

Regards