Interfacing IMRT1170-EVKB DevKit with a 12 bit pixel monochrome camera with 2 lane MIPI

[jyothz]

Hi Team,

We are currently working on interfacing the i.MX RT1170-EVKB board with a camera using a 2-lane MIPI interface. In our setup, all camera control signals are managed by an FPGA, while the i.MX RT1170 board is responsible only for receiving image data from the FPGA and streaming it to the host system.

We have attempted to modify the “uvc_rgb_imxrt1170” example project by bypassing the camera initialization and I²C control sequences, since the camera is managed externally. However, we have not yet been able to verify whether the board is successfully receiving data over the MIPI interface.

The camera specifications are as follows:

• Pixel format: 12-bit monochrome

• Resolution: 2048 × 2048

• Data source: FPGA (via 2-lane MIPI)

Before proceeding further, we would like clarification on the following points:

1. Is it feasible to interface the i.MX RT1170-EVKB with an FPGA-based MIPI source by replacing the OV5640 camera?

2. Can the existing PXP (Pixel Pipeline) module handle the 12-bit monochrome data format described above?

For reference, we have attached details of the MIPI connector used and the example project originally designed for streaming data from the OV5640 camera.

FPGA to IMXRT1170 connector (J2 in IMX BOARD)

Please Go through and Respond 
Any information regarding this will be much valuable and helpful.

Thank you for your guidance and support.
Jyothish

[jyothz]

Hi, have done most of the workaround but still not able to receive the data send from FPGA.

Q1 ) I wanted to ask about the connected i am using in mipi .

Image 1 :

image 2:

as shown in above "image 1" of the connected from the NXP Schematics there are many functional pins , like PWR_EN and others but in the connecter i have designed only has 3 set of differential pairs 2 data lanes and 1 clock lane with ground are these much connections are only needed to establish a valid connection in mipi with the FPGA Replacing OVA5640 camera or any other pins are been validated for proper connection.

Q2) I have also observed while Initializing MIPI CSI2 RX in NXP IMXRT1170 controller the while initializing the MIPI  CSI@ RX registers some hard_fault or bus error occurs due to which the code gets hang there and after that i am not able to flash code causing "error closing down debug session - Nn(05). Wire ACK Fault in DAP access" error

Please help with these doubts so that i can move forward with my work since i am stuck for a long.

Thankyou for your time and effort.

Jyothish

[Sam_Gao]

please refer to application notes AN13573 for MIPI CSI and AN12940 for MIPI DSI configurations on the RT1170 platform.

https://docs.nxp.com/bundle/AN13573/page/topics/features_differences_between_imx_8m_and_imx_rt_par.h...

https://www.nxp.com/docs/en/application-note/AN12940.pdf

[Sam_Gao]

Hi,

It is feasible to interface the i.MX RT1170-EVKB with an FPGA-based MIPI source, but the PXP module will require data format conversion to handle 12-bit monochrome data.

• Q1. FPGA-based MIPI Source Interface: Interfacing an FPGA that acts as a MIPI CSI-2 camera source is possible. The i.MX RT1170-EVKB is equipped with a MIPI Camera Module Connector (J2) designed for this purpose. But we don't have such solution to support by using FPGA-based MIPI source.
• Q2. PXP and 12-bit Monochrome Data: The PXP (Pixel Pipeline) is a 2D graphics accelerator capable of operations like color space conversion, rotation, and resizing , . However, it does not have native support for a 12-bit monochrome (grayscale) input format.
  • Supported PXP Formats : The PXP supports a variety of RGB and YUV formats, including 8-bit monochrome ( Y8 ) and 4-bit monochrome ( Y4 ),. There is no documented support for a 12-bit monochrome ( Y12 ) input.
  • Required Workaround : To process the image with the PXP, the 12-bit monochrome data must be converted into a supported format before it is passed to the PXP. 

[jyothz]

Apologies for the delayed response, and thank you for your valuable input earlier — it helped us confirm that the setup is indeed feasible.

We have an additional query: In our setup, an FPGA is connected to a camera module and continuously streams image data to the i.MX RT1170 controller via the MIPI interface. Since the FPGA handles all communication with the camera, we have excluded the I2C-based camera initialization from the i.MX RT1170 side.
Our question is: Will the MIPI interface on the i.MX RT1170 still function correctly if we completely remove the I2C camera initialization sequence, considering that the FPGA does not require any I2C interaction? Or, are there any I2C-dependent flags, registers, or status bits within the i.MX RT1170 MIPI subsystem that are mandatory for proper MIPI operation?

Thank you for your time and guidance.

Best regards,
Jyothish

[Sam_Gao]

Hi,

I2C and MIPI are independent. MIPI and I2C(I2C_6) are used to control the camera in the RT1170-EVKB board, but there is no dependency between them.