2389749_en-US

[#1]

OV5640 Interfacing with i.MX RT1170 (Without Display) Image Capture and Streaming to Desktop

Hello,

I am using the i.MX RT1170-EVKB board, and my goal is to capture images from the OV5640 camera and view either the captured image or a live video stream on my desktop PC without using an LCD display.

I have tried the MIPI CSI SDK examples and was able to capture image data in RAW format. However, I am facing several issues.

The captured output is in RAW format, and I could not find any documentation explaining how to properly convert or view these images.
The captured images appear to have incorrect colors or filter-like artifacts, making it difficult to verify whether the camera output is correct.
I could not find any official documentation, application notes, or video tutorials describing the complete workflow for capturing images from the OV5640 and viewing them on a desktop PC.
There is no clear reference explaining how to stream the camera output over Ethernet or USB without using the onboard display.
I also tried the sd_jpeg example, but I encountered multiple problems.

During integration, the project reported missing JPEG library configuration files such as jconfig.h.
After resolving some build issues, I continued to encounter compilation and integration errors while combining the JPEG encoder with the MIPI CSI camera example.
I was unable to generate a valid JPEG image from the captured camera frame.
My objective is to:

Interface the OV5640 camera with the i.MX RT1170-EVKB board without using an LCD display.
Capture images and transfer them to my desktop PC for viewing.
Stream live video from the camera to my desktop PC over Ethernet, if supported.
I would appreciate your guidance on the following questions:

Is there an official SDK example or reference project for this use case?
Is there any documentation explaining the complete image capture pipeline from the OV5640 through MIPI CSI, memory, JPEG or RAW processing, and Ethernet or USB transfer to a desktop PC?
Is live streaming over Ethernet supported on the RT1170-EVKB? If yes, could you recommend the appropriate SDK example or middleware?
Are there any known issues with the sd jpeg example or any additional configuration steps required to integrate it with the MIPI CSI camera examples?
Any guidance, documentation, or reference projects would be greatly appreciated.

Thank you for your support.

Re: OV5640 Interfacing with i.MX RT1170 (Without Display) Image Capture and Streaming to Desktop

HI @Sureshk123,

We don't have an official example project or reference design for your application. That said, from my understanding, I would recommend you tackle the complete application as follows:

Camera capture path (OV5640 > MIPI CSI > cameraBuffer) This part we do have an example application, which are the aforementioned MIPI CSI SDK examples. Keep in mind that, as per ERR051248: "Video Mux Controller (VIDEO_MUX), raw data and YUV422 (10 bit) formats to the MIPI_CSI2 block are not supported." Using the parallel CSI is an optional workaround, either that or a video decoder.

Once you have the adequate data on your cameraBuffer, you can integrate example projects from our SDK based on USB or lwIP to transport this data to your PC. I would recommend looking into JPEG encoding only after the buffer is known to work.

BR,
Edwin.