RT1060 - 1080p Video stream via wifi (88W8887 or 88W8977)

[shai_b]

Hello Team,

My Customer has the following requirements to capture 1080p video (without audio) at 30 frames per second using RT1050/60 and able to transfer (stream) via wifi(4/5) direct protocol. 

Could you please advise if such a design is feasible using the iMX RT family and if WIFI4 is enough to transfer/stream 1080p video (p2p)?

if there is a relevant reference design available it would be great, waiting for your kind support.

Thanks in advance

Regards,

Shai 

[kerryzhou]

Hi shai_b，

   Could you please also tell me your 1080p video per frame data? In fact, I want to know the detail 30 frames per second data.

 To 8977, the wifi data rates up to MCS7 150Mbit/s

You can calculate your frame data, whether in the wifi send Rate range.

Any updated information, just kindly let me know.

Best Regards,

Kerry

[shai_b]

Hi @kerryzhou,

Thanks for your inputs, could you please advise if the RT1050/60 Parallel camera sensor interface can handle a 1080p@30fps CMOS sensor and able to save the video (a few sec of video without audio) on SD and able to stream the video over the Wifi?

second thing, there is any reference design that you can share and if there is any recommend CMOS sensor that works with the RT family that provides such a resolution.

the last thing, do you think that iMX RT1050/60 or even RT1170 could be able to encode/compress the saved video (by SW) before sending the video over wifi?

Waiting for your kind response, Thanks. 

BR,

Shai

[kerryzhou]

Hi shai_b,

   About the RT CSI resolutions, we have an application note:

AN12110 Developing a Camera Application with i.MX RT Series

 https://www.nxp.com/docs/en/application-note/AN12110.pdf

This application is use the RT1050 CSI to capture the camera with HD-720P @30fps, displays on the LCD panel, and save to sd card with compressed JPEG format.

   But to your required 1080p@30fps, I search it internally, and find the expert has reply the related question in the previous time.

  The related information may useful to you, but it is for the UVC:

-----------------

 it is difficult for RT1050 to support the requirements with UVC.

• RT1050 USB in HS mode, the UVC bandwidth is about 24,576,000 bytes per second.
• 720p 60fps 16-bit pixel loading: 720x1280x2x60= 110,592,000 bytes per second.
• 1080p 30fps 16-bit pixel loading: 1080x1920x2x30 = 124,416,000 bytes per second.
• JPEG compression by software is very low efficient. It impossible for RT1050 to compress 720p 60fps or 1080p 30fps.

According to the USB spec:

• The maximum data size in the data packet of isochronous transfers for a HS device is 1024 bytes.
• There're up to 3 transactions in a micro-frame (each transaction containing one data packet).
• A micro frame takes up 125us.

So the bandwidth is 1024 x 3 / 0.000125 = 24,576,000 B/s

Not only for RT1050/1060/1170, but also all High-Speed UVC has same bandwidth limitation.

--------------------------

So, at last, if you save the picture with the JPEG compression with 1080p 30fps, RT1050/60  may can't realize it. Talkback to the wifi, just as my above picture, you can find datarate is 150Mb/s, the bandwidth should be 150*1024*1024/8=19,660,800Byte per second, you can find it even smaller than the UVC bandwidth.  And the RT1170 also have the UVC limitation, so I think the wifi also have this limit.

Wish it helps you!

Best Regards,

Kerry

[shai_b]

@kerryzhou hello,

Thank you so much for your detailed answer, after escalating again with the customer we get into a compromise in the requirements, see below the brief of the products needs.

this is a medical product that uses a camera for capturing a short video clip of patient skin to analyze the skin on a doctor's PC. The purpose of the live streaming is only to able the doctor to direct the device to the relevant place on the skin and then the doctor triggers the testing process which is typically a 3-4 second video clip (which should not be streamed live) but should be saved in SD card as RAW format and then send the file via DirectWiFi communication back to the PC.

The product will contain two parts one is the "camera probe" (as described above) and the second device is a "direct wifi USB dongle" that connected to PC in order to provide a clean DirectWifi Channel between the Probe and the PC.

the live streaming video should be 720p@30 (can be compressed), but once the Probe got triggered the video should be at least 1000x1000@30 in RAW and should be saved on the SD before sending via Wi-Fi.

The customer also understands his processing limitation power and consider to use RT1170.

Please advise if it possible to achieve? 

Thanks in advance 

BR,

Shai

[kerryzhou]

Hi shai_b,

   Thanks for your updated information.

  Do you mean, the customer can accept just save the raw data to the SDcard, not the  JPEG compression method, right?

   And the camera also can use the 720@30pfs, now, the data should be:

• 720p 30fps 16-bit pixel loading: 720x1280x2x30= 55,296,000 bytes per second

So, from the 8977 and 8887 datasheet:

https://www.nxp.com/products/wireless/wi-fi-plus-bluetooth/88w8977-2-4-5-ghz-dual-band-1x1-wi-fi-4-8...

Up to MCS7 data rates (150 Mbps), the bandwidth should be 150*1024*1024/8=19,660,800Byte per second,

https://www.nxp.com/products/wireless/wi-fi-plus-bluetooth/88w8887-1x1-dual-band-wi-fi5-802-11ac-and...

IEEE 802.11 ac compliant, 1x1 spatial stream with data rates up to MCS9 (433 Mbit/s)

the bandwidth should be 433*1024*1024/8=56,754,176Byte per second,

8887 may can cover the data transfer.

Now, when you save the data to the SDcard, not use the JPEG compression, right?

Best Regards,

Kerry

[kerryzhou]

Hi shai_b,

  Thanks for your interest in the NXP MIMXRT product, I would like to provide service for you.

  I will check with our internal side, please keep patient.

   Any updated information will let you know.

Best Regards,

Kerry

[thieuqp]

Dear @kerryzhou 

Do you have any Solution for JPEG encode by MCU. i need take a picture and send PC via USB 2.0

Many thanks

[kerryzhou]

Hi @thieuqp ,

  Any issues, please help to create your own question post.

Then we will help you in your own question post, thanks.

Best Regards,

Kerry