Seems I can't add the other pictures in the above post, just add another freertos version picture:
Hi sathishkumar_r,
Thanks for your updated information and let me know the newest SDK still the same result.
You mentioned:
Currently, we are using the source code which shared by NXP team, which streams the MT9M114 720p in UVC.
Do you mean, you get the MT9M114 with the usb_device_video_virtual_camera project also from NXP side? Could you please tell me who give you this project? This will be let me know the detail information from the internal side.
Now answer your questions：
1) For transferring the image data we can use the frame done dma callback instead of using the USB callback. so that we no need to wait until the buffer fill. Once we got the filled buffer we can start send the image data through USB. Why we are using the USB callback instead of using the frame done callback? Is that any issues behind this like affecting data rate or any thing else?
Answer: Do you try the dma callback directly, whether that works or not?
I need to know more information from your side, if your project with the camera sensor is from the NXP side, I need to contact with your code engeer, to know the details. If you just find it from the SDK, please also let me know, I will also check with an internal expert.
2) If we go for an RTOS, which RTOS should be use for USB either Amazon FreeRTOS or Azure RTOS?. In latest SDK we don't find any USB related Amazon free RTOS. Do we have any RTOS source code which streams the MT9M114 sensor in UVC?
Answer: in fact, you can use the FreeRtos.
You just need to download the newest SDK version in the rtos mode, then you will find the usb_device_video_virtual_camera related freertos version.
SDK_2.8.6_EVK-MIMXRT1060_freertos\boards\evkmimxrt1060\usb_examples\usb_device_video_virtual_camera\freertos
Now I can download the code to my board, your project has one build error, seems caused by the header file path missing,
after I add the path, it builds without any issues, and can download the code now.
You mentioned to reproduce the problem need to stream both the video and audio data at same time, any PC configuration? As I didn't find the audio USB interface now, could you please let me know how to select the audio and let it play in the same with the video?
I can get the video from the on board camera to the PC now, but I don't know how to select the audio to play it at the same time.
Please give me more details, then I can test it and check with our internal side.
Best Regards,
Kerry
Hi kerry,
Sorry, you can test the mic in your side also. Since we sending the static audio data.
To test the audio, please go the below website,
https://webcammictest.com/check-mic.html
Click on the Check microphone option.
Then select the audio device "VIDEO DEMO". If you playing the audio data alone without streaming the camera means, you will hear the audio sound. While you streaming the both camera and audio data means the audio sound will differ where during camera streaming audio data is not sent because of this we will get that sound differently.
