Using a Camera with FRDM-MCXN947 for Vision AI/ML

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Using a Camera with FRDM-MCXN947 for Vision AI/ML

Using a Camera with FRDM-MCXN947 for Vision AI/ML

The MCX N microcontroller family includes an eIQ Neutron N1-16 NPU for accelerating neural network models. The FRDM-MCXN947 development board can be combined with a camera and LCD screen to showcase running TinyML vision models on a microcontroller. 


 MCX N Camera Hardware Setup:

The following hardware is used:

 There are three small modifications needed for the FRDM-MCXN947 board for camera support. Without this modification the camera colors will be incorrect and tinted red.  

  • Change SJ16, SJ26, and SJ27 found on the back of the Rev B board to connect pin 3 (the dashed side) so that it looks like the following:
        anthony_huereca_0-1770329042521.png

Then connect the camera and LCD to the FRDM-MCXN947:

  1. Plug in the OV7670 camera into J11. It should line up with the orange box.
       anthony_huereca_1-1770329080269.png          
       anthony_huereca_2-1770329086311.png

 

 

  1. Connect the LCD-PAR-S035 LCD into J12. It should be flush with the bottom so that the top 2 rows of pins are left hanging off the edge. Also note that on some LCD-PAR-S035 boards those top two rows of pins are not installed.
        anthony_huereca_3-1770329095085.png

 

  1. It should look like the following when complete
         anthony_huereca_4-1770329100729.png

 


Also as the camera and Ethernet pins are shared, if you need to use the Ethernet+Camera at the same time please see this NXP Community post.


MCX N Vision ML Examples:

The NXP Application Code Hub contains several vision AI/ML examples:

There are also Multimedia Processing Pipeline (MPP) examples inside the MCX N MCUXpresso SDK that demonstrate more examples of using vision AI/ML on MCX N. These examples are only available for VSCode/GCC in the Repository-Layout SDK package.

Note: It is recommended to use MCUXpresso SDK 25.09 for these examples. The MPP issues in the 25.12 and 26.03 MCUXpresso SDK releases should be fixed in the upcoming MCUXpresso SDK 26.06. 

anthony_huereca_5-1770329951165.png

 

MCX N ML Vision Lab:

The attached eIQ Neutron NPU for MCX N Lab Guide - Face Detect.pdf lab document walks through the steps to download an example Face Detect ML project from the NXP Application Code Hub and use the eIQ Neutron Converter tool to convert a model. It also describes how to update the eIQ and Neutron software libraries in an older MCUXpresso SDK project to work with the latest eIQ Neutron SDK libraries. It is recommended to go through the general MCX N NPU Lab Guide first and then do the attached Face Detect lab second. 


Labels (3)
Attachments
%3CLINGO-SUB%20id%3D%22lingo-sub-2313227%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3EUsing%20a%20Camera%20with%20FRDM-MCXN947%20for%20Vision%20AI%2FML%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2313227%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%0A%3CP%3EThe%20%3CA%20href%3D%22https%3A%2F%2Fwww.nxp.com%2Fproducts%2FMCX-N94-N54-N53-N52-N24%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EMCX%20N%20microcontroller%20family%3C%2FA%3E%20includes%20an%20eIQ%20Neutron%20N1-16%20NPU%20for%20accelerating%20neural%20network%20models.%20The%20FRDM-MCXN947%20development%20board%20can%20be%20combined%20with%20a%20camera%20and%20LCD%20screen%20to%20showcase%20running%20TinyML%20vision%20models%20on%20a%20microcontroller.%26nbsp%3B%3CBR%20%2F%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3CFONT%20size%3D%225%22%3E%3CSTRONG%3EMCX%20N%20Camera%20Hardware%20Setup%3A%3C%2FSTRONG%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3EThe%20following%20hardware%20is%20used%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EMCX%20N%20FRDM%20Development%20Board%20-%20%3CA%20href%3D%22http%3A%2F%2Fnxp.com%2FFRDM-MCXN947%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EFRDM-MCXN947%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fa.co%2Fd%2F1V7IIdy%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EOV7670%20camera%3C%2FA%3E%20(with%20optional%20%3CA%20href%3D%22https%3A%2F%2Fa.co%2Fd%2F1dIXYuZ%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Ewide-angle%20lens%3C%2FA%3E)%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fwww.nxp.com%2Fdesign%2Fdesign-center%2Fdevelopment-boards-and-designs%2FLCD-PAR-S035%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3ENXP%20LCD-PAR-S035%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3BThere%20are%20three%20small%20modifications%20needed%20for%20the%20FRDM-MCXN947%20board%20for%20camera%20support.%20Without%20this%20modification%20the%20camera%20colors%20will%20be%20incorrect%20and%20tinted%20red.%26nbsp%3B%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EChange%20%3CSTRONG%3ESJ16%3C%2FSTRONG%3E%2C%20%3CSTRONG%3ESJ26%3C%2FSTRONG%3E%2C%20and%20%3CSTRONG%3ESJ27%3C%2FSTRONG%3E%20found%20on%20the%20back%20of%20the%20Rev%20B%20board%20to%20connect%20pin%203%20(the%20dashed%20side)%20so%20that%20it%20looks%20like%20the%20following%3A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%26nbsp%3B%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22anthony_huereca_0-1770329042521.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22anthony_huereca_0-1770329042521.png%22%20style%3D%22width%3A%20367px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F375743iCC9604C4D23E3304%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22anthony_huereca_0-1770329042521.png%22%20alt%3D%22anthony_huereca_0-1770329042521.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%0A%3CP%3EThen%20connect%20the%20camera%20and%20LCD%20to%20the%20FRDM-MCXN947%3A%3C%2FP%3E%0A%3COL%3E%0A%3CLI%3EPlug%20in%20the%20OV7670%20camera%20into%20J11.%20It%20should%20line%20up%20with%20the%20orange%20box.%3C%2FLI%3E%0A%3C%2FOL%3E%0A%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22anthony_huereca_1-1770329080269.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22anthony_huereca_1-1770329080269.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F375744iD34AFD975AC6D0B5%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22anthony_huereca_1-1770329080269.png%22%20alt%3D%22anthony_huereca_1-1770329080269.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%26nbsp%3B%0A%3CDIV%20class%3D%22lia-message-template-content-zone%22%3E%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22anthony_huereca_2-1770329086311.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22anthony_huereca_2-1770329086311.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F375745i50D061DD5A38AC32%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22anthony_huereca_2-1770329086311.png%22%20alt%3D%22anthony_huereca_2-1770329086311.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%0A%3CBR%20%2F%3E%0A%3CBR%20%2F%3E%0A%3COL%20start%3D%222%22%3E%0A%3CLI%3EConnect%20the%20LCD-PAR-S035%20LCD%20into%20J12.%20It%20should%20be%20flush%20with%20the%20bottom%20so%20that%20the%20%3CSTRONG%3Etop%202%20rows%20of%20pins%3C%2FSTRONG%3E%20are%20left%20hanging%20off%20the%20edge.%20Also%20note%20that%20on%20some%20LCD-PAR-S035%20boards%20those%20top%20two%20rows%20of%20pins%20are%20not%20installed.%3C%2FLI%3E%0A%3C%2FOL%3E%0A%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%26nbsp%3B%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22anthony_huereca_3-1770329095085.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22anthony_huereca_3-1770329095085.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F375746iB1CC96779FC405C1%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22anthony_huereca_3-1770329095085.png%22%20alt%3D%22anthony_huereca_3-1770329095085.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%0A%3CBR%20%2F%3E%0A%3COL%20start%3D%223%22%3E%0A%3CLI%3EIt%20should%20look%20like%20the%20following%20when%20complete%3C%2FLI%3E%0A%3C%2FOL%3E%0A%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%20%26nbsp%3B%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22anthony_huereca_4-1770329100729.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22anthony_huereca_4-1770329100729.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F375747i41A4ED1C4464F2D1%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22anthony_huereca_4-1770329100729.png%22%20alt%3D%22anthony_huereca_4-1770329100729.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%0A%3CBR%20%2F%3E%0A%3CP%3E%3CBR%20%2F%3EAlso%20as%20the%20camera%20and%20Ethernet%20pins%20are%20shared%2C%20if%20you%20need%20to%20use%20the%20Ethernet%2BCamera%20at%20the%20same%20time%20please%20see%20%3CA%20href%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2FMCX-Microcontrollers-Knowledge%2FMCX-N947-Simultaneous-Implementation-of-Ethernet-and-Camera%2Fta-p%2F2167421%22%20target%3D%22_self%22%3Ethis%20NXP%20Community%20post.%3C%2FA%3E%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3E%3CFONT%20size%3D%225%22%3E%3CSTRONG%3EMCX%20N%20Vision%20ML%20Examples%3A%3C%2FSTRONG%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%3EThe%20%3CA%20href%3D%22https%3A%2F%2Fmcuxpresso.nxp.com%2Fappcodehub%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3ENXP%20Application%20Code%20Hub%3C%2FA%3E%20contains%20several%20vision%20AI%2FML%20examples%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fnxp-appcodehub%2Fdm-multiple-face-detection-on-mcxn947%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EFace%20Detect%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fnxp-zephyr%2Fapps_zephyr%2Fblob%2FFacialDetect%2FREADME.md%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EFace%20Detect%20with%20Zephyr%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fnxp-appcodehub%2Fdm-multiple-person-detection-on-mcxn947%2Fblob%2Fmain%2FREADME.md%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EMultiple%20Person%20Detection%26nbsp%3B%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fnxp-appcodehub%2Fdm-label-cifar10-images-on-mcxn947%2Fblob%2Fmain%2FREADME.md%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3ECIFAR10%3C%2FA%3E%3C%2FLI%3E%0A%3CLI%3E%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fnxp-appcodehub%2Fdm-fashion-mnist-recognition-on-mcxn947%2Fblob%2Fmain%2FREADME.md%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EFashion%20MNIST%3C%2FA%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EThere%20are%20also%20Multimedia%20Processing%20Pipeline%20(MPP)%20examples%20inside%20the%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fnxp-mcuxpresso%2Fmcuxsdk-examples%2Ftree%2Fmain%2Feiq_examples%2Fmpp%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EMCX%20N%20MCUXpresso%20SDK%3C%2FA%3E%20that%20demonstrate%20more%20examples%20of%20using%20vision%20AI%2FML%20on%20MCX%20N.%20These%20examples%20are%20only%20available%20for%20VSCode%2FGCC%20in%20the%20Repository-Layout%20SDK%20package.%20%3CBR%20%2F%3E%3CBR%20%2F%3E%3CSTRONG%3ENote%3A%3C%2FSTRONG%3E%20It%20is%20recommended%20to%20use%20MCUXpresso%20SDK%2025.09%20for%20these%20examples.%20The%20MPP%20issues%20in%20the%2025.12%20and%2026.03%20MCUXpresso%20SDK%20releases%20should%20be%20fixed%20in%20the%20upcoming%20MCUXpresso%20SDK%2026.06.%26nbsp%3B%3C%2FP%3E%0A%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22anthony_huereca_5-1770329951165.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22anthony_huereca_5-1770329951165.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F375750i882398DED5058277%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22anthony_huereca_5-1770329951165.png%22%20alt%3D%22anthony_huereca_5-1770329951165.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%0A%3CBR%20%2F%3E%0A%3CP%3E%3CFONT%20size%3D%225%22%3E%3CSTRONG%3EMCX%20N%20ML%20Vision%20Lab%3A%3C%2FSTRONG%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20data-unlink%3D%22true%22%3EThe%20attached%20%3CA%20href%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2FMCX-Microcontrollers-Knowledge%2FUsing-a-Camera-with-FRDM-MCXN947-for-Vision-AI-ML%2Fta-p%2F2313227%3Fattachment-id%3D215738%22%20target%3D%22_self%22%3EeIQ%20Neutron%20NPU%20for%20MCX%20N%20Lab%20Guide%20-%20Face%20Detect.pdf%3C%2FA%3E%20lab%20document%20walks%20through%20the%20steps%20to%20download%20an%20example%20Face%20Detect%20ML%20project%20from%20the%20NXP%20Application%20Code%20Hub%26nbsp%3Band%20use%20the%20eIQ%20Neutron%20Converter%20tool%20to%20convert%20a%20model.%20It%20also%20describes%20how%20to%20update%20the%20eIQ%20and%20Neutron%20software%20libraries%20in%20an%20older%20MCUXpresso%20SDK%20project%20to%20work%20with%20the%20latest%20eIQ%20Neutron%20SDK%20libraries.%20It%20is%20recommended%20to%20go%20through%20the%20%3CA%20href%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2FMCX-Microcontrollers-Knowledge%2FeIQ-Neutron-NPU-Lab-Guides%2Fta-p%2F1799233%22%20target%3D%22_self%22%3Egeneral%20MCX%20N%20NPU%20Lab%20Guide%20first%3C%2FA%3E%20and%20then%20do%20the%20attached%20Face%20Detect%20lab%20second.%26nbsp%3B%3CBR%20%2F%3E%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%0A%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2313227%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3EFRDM-Training%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMCXN%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ENPU%7CML%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
No ratings
Version history
Last update:
Wednesday
Updated by: