I run model from sample tflm_cifar10 on MIMRT700 (NPU model). When building the program, I could see the model's size and correspond region size.
In many cases, the region size is 1 MB. As my understanding, the model's size is limited at 1 MB. Is that right?
I did not understand this point. Here is information of MIMRT700 EVK.
I don't know where model is saved on MIMRT700 EVK. And where is the 1 MB for region size? Is it actual limit of model size? Or we can increase model size by some methods.
Do you have any comment for this problem? Because I try to deploy a larger model > 1 MB. I do wait for your response. Thank you.
Thank you so much. Now I understood that we can increase the size of the model by setting region size.
Or If I want to run larger model on external memory, I can follow this document https://docs.nxp.com/bundle/AN14700/page/topics/external_memory.html
Hi @nnxxpp ,
Thank you so much for your interest in our products and for using our community.
Q: I don't know where model is saved on MIMRT700 EVK. And where is the 1 MB for region size? Is it actual limit of model size? Or we can increase model size by some methods.
Do you have any comment for this problem? Because I try to deploy a larger model > 1 MB.
A: The 1 MB shown for modeldata is not a hardware limit of the RT700.
It is only the default linker allocation used in the sample project.
For larger models, this allocation can be adjusted in the project settings, and external XSPI flash can also be used if more storage is needed.
For more detail information, you can refer to this AN14700.
https://docs.nxp.com/bundle/AN14700/page/topics/introduction.html
So, the RT700 is not inherently limited to a 1 MB model. Larger NPU models are supported either by increasing the modeldata memory allocation or by placing the model in external XSPI flash with the appropriate conversion option.
Wish it helps you
Best Regards
May Liu