FAQs
English (US) 日本語 | Japanese 中文 | Chinese (Simplified)

Tensorflow to CMSIS-NN via Glow

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Tensorflow to CMSIS-NN via Glow

‎12-09-2020 03:37 AM
2,412 Views
jack5
Contributor I

Hi

I need to convert a tensorflow-model so that it will run on a LPC43S57-Chip using CMSIS-NN.

What I have so far:

Created a small, simple network using Python 3.7.9, Keras 2.4.3 and coverted it to onnx using onnxmltools 1.7.0.

I downloaded the "Glow Installer for windows" from your website, installed it and ran the model-compiler command to received the folder as the output as expected.

I have two questions:

  1. In this video you mention a quantization-profile and use the "image-classifier" command. What command is to use if the input to the model is NOT a picture?
  2. As stated, I need to use the CMSIS-NN library. The functions of the CMSIS-NN-library expect arrays for the different layers for their weightes and biases. The output of model-compiler (glow) seems to store the weights and bias information inside the "xxx.weights.txt" file but they are not organized so that they can be used with CMSIS-NN. How do you organize the values inside "xxx.weights.txt" so that they can be used with CMSIS-NN?

Best

0 Kudos
1 Reply

‎12-15-2020 09:51 AM
2,377 Views
anthony_huereca
NXP Employee
NXP Employee

To summarize what we discussed via messenger, Glow does not convert a model into CMSIS-NN code. Instead it compiles a model into a machine executable binary, and as part of that process the compiler has the option, if specified with the -use-cmsis argument, to make use of the CMSIS-NN libraries to speed up the execution of that code. The end result of running the Glow compiler though is a binary file that gets executed as part of a MCUXpresso SDK project. 

If the model is not doing image classification, the Glow model-profiler tool (look under the "Compile a bundle for a quantized model" section)  can be used to generate a quantization profile. This tool is not included in the current NXP Glow release, but will be part of the next NXP Glow release early next year. 

I should note that there are scripts (code_gen.py) from ARM that can convert a Caffe model into CMSIS-NN API calls. 

Finally it may be possible to run your model using Glow on a LPC53S57 chip. There's a Glow porting guide available that should help with the porting process. The key requirement will be how large your model is which determines if it'll fit in the memory constraints of that device. 

0 Kudos