Is there any guide to evaluate tflite NPU on local host?

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Is there any guide to evaluate tflite NPU on local host?

1,174 Views
nnxxpp
Contributor IV

My question is same as title. 

tflite NPU has custom operator NeutronGraph, it is not supported in default tflite. Do you have any guide to inference NPU tflite on PC?

0 Kudos
Reply
4 Replies

1,161 Views
jamesbone
NXP TechSupport
NXP TechSupport

NXP offers  eIQ Toolkit .   You can see the tool in the following link:

https://www.nxp.com/design/design-center/software/eiq-ml-development-environment/eiq-toolkit-for-end...

0 Kudos
Reply

1,143 Views
nnxxpp
Contributor IV

@jamesbone 

Thanks. I am using it. But it seems that it allow only evaluate TensorFlow .h model. After that we convert to tflite and to NPU tflite. I don’t see the feature that allow me to evaluate NPU tflite on PC. If I am wrong, please correct me.

Do you release tensorflow lite with Neutrongraph custom operator supporting?

0 Kudos
Reply

1,042 Views
jamesbone
NXP TechSupport
NXP TechSupport

You are correct, there is not option to evaluate TFlite in PC,  our idea it is that you can test and evaluate your Model with Tensorflow and then convert it to Tflite to use it in the device.

0 Kudos
Reply

1,010 Views
nnxxpp
Contributor IV

@jamesbone 

I understood. Of course, I evaluated TensorFlow and Tflite model on PC.

I intend to evaluate NPU tflite model in PC by using NXP implementation of Neutrongraph from board. I am not sure whether it is worth.

0 Kudos
Reply