Is there any guide to evaluate tflite NPU on local host?

キャンセル
次の結果を表示 
表示  限定  | 次の代わりに検索 
もしかして: 

Is there any guide to evaluate tflite NPU on local host?

1,168件の閲覧回数
nnxxpp
Contributor IV

My question is same as title. 

tflite NPU has custom operator NeutronGraph, it is not supported in default tflite. Do you have any guide to inference NPU tflite on PC?

0 件の賞賛
返信
4 返答(返信)

1,155件の閲覧回数
jamesbone
NXP TechSupport
NXP TechSupport

NXP offers  eIQ Toolkit .   You can see the tool in the following link:

https://www.nxp.com/design/design-center/software/eiq-ml-development-environment/eiq-toolkit-for-end...

0 件の賞賛
返信

1,137件の閲覧回数
nnxxpp
Contributor IV

@jamesbone 

Thanks. I am using it. But it seems that it allow only evaluate TensorFlow .h model. After that we convert to tflite and to NPU tflite. I don’t see the feature that allow me to evaluate NPU tflite on PC. If I am wrong, please correct me.

Do you release tensorflow lite with Neutrongraph custom operator supporting?

0 件の賞賛
返信

1,036件の閲覧回数
jamesbone
NXP TechSupport
NXP TechSupport

You are correct, there is not option to evaluate TFlite in PC,  our idea it is that you can test and evaluate your Model with Tensorflow and then convert it to Tflite to use it in the device.

0 件の賞賛
返信

1,004件の閲覧回数
nnxxpp
Contributor IV

@jamesbone 

I understood. Of course, I evaluated TensorFlow and Tflite model on PC.

I intend to evaluate NPU tflite model in PC by using NXP implementation of Neutrongraph from board. I am not sure whether it is worth.

0 件の賞賛
返信