nnapi enabled tflite on i.mx8m nano results negative performance gain

[Zack_Mak]

Hi,

I am testing the imx8mnddr4evk for tflite GPU acceleration.

As I know the i.MX8 nano uses NNAPI for GPU acceleration in tflite. However, in my test setup, the tflite shows negative performance gain when nnapi is enabled for tflite.

I also get the same observation when I run the tflite sample program (label_image) in NXP stock FW images.

The attached log file shows the sample code results from stock FW image version L5.4.47-2.2.0 imx-image-full-imx8mnevk. I ran the sample program right after flashing the FW image without any modifications.

Would you please verify my finding and advise if I have miss something?

Thank you very much.

[joanxie]

refer to your log file, when disable nnapi:

0.780392: 653 military uniform

enalbe nnapi:

0.784314: 653 military uniform

Python code, NNAPI enabled:

0.670588: military uniform

it seems the performance improved when you enable NNAPI, what negative performance do you mean?