IMX 8M Plus, Not able to run inference on NPU.

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

IMX 8M Plus, Not able to run inference on NPU.

472 Views
kandarp_rastey
Contributor II

IMX 8M Plus, Not able to run inference on NPU.

Platform = CL-SOM-iMX8Plus

Linux Kernel Release = 5.10.72+gce60d3fa56c9

Using tflite_runtime on python3 to run an inference pipeline on the npu, the pipeline consists of two models (Object Detection + Classifier). Here I'm able to make an Object Detection interpreter with experimental_delegates=libvx_delegate, but when i try to use the same delegate for the Classifier and try to run the inference I get this error:

 

 

Traceback (most recent call last):
  File "/home/root/.../.../tflite_detection_live.py", line 132, in <module>
    main()
  File "/home/root/.../.../tflite_detection_live.py", line 110, in main
    c_interpreter.invoke()
  File "/usr/lib/python3.9/site-packages/tflite_runtime/interpreter.py", line 875, in invoke
    self._interpreter.Invoke()
RuntimeError: Node number 66 (Vx Delegate) failed to invoke.

 

 

NOTE: The same pipeline runs just fine on the CPU.

 

Please help resolve this and help run the inference pipeline in such a way that both inferences (Object Detection + Classifier) run on the NPU.

 

Let me know if you need any more details.

 

0 Kudos
Reply
1 Reply

448 Views
Bio_TICFSL
NXP TechSupport
NXP TechSupport

Hello,

Please try it on 5.15.52BSP that VX delegate works nicelly in this version.

regards

0 Kudos
Reply