How to use ovxlib or NPU

cancel
Showing results for 
Search instead for 
Did you mean: 

How to use ovxlib or NPU

Jump to solution
926 Views
weilly_li
Contributor IV

Hi,

     Recently, I find a code as "VSI_NN_LOG_LEVEL" from PyeIQ using NPU . So I tracked to ovxlib and openvx . but I don't know how to use it ,please help me get some document and information!! 

I appreciate your help very much.

 

Weilly

0 Kudos
1 Solution
697 Views
joanxie
NXP TechSupport
NXP TechSupport

don't such document besides the machine learning user guide I sent to you


OVXLIB and OpenVX driver integrated with NXP
GPU driver package
− Provides low-level calls to NPU hardware
− Implemented as OpenCL kernels for GPUs of i.MX
8M, 8M Nano and 8QuadXPlus
− i.MX 8QuadMax OpenVX hardware extension
accelerates OpenVX instructions and has a significant
performance advantage over running on shader core

for imx8mp:

openvx hardware extension is available in the i.MX8MP NPU, which means that OpenVX hardware acceleration is performed on the NPU, not on the GPU

so for gpu or npu demo module, you can find the test demo in the bsp , for imx8mp demo, which is still internal use, I couldn't share with outside customer

 

View solution in original post

0 Kudos
9 Replies
885 Views
weilly_li
Contributor IV

Hi, Joanxie

     It is running PyeIQ DEMO on  i.MX8M Plus (NPU)  or   i.MX8QM (GPU) .

     Thank you

0 Kudos
877 Views
joanxie
NXP TechSupport
NXP TechSupport
0 Kudos
867 Views
weilly_li
Contributor IV

Hi, Joanxie

    Thank You tell me about ISP & OpenVX information,  But it's not My need.

    I want to know "HOW to use ovxlib on NPU/GPU" , or any related document .

    Example 1 : enable inference engine
                       VSI_NN_LOG_LEVEL=0 {bin} -m {model} -t 1 -i {Image} -l {label} -a 1 -v 0 -c 100

     Example 2 : Using Ovxlib  library

                         vsi_nn_VerifyGraph,  vsi_nn_AddNode etc....

 

   Or... How to get VX/vx_ext_program.h 

   like this link :OpenVX Vision Image Extension API Introduction - Basic API

 

   Thank your help so much

0 Kudos
848 Views
joanxie
NXP TechSupport
NXP TechSupport

pls refer to the enclosed file, hope helpful for you

 

0 Kudos
831 Views
weilly_li
Contributor IV

Hi, joanxie

     thank your help , this document taught me some operations with NPU/GPU  (at Appendix A &B),

     but it's not about "ovxlib" or "VSI_NN_LOG_LEVEL" using way...

     I appreciate your help very much.

0 Kudos
900 Views
joanxie
NXP TechSupport
NXP TechSupport

what board are you talking about?

0 Kudos
735 Views
weilly_li
Contributor IV

My board is i.MX8MPlus and i.MX8QM. 

The problem's not find the tutorials documen yet, thank your help !!

 

0 Kudos
698 Views
joanxie
NXP TechSupport
NXP TechSupport

don't such document besides the machine learning user guide I sent to you


OVXLIB and OpenVX driver integrated with NXP
GPU driver package
− Provides low-level calls to NPU hardware
− Implemented as OpenCL kernels for GPUs of i.MX
8M, 8M Nano and 8QuadXPlus
− i.MX 8QuadMax OpenVX hardware extension
accelerates OpenVX instructions and has a significant
performance advantage over running on shader core

for imx8mp:

openvx hardware extension is available in the i.MX8MP NPU, which means that OpenVX hardware acceleration is performed on the NPU, not on the GPU

so for gpu or npu demo module, you can find the test demo in the bsp , for imx8mp demo, which is still internal use, I couldn't share with outside customer

 

View solution in original post

0 Kudos
363 Views
arno_0
Contributor III

I would like to use NPU of imx8mp. At the moment I am on a 5.10 mainline kernel, but it seems that I need parts of NXP kernel for accessing the NPU. From the other post it seems like that gpu-viv is needed (and its part of devicetree). Is this right - even if computation is not done on GPU but NPU? At least I don't find a dedicated NPU kernel driver. Can you advise?

0 Kudos