question regarding npu profiling tools

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

question regarding npu profiling tools

Jump to solution
1,152 Views
astel_
Contributor II

Hello

Right now I am curious on how the NPU profiling tools works. Is it possible to profile 2 or more models at the same time when we run a code where we use 2 or more models? if it is possible, what will the log looks like?

also is it only limited to libvx_delegate.so only? or can we get the same profiler result if we run a code where it run using opencv cv::dnn::DNN_BACKEND_TIMVX?

Thank you

0 Kudos
Reply
1 Solution
1,130 Views
Bio_TICFSL
NXP TechSupport
NXP TechSupport

Hello,

No is not possible to profile two or more models in NPU and only is limited to libvx_delegate.

 

Regards

View solution in original post

0 Kudos
Reply
2 Replies
1,131 Views
Bio_TICFSL
NXP TechSupport
NXP TechSupport

Hello,

No is not possible to profile two or more models in NPU and only is limited to libvx_delegate.

 

Regards

0 Kudos
Reply
1,117 Views
astel_
Contributor II

thank you for your reply

also can i ask, if imx support the cv::dnn::DNN_BACKEND_TIMVX and cv::dnn::DNN_TARGET_NPU to run inference in npu?

bc i just read that opencv zoo model have this integration (link)

0 Kudos
Reply
%3CLINGO-SUB%20id%3D%22lingo-sub-1965483%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3Equestion%20regarding%20npu%20profiling%20tools%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1965483%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3EHello%3CBR%20%2F%3E%3CBR%20%2F%3ERight%20now%20I%20am%20curious%20on%20how%20the%20NPU%20profiling%20tools%20works.%20Is%20it%20possible%20to%20profile%202%20or%20more%20models%20at%20the%20same%20time%20when%20we%20run%20a%20code%20where%20we%20use%202%20or%20more%20models%3F%20if%20it%20is%20possible%2C%20what%20will%20the%20log%20looks%20like%3F%3CBR%20%2F%3E%3CBR%20%2F%3Ealso%20is%20it%20only%20limited%20to%20libvx_delegate.so%20only%3F%20or%20can%20we%20get%20the%20same%20profiler%20result%20if%20we%20run%20a%20code%20where%20it%20run%20using%20opencv%20cv%3A%3Adnn%3A%3ADNN_BACKEND_TIMVX%3F%3CBR%20%2F%3E%3CBR%20%2F%3EThank%20you%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1965483%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CLINGO-LABEL%3Ei.MX%208%20Family%20%7C%20i.MX%208QuadMax%20(8QM)%20%7C%208QuadPlus%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1966043%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3ERe%3A%20question%20regarding%20npu%20profiling%20tools%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1966043%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3Ethank%20you%20for%20your%20reply%3CBR%20%2F%3E%3CBR%20%2F%3Ealso%20can%20i%20ask%2C%20if%20imx%20support%20the%26nbsp%3Bcv%3A%3Adnn%3A%3ADNN_BACKEND_TIMVX%20and%26nbsp%3Bcv%3A%3Adnn%3A%3ADNN_TARGET_NPU%20to%20run%20inference%20in%20npu%3F%3CBR%20%2F%3E%3CBR%20%2F%3Ebc%20i%20just%20read%20that%20opencv%20zoo%20model%20have%20this%20integration%20(%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fopencv%2Fopencv%2Fwiki%2FTIM-VX-Backend-For-Running-OpenCV-On-NPU%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Elink%3C%2FA%3E)%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1965710%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3ERe%3A%20question%20regarding%20npu%20profiling%20tools%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1965710%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3EHello%2C%3C%2FP%3E%0A%3CP%3ENo%20is%20not%20possible%20to%20profile%20two%20or%20more%20models%20in%20NPU%20and%20only%20is%20limited%20to%20libvx_delegate.%3C%2FP%3E%0A%3CBR%20%2F%3E%0A%3CP%3ERegards%3C%2FP%3E%3C%2FLINGO-BODY%3E