question regarding npu profiling tools

取消
显示结果 
显示  仅  | 搜索替代 
您的意思是: 
已解决

question regarding npu profiling tools

跳至解决方案
1,371 次查看
astel_
Contributor II

Hello

Right now I am curious on how the NPU profiling tools works. Is it possible to profile 2 or more models at the same time when we run a code where we use 2 or more models? if it is possible, what will the log looks like?

also is it only limited to libvx_delegate.so only? or can we get the same profiler result if we run a code where it run using opencv cv::dnn::DNN_BACKEND_TIMVX?

Thank you

0 项奖励
回复
1 解答
1,349 次查看
Bio_TICFSL
NXP TechSupport
NXP TechSupport

Hello,

No is not possible to profile two or more models in NPU and only is limited to libvx_delegate.

 

Regards

在原帖中查看解决方案

0 项奖励
回复
2 回复数
1,350 次查看
Bio_TICFSL
NXP TechSupport
NXP TechSupport

Hello,

No is not possible to profile two or more models in NPU and only is limited to libvx_delegate.

 

Regards

0 项奖励
回复
1,336 次查看
astel_
Contributor II

thank you for your reply

also can i ask, if imx support the cv::dnn::DNN_BACKEND_TIMVX and cv::dnn::DNN_TARGET_NPU to run inference in npu?

bc i just read that opencv zoo model have this integration (link)

0 项奖励
回复
%3CLINGO-SUB%20id%3D%22lingo-sub-1965483%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%E5%85%B3%E4%BA%8E%20NPU%20%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7%E7%9A%84%E9%97%AE%E9%A2%98%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1965483%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3E%E4%BD%A0%E5%A5%BD%3CBR%20%2F%3E%3CBR%20%2F%3E%E7%8E%B0%E5%9C%A8%E6%88%91%E5%BE%88%E5%A5%BD%E5%A5%87%20NPU%20%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7%E6%98%AF%E5%A6%82%E4%BD%95%E5%B7%A5%E4%BD%9C%E7%9A%84%E3%80%82%E5%BD%93%E6%88%91%E4%BB%AC%E8%BF%90%E8%A1%8C%E4%BD%BF%E7%94%A8%202%20%E4%B8%AA%E6%88%96%E6%9B%B4%E5%A4%9A%E6%A8%A1%E5%9E%8B%E7%9A%84%E4%BB%A3%E7%A0%81%E6%97%B6%EF%BC%8C%E6%98%AF%E5%90%A6%E5%8F%AF%E4%BB%A5%E5%90%8C%E6%97%B6%E5%88%86%E6%9E%90%202%20%E4%B8%AA%E6%88%96%E6%9B%B4%E5%A4%9A%E6%A8%A1%E5%9E%8B%EF%BC%9F%E5%A6%82%E6%9E%9C%E5%8F%AF%E8%83%BD%E7%9A%84%E8%AF%9D%EF%BC%8C%E6%97%A5%E5%BF%97%E4%BC%9A%E6%98%AF%E4%BB%80%E4%B9%88%E6%A0%B7%E5%AD%90%EF%BC%9F%3CBR%20%2F%3E%3CBR%20%2F%3E%E5%8F%A6%E5%A4%96%EF%BC%8C%E5%AE%83%E6%98%AF%E5%90%A6%E4%BB%85%E9%99%90%E4%BA%8E%20libvx_delegate.so%EF%BC%9F%E6%88%96%E8%80%85%EF%BC%8C%E5%A6%82%E6%9E%9C%E6%88%91%E4%BB%AC%E8%BF%90%E8%A1%8C%E4%BD%BF%E7%94%A8%20opencv%20cv%3A%3Adnn%3A%3ADNN_BACKEND_TIMVX%20%E8%BF%90%E8%A1%8C%E7%9A%84%E4%BB%A3%E7%A0%81%EF%BC%8C%E6%88%91%E4%BB%AC%E8%83%BD%E5%BE%97%E5%88%B0%E7%9B%B8%E5%90%8C%E7%9A%84%E5%88%86%E6%9E%90%E5%99%A8%E7%BB%93%E6%9E%9C%E5%90%97%EF%BC%9F%3CBR%20%2F%3E%3CBR%20%2F%3E%E8%B0%A2%E8%B0%A2%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1965483%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CLINGO-LABEL%3Ei.MX%208%20%E7%B3%BB%E5%88%97%20%7C%20i.MX%208QuadMax%20(8QM)%20%7C%208QuadPlus%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1966043%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%E5%9B%9E%E5%A4%8D%EF%BC%9A%E5%85%B3%E4%BA%8E%20NPU%20%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7%E7%9A%84%E9%97%AE%E9%A2%98%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1966043%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3E%E6%84%9F%E8%B0%A2%E4%BD%A0%E7%9A%84%E5%9B%9E%E5%A4%8D%3CBR%20%2F%3E%3CBR%20%2F%3E%E5%8F%A6%E5%A4%96%E6%88%91%E5%8F%AF%E4%BB%A5%E9%97%AE%E4%B8%80%E4%B8%8B%EF%BC%8Cimx%20%E6%98%AF%E5%90%A6%E6%94%AF%E6%8C%81%20cv%3A%3Adnn%3A%3ADNN_BACKEND_TIMVX%20%E5%92%8C%20cv%3A%3Adnn%3A%3ADNN_TARGET_NPU%20%E5%9C%A8%20npu%20%E4%B8%AD%E8%BF%90%E8%A1%8C%E6%8E%A8%E7%90%86%EF%BC%9F%3CBR%20%2F%3E%3CBR%20%2F%3E%E5%9B%A0%E4%B8%BA%E6%88%91%E5%88%9A%E5%88%9A%E8%AF%BB%E5%88%B0%20opencv%20zoo%20%E6%A8%A1%E5%9E%8B%E6%9C%89%E8%BF%99%E7%A7%8D%E9%9B%86%E6%88%90%EF%BC%88%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fopencv%2Fopencv%2Fwiki%2FTIM-VX-Backend-For-Running-OpenCV-On-NPU%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3E%E9%93%BE%E6%8E%A5%3C%2FA%3E%EF%BC%89%3C%2FP%3E%3C%2FLINGO-BODY%3E