topic How to deploy and run YOLOv5 trained model on imx8mplus? in i.MX Processors

How to deploy and run YOLOv5 trained model on imx8mplus?

vivek338 — Fri, 21 Feb 2025 04:42:04 GMT

Hi,

Iam working on imx8mplus yocto project. I have trained object detection model on YOLOv5 on custom dataset. Its working fine on ubuntu pc. Now I want to run that model on my imx8mplus board. I convert the model in yo tflite and try to run the model on tensorflow script but its not working.

How can I run YOLOv5 model on imx8mplus?

Is any other way to run any other object detection model on imx8mplus that support for faster framerate and easy to interface? Also I need to train that model on my custom dataset.

Thanks in advance!!

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

Zhiming_Liu — Tue, 25 Feb 2025 03:06:14 GMT

Hello,
Please refer the doc i shared.

Best Regards,
Zhiming

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

adarshkv — Tue, 25 Feb 2025 04:56:36 GMT

Hi ,
Could you please share the document for deploying yolo models on imx8mp.

Thank you,
Adarsh

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

vivek338 — Tue, 25 Feb 2025 12:05:43 GMT

Hi,
Thanks for replying!
Now I have successfully converted yolov5 to tflite model and tested becnchmark on npu as well following the document you have sent. But now I need example code in python to test live object detection on camera.

Thanks in advance !

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

Zhiming_Liu — Wed, 26 Feb 2025 01:17:15 GMT

Hello,

The video pipeline is using gstreamer in the document. Please refer official detect code: https://github.com/ultralytics/yolov5/blob/master/detect.py

Best Regards,
Zhiming

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

vivek338 — Fri, 28 Feb 2025 07:21:57 GMT

Hi,
Thanks for replying!
Iam unable to open link in document:-
https://community.nxp.com/t5/iMX-and-Vybrid-Support/Steps-to-deploy-yolov5s-on-i-MX8MP/ta-p/1410740

Getting Access Denied.

Please help !

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

Zhiming_Liu — Thu, 06 Mar 2025 00:33:46 GMT

Hello,

This is not a public group.

Best Regards,
Zhiming

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

vivek338 — Thu, 06 Mar 2025 08:08:00 GMT

Hi @Zhiming_Liu ,

I have somehow manage to run yolov5s model on board including gpu using tensorflow lite python api, but its too slow and its too difficult to run as compare to yolo.

My question is that, any library or api is available like ultarlytics(yolo) for tensorflow lite for detection in python. Like:-

python3 detect.py --weights yolov5s.pt --source 0 --device 0 --conf 0.5

Or I have to learn python and machine learning using tensorflow from scratch?

Please help !!

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

Zhiming_Liu — Wed, 12 Mar 2025 03:16:21 GMT

Hello,

You may need add NPU delegate support in your python script, please refer here.

https://community.nxp.com/t5/i-MX-Processors/Request-Updated-NPU-Code-for-movenet-tflite-for-imx8mp/m-p/2058790#M234869

Best Regards,
Zhiming

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

vivek338 — Thu, 27 Mar 2025 11:41:15 GMT

What are these parametrs and how to modify according to pixel size.

gst-launch-1.0 --no-position v4l2src device=/dev/video3 ! \
video/x-raw,width=640,height=480,framerate=30/1! \
tee name=t t. ! queue max-size-buffers=2 leaky=2 ! \
imxvideoconvert_g2d ! video/x-raw,width=256,height=256,format=RGBA ! \
videoconvert ! video/x-raw,format=RGB ! \
tensor_converter ! \
tensor_filter framework=tensorflow-lite model=yolov5s_quant_256.tflite \
custom=Delegate:External,ExtDelegateLib:libvx_delegate.so ! \
tensor_decoder mode=bounding_boxes option1=yolov5 option2=coco_label.txt \
option4=640:480 option5=256:256 ! \
mix. t. ! queue max-size-buffers=2 ! \
imxcompositor_g2d name=mix sink_0::zorder=2 sink_1::zorder=1 ! waylandsink

What to give option2=coco_label.txt. And what are the changes done to run model at 26-30fps? or what is the best parameter to run like pixel size, yolov5 model(small,medium,nano), number of images to train, epochs.

I want to run like nxp-demo object detection example but on custom data set.

Re: How to deploy and run YOLOv5 trained model on imx8mplus?

Zhiming_Liu — Tue, 01 Apr 2025 05:00:19 GMT

Hello,

Please use int8/uint8 for input/output data type, this should enhance the performance.

Best Regards,
Zhiming