i.mx8mp NPU accelerated segmentation demo

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

i.mx8mp NPU accelerated segmentation demo

3,726 Views
fjpmbb_abc
Contributor I

We used Nvidia Jetson nano segmentation demo using SegNet and we are interested in the case using the Cityscapes dataset.

The model file should be included in the Jetson package.

https://github.com/dusty-nv/jetson-inference/blob/master/docs/segnet-console-2.md

Now we want to use NXP i.mx8mp for processor replacement,
1. Is is a similar real-time, NPU accelerated demo on the i.MX board, with camera stream as the input?
2. Is it feasible i.mx8mp runing the above segmentation demo code?

Thanks.

 

@xiaodong_zhang 

0 Kudos
12 Replies

3,291 Views
hiep_nguyen
Contributor III

Hi,

Just share a bit my experience, the i.MX 8MP NPU can run a segmentation model over 15 FPS with 720p image resolution.

Hope it motivates you to keep experimenting.

2,987 Views
at_akihito
Contributor I

@hiep_nguyen 

Hi.

I'm also trying to create a segmentation application that will run on a board with i.MX 8M Plus.
I'm generating segmentation TFLite models based on the existing TF SavedModel with conversion to TFLite, but they all only run at about 0.3 FPS.
Could you please tell me how to create a model that achieves 15 FPS at 720p?

Thanks.

0 Kudos

2,978 Views
xiaodong_zhang
NXP Employee
NXP Employee

@DevinJiao 

  Please have a look at the issue from @at_akihito .

0 Kudos

2,974 Views
DevinJiao
NXP Employee
NXP Employee

Sure. @at_akihito , can you share the model you used? Did you quantize it before you run it on NPU?

0 Kudos

2,915 Views
at_akihito
Contributor I

@DevinJiao 

I apologize for the delay in replying.

I have completed the model at a somewhat satisfactory speed, but another problem has arisen, so I will ask the question in another thread.

Thanks.

0 Kudos

3,710 Views
xiaodong_zhang
NXP Employee
NXP Employee

@fjpmbb_abc 

1. Is is a similar real-time, NPU accelerated demo on the i.MX board, with camera stream as the input?

Please refer to https://pyeiq.dev/ which supports camera.
2. Is it feasible i.mx8mp runing the above segmentation demo code?

The examples in eIQ don't include SegNet. But I found someone implemented it by Tensorflow. Customer can refer the below examples and convert TF model to TFlite which has deployed on i.MX8M Plus.

https://github.com/toimcio/SegNet-tensorflow

https://github.com/Keyird/TensorFlow2-Segmentation

 

 

3,703 Views
fjpmbb_abc
Contributor I

@xiaodong_zhang 

   Thanks for your reply. 

   With your suggestion, i installed the pyeiq in the imx8mp board. But i can't run the demos and apps which pyeiq mentioned "pyeiq --run xxxx"

 The board said there is no valid server to download the demos and apps.  Whether the demos and apps need special network connection for download.(such as can visit the google.com)

 

0 Kudos

3,697 Views
xiaodong_zhang
NXP Employee
NXP Employee
0 Kudos

3,690 Views
fjpmbb_abc
Contributor I

@xiaodong_zhang 

 

   After reading the eiq FAQ you mentioned, i don't know what is the problem in my side.

   my i.mx8mp can visit the internet well as attachment show. But can't run the " pyeiq --run xxxx" well, encounter the "no servers were avalible to download the data".

0 Kudos

3,684 Views
xiaodong_zhang
NXP Employee
NXP Employee

Hi @fjpmbb_abc 

    Check with owner of PyeIQ, server has some issue. He is working on fix it.

0 Kudos

3,675 Views
Bio_TICFSL
NXP TechSupport
NXP TechSupport

Good

 

0 Kudos

3,658 Views
fjpmbb_abc
Contributor I

@xiaodong_zhang 

@Bio_TICFSL 

It seems like the pyeiq server still can't access.

May i know when this issue will be solved? Thanks.

0 Kudos