Using GPU on IMX-8qxp for CNN Inference

parag_jain — Thu, 18 Mar 2021 12:49:21 GMT

Context :

I would like to inference my CNN model on IMX-8qxp unit. As your website states, inference is supported on Vulkan GPU on IMX-8qxp through eIQ for ARM-NN & TF-Lite models(https://www.nxp.com/docs/en/fact-sheet/EIQ-FS.pdf )[Page-2] . Following are the related questions.

Questions :

1) IMX-8qxp has 1x4-shader Vulkan GPU. Can we access this GPU using latest eIQ package for CNN model inference?
2) If yes, would you please share some reference documents?
3) If GPU based CNN inference is supported, can we use eIQ as stand-alone module or does it BSP to be rebuilt?
4) GpuAcc flag in ARM-NN supports only Mali-based GPU. Can you please point me to a sample C++ testapp in which eIQ is used for inference on Vulkan GPU?

Re: Using GPU on IMX-8qxp for CNN Inference

Bio_TICFSL — Thu, 18 Mar 2021 14:30:18 GMT

Hello parag,

1. The MX8X has the GPU7000Lite but not have NPU. the eIQ that can access is on L5.4.70.

2. The eIQ documents are in your yocto relases.

3. Is in the L5.4.70 BSP

4. you can download the demos from https://github.com/NXPmicro/gtec-demo-framework

Regards

topic Re: Using GPU on IMX-8qxp for CNN Inference in i.MX Processors

Using GPU on IMX-8qxp for CNN Inference

Re: Using GPU on IMX-8qxp for CNN Inference