Transformer networks on i.MX 8M Plus

[GeraldK]

Hello everyone,

NXP presented the i.MX 95 earlier this year and with it the new eIQ Neutron NPU. As mentioned on their page it supports transformer network architectures. So I am wondering, if this only holds to the neutron NPU. Or are transformers also possible on the NPU of the 8M+? Does anyone have knowldege about that?

IMX8MPLUS

[RizHsu]

I'm also interested in this. May I know if it's possible to run a transformer model on the i.MX 8M Plus?

Since we currently cannot purchase a i.MX95 EVK without joining the early access plan, so we would like to use the i.MX 8M for doing early evaluation on our ML solution.

[joanxie]

let me confirm it and tell you later

[jlamp]

Hi @joanxie I am also interested in running transformer models in the i.MX 8M Plus. Do you have any information?

Regards,

[joanxie]

Transformer networks are supported, however, the performance really depends upon the model architecture.

[jlamp]

Hi @joanxie can you tell me which transformer models are supported?

I am trying the Visual Transformers (ViT) and I am not able run them using NPU...

Regards!