2122841_en-US

[#1]

BSP Version Required for dm-eiq-genai-flow-demonstrator on i.MX95

Hi Team,

I’m exploring the dm-eiq-genai-flow-demonstrator (GenAI Flow) on the i.MX95 platform working within a Yocto environment. Could you please clarify:

     1. Which BSP version (e.g., L6.12.20_2.0.0) is minimum required to run the demo end-to-end?

    2. Does this BSP include all necessary elements—such as updated Neutron delegate, TFLite  runtime, and tooling—to support LLM inference (RAG)?

    3. Are there any additional Yocto meta-layers or image recipes (for example meta-eiq-        genai) recommended for this demo?

Thanks in advance for your insights!

Best regards,
Varshil Gandhi

Re: BSP Version Required for dm-eiq-genai-flow-demonstrator on i.MX95

Hi Varshil,
Thanks for your questions.
Let me try to answer them:
1. The package was initially made for Q1 BSP L6.12.3-1.0.0 for i.MX95 rev Ax.
2. This Q1 BSP does not directly include what's necessary to leverage Neutron on LLM inferences. That's why the package provides a meta-layer.
3. This meta-eiq-genai-flow meta-layer provides the possibility to add a Onnxruntime Neutron Execution Provider to accelerate the LLM operations on Neutron and free up some CPU resources, with associated patches/files for Kernel and Neutron Fw. Please note that we are using onnxruntime and not TF lite for this project.

That being said, Q2 BSP (e.g., L6.12.20_2.0.0) is being released this days. It supports the B0 revision of i.MX95 but without LLM acceleration on Neutron, only CPU mode is functional.

Thanks and best regards,

Pierre