https://community.nxp.com/t5/i-MX-Processors/How-to-Use-Neutron-Execution-Provider-with-ONNXRT/m-p/2030330#M233114 <P><SPAN>Hello<BR /><BR />While reading the </SPAN><EM>GEN-AI-RAG-WHITEPAPER.pdf</EM><SPAN> provided by NXP, I found that the TinyLlama-1B quantized model was ported to the i.MX95 device using the Neutron Execution Provider within ONNXRT runtime.</SPAN></P><P>I have a few questions regarding this:</P><OL><LI>Does ONNXRT refer to <EM>onnxruntime</EM>?</LI><LI>I would like to try using the Neutron Execution Provider with ONNXRT as well. Could you provide guidance on how to set up the environment for this?Additionally, how can I apply it in the code?</LI></OL><P>A detailed explanation would be greatly appreciated. Thank you in advance for your support! <LI-EMOJI id="lia_smiling-face-with-smiling-eyes" title=":smiling_face_with_smiling_eyes:"></LI-EMOJI></P> Mon, 20 Jan 2025 06:24:43 GMT NXP_imx93evk_user 2025-01-20T06:24:43Z https://community.nxp.com/t5/i-MX-Processors/How-to-Use-Neutron-Execution-Provider-with-ONNXRT/m-p/2030330#M233114 <P><SPAN>Hello<BR /><BR />While reading the </SPAN><EM>GEN-AI-RAG-WHITEPAPER.pdf</EM><SPAN> provided by NXP, I found that the TinyLlama-1B quantized model was ported to the i.MX95 device using the Neutron Execution Provider within ONNXRT runtime.</SPAN></P><P>I have a few questions regarding this:</P><OL><LI>Does ONNXRT refer to <EM>onnxruntime</EM>?</LI><LI>I would like to try using the Neutron Execution Provider with ONNXRT as well. Could you provide guidance on how to set up the environment for this?Additionally, how can I apply it in the code?</LI></OL><P>A detailed explanation would be greatly appreciated. Thank you in advance for your support! <LI-EMOJI id="lia_smiling-face-with-smiling-eyes" title=":smiling_face_with_smiling_eyes:"></LI-EMOJI></P> Mon, 20 Jan 2025 06:24:43 GMT https://community.nxp.com/t5/i-MX-Processors/How-to-Use-Neutron-Execution-Provider-with-ONNXRT/m-p/2030330#M233114 NXP_imx93evk_user 2025-01-20T06:24:43Z https://community.nxp.com/t5/i-MX-Processors/How-to-Use-Neutron-Execution-Provider-with-ONNXRT/m-p/2030930#M233155 <P>Hello,<BR /><BR />There is no public information available to explain this process, so please wait for the eIQ tool and BSP to be officially released.<BR /><BR />Best Regards,<BR />Zhiming</P> Tue, 21 Jan 2025 00:48:10 GMT https://community.nxp.com/t5/i-MX-Processors/How-to-Use-Neutron-Execution-Provider-with-ONNXRT/m-p/2030930#M233155 Zhiming_Liu 2025-01-21T00:48:10Z