M.2 Custom AI Hat board

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

M.2 Custom AI Hat board

341 Views
Mustafa07
Contributor I

Good morning All, Hope you are doing well.

i have an idea and i want to know if it is applicable or if i will face problems, And i need your recommendations.

currently i am buying NXP I.MX8QM MEK board, and my project idea is to use local LLM on the board, For that i will need AI accelerator.

my current setup is using RPI5 and AI Hat +2 and i want to level up the project so i will use NXP i.mx8QM board, And i want to use the AI Hat +2 with the NXP board

the AI Hat +2 is Hailo-10 H AI acceleration module and it is interfaced with pcie fpc 16 way connector as follows its signal is standard PCIe signals

The following Image shows it.

Mustafa07_1-1779749448515.pngMustafa07_1-1779749448515.png

So i want to use it with the NXP board and i thought to create a custom M.2 Card that just routes the PCIe signals from the Hat to the M.2 like the following image.

this is just a simple example of the board as a explanation.

Mustafa07_0-1779749224507.pngMustafa07_0-1779749224507.png

so my question, Is what i am thinking of is applicable or there is something i didn't take care of it?
also if this is applicable do i need a special driver or the linux driver of the hat is enough?

 

 your answer will help me a lot and thank you in advance.

 

0 Kudos
Reply
0 Replies
%3CLINGO-SUB%20id%3D%22lingo-sub-2370933%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3EM.2%20Custom%20AI%20Hat%20board%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2370933%22%20slang%3D%22en-US%22%20mode%3D%22CREATE%22%3E%3CP%3EGood%20morning%20All%2C%20Hope%20you%20are%20doing%20well.%3C%2FP%3E%3CP%3Ei%20have%20an%20idea%20and%20i%20want%20to%20know%20if%20it%20is%20applicable%20or%20if%20i%20will%20face%20problems%2C%20And%20i%20need%20your%20recommendations.%3C%2FP%3E%3CP%3Ecurrently%20i%20am%20buying%20NXP%20I.MX8QM%20MEK%20board%2C%20and%20my%20project%20idea%20is%20to%20use%20local%20LLM%20on%20the%20board%2C%20For%20that%20i%20will%20need%20AI%20accelerator.%3C%2FP%3E%3CP%3Emy%20current%20setup%20is%20using%20RPI5%20and%20AI%20Hat%20%2B2%20and%20i%20want%20to%20level%20up%20the%20project%20so%20i%20will%20use%20NXP%20i.mx8QM%20board%2C%20And%20i%20want%20to%20use%20the%20AI%20Hat%20%2B2%20with%20the%20NXP%20board%3C%2FP%3E%3CP%3Ethe%20AI%20Hat%20%2B2%20is%20Hailo-10%20H%20AI%20acceleration%20module%20and%20it%20is%20interfaced%20with%20pcie%20fpc%2016%20way%20connector%20as%20follows%20its%20signal%20is%20standard%20PCIe%20signals%3C%2FP%3E%3CP%3EThe%20following%20Image%20shows%20it.%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22Mustafa07_1-1779749448515.png%22%20style%3D%22width%3A%20356px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22Mustafa07_1-1779749448515.png%22%20style%3D%22width%3A%20356px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F386738iF41265E0897071C6%2Fimage-dimensions%2F356x356%3Fv%3Dv2%22%20width%3D%22356%22%20height%3D%22356%22%20role%3D%22button%22%20title%3D%22Mustafa07_1-1779749448515.png%22%20alt%3D%22Mustafa07_1-1779749448515.png%22%20%2F%3E%3Cspan%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3EMustafa07_1-1779749448515.png%3C%2Fspan%3E%3C%2Fspan%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3ESo%20i%20want%20to%20use%20it%20with%20the%20NXP%20board%20and%20i%20thought%20to%20create%20a%20custom%20M.2%20Card%20that%20just%20routes%20the%20PCIe%20signals%20from%20the%20Hat%20to%20the%20M.2%20like%20the%20following%20image.%3C%2FP%3E%3CP%3Ethis%20is%20just%20a%20simple%20example%20of%20the%20board%20as%20a%20explanation.%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22Mustafa07_0-1779749224507.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22Mustafa07_0-1779749224507.png%22%20style%3D%22width%3A%20385px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F386737iB594AD8AC1659E36%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22Mustafa07_0-1779749224507.png%22%20alt%3D%22Mustafa07_0-1779749224507.png%22%20%2F%3E%3Cspan%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3EMustafa07_0-1779749224507.png%3C%2Fspan%3E%3C%2Fspan%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3Eso%20my%20question%2C%20Is%20what%20i%20am%20thinking%20of%20is%20applicable%20or%20there%20is%20something%20i%20didn't%20take%20care%20of%20it%3F%3CBR%20%2F%3Ealso%20if%20this%20is%20applicable%20do%20i%20need%20a%20special%20driver%20or%20the%20linux%20driver%20of%20the%20hat%20is%20enough%3F%3C%2FP%3E%3CBR%20%2F%3E%3CP%3E%26nbsp%3Byour%20answer%20will%20help%20me%20a%20lot%20and%20thank%20you%20in%20advance.%3C%2FP%3E%3CBR%20%2F%3E%3C%2FLINGO-BODY%3E