Add a yet another NIC on the lx2160

[SysManOne]

Hello!

I have lx2160a there is onboard NI I have used by running DPDK app.  and use only 

dpdk-extras/dpaa2/dynamic_dpl.sh dpmac.10 dpmac.9 dpmac.8 dpmac.7 dpmac.6 dpmac.5 ...

As a result I see a number of dpni.X devices ...

Now I insert a yet another network card on board (it's MT26448 ) and just is puzzled how to make  ports of the card available for DPDK ? 

Is there simple procedure step-by-step to do this ?

PS:On intel I use dpdk-devbind ... but on the LX this cannot be used.

[SysManOne]

Hello!

Is there any who can me help to resolve a problem ?

This is not QEMU or any other HyperVisor related problem. I running DPDK apps on the NXP ls2160a.

Is the adding discrete NIC is supported in the NXP at all ?

[khushbur]

Hi @SysManOne 

Please refer below link to set up device using dpdk scripts.

https://docs.nxp.com/bundle/GUID-1441E561-3EAD-47FD-A50D-72E1A4E4D69E/page/GUID-B305DA25-E082-4C6A-B...

https://docs.nxp.com/bundle/GUID-1441E561-3EAD-47FD-A50D-72E1A4E4D69E/page/GUID-12DDB143-ACC5-4752-8...

Thanks

Khushbu

Thanks

Khushbu

[SysManOne]

Hi !

Thanks for the answer.

#./dpdk-extras/dpaa2/dynamic_dpl.sh dpmac.10 dpmac.9 dpmac.8 dpmac.7
# ${HOME}/dpdk-extras/dpaa2/dynamic_dpl.sh dpmac.10 dpmac.9 dpmac.8 dpmac.7
${HOME}/dpdk-extras/dpaa2/dynamic_dpl.sh dpmac.10 dpmac.9 dpmac.8 dpmac.7 dpmac.6 dpmac.5 dpmac.4
++ /root/dpdk-extras/dpaa2/dynamic_dpl.sh dpmac.10 dpmac.9 dpmac.8 dpmac.7 dpmac.6 dpmac.5 dpmac.4
Using board type as 2160
Using High Performance Buffers
mkdir: cannot create directory ‘/mnt/hugepages’: File exists

##################### Container dprc.2 is created ####################

Container dprc.2 have following resources :=>

* 16 DPBP
* 8 DPCON
* 8 DPSECI
* 7 DPNI
* 24 DPIO
* 2 DPCI

######################### Configured Interfaces #########################

Interface Name Endpoint Mac Address
============== ======== ==================
dpni.1 dpmac.10 00:00:00:00:0:10
dpni.2 dpmac.9 00:00:00:00:0:9
dpni.3 dpmac.8 00:00:00:00:0:8
dpni.4 dpmac.7 00:00:00:00:0:7
dpni.5 dpmac.6 00:00:00:00:0:6
dpni.6 dpmac.5 00:00:00:00:0:5
dpni.7 dpmac.4 00:00:00:00:0:4

export DPRC=dprc.2
++ export DPRC=dprc.2
++ DPRC=dprc.2

root@TTR:~/Works/tootoo2# dpdk-devbind.py -s

Network devices using kernel driver
===================================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' if=enP1p1s0,enP1p1s0d1 drv=mlx4_core unused=vfio-pci,uio_pci_generic

root@TTR:~/Works/tootoo2# dpdk-devbind.py -b uio_pci_generic 0001:01:00.0
Error: bind failed for 0001:01:00.0 - Cannot bind to driver uio_pci_generic: [Errno 19] No such device
Error: unbind failed for 0001:01:00.0 - Cannot open /sys/bus/pci/drivers//unbind: [Errno 13] Permission denied: '/sys/bus/pci/drivers//unbind'

root@TTR:~/Works/tootoo2# dpdk-devbind.py -s

Other Network devices
=====================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' unused=mlx4_core,vfio-pci,uio_pci_generic

What i did wrong ?

[khushbur]

Hi @SysManOne 

Can you please share output of below command?

dpdk-devbind.py -s

Thanks

Khushbu

[SysManOne]

Hi @khushbur !

1 - root@TTR:~/Works/tootoo2# dpdk-devbind.py -s

Network devices using kernel driver
===================================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' if=enP1p1s0,enP1p1s0d1 drv=mlx4_core unused=vfio-pci,uio_pci_generic

2 - root@TTR:~/Works/tootoo2# dpdk-devbind.py -b uio_pci_generic 0001:01:00.0
Error: bind failed for 0001:01:00.0 - Cannot bind to driver uio_pci_generic: [Errno 19] No such device
Error: unbind failed for 0001:01:00.0 - Cannot open /sys/bus/pci/drivers//unbind: [Errno 13] Permission denied: '/sys/bus/pci/drivers//unbind'

3 - root@TTR:~/Works/tootoo2# dpdk-devbind.py -s

Other Network devices
=====================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' unused=mlx4_core,vfio-pci,uio_pci_generic

[khushbur]

Hi @SysManOne 

Can you please run below command and try binding device after that.

dpdk-devbind.py -b none 0001:01:00.0

Thanks

Khushbu

[SysManOne]

Hi @khushbur !

root@TTR:~# dpdk-devbind.py -s

Other Network devices
=====================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' unused=mlx4_core,vfio-pci,uio_pci_generic

root@TTR:~# dpdk-devbind.py -b none 0001:01:00.0
Notice: 0001:01:00.0 MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] is not currently managed by any driver

root@TTR:~# dpdk-devbind.py -b uio_pci_generic 0001:01:00.0
Error: bind failed for 0001:01:00.0 - Cannot bind to driver uio_pci_generic: [Errno 19] No such device

[khushbur]

Hi @SysManOne 

Can you please try to bind it to another driver eg. mlx4_core or vfio-pci.

Thanks

Khushbu

[SysManOne]

Hi @khushbur !

root@TTR:~/Works/tootoo2/build# dpdk-devbind.py -s

Other Network devices
=====================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' unused=mlx4_core,vfio-pci,uio_pci_generic

root@TTR:~/Works/tootoo2/build# dpdk-devbind.py -b none 0001:01:00.0
Notice: 0001:01:00.0 MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] is not currently managed by any driver

root@TTR:~/Works/tootoo2/build# dpdk-devbind.py -b mlx4_core 0001:01:00.0
Error: bind failed for 0001:01:00.0 - Cannot bind to driver mlx4_core: [Errno 19] No such device

root@TTR:~/Works/tootoo2/build# dpdk-devbind.py -b vfio-pci 0001:01:00.0

root@TTR:~/Works/tootoo2/build# dpdk-devbind.py -s

Network devices using DPDK-compatible driver
============================================
0001:01:00.0 'MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] 6750' drv=vfio-pci unused=mlx4_core,uio_pci_generic

[khushbur]

Hi @SysManOne 

Looks like you are able to bind device to vfio-pci. Please refer below link for more details.

https://docs.nxp.com/bundle/GUID-487B2E69-BB19-42CB-AC38-7EF18C0FE3AE/page/GUID-8DE656C1-8E78-4193-9...

Thanks

Khushbu

[SysManOne]

Hello @khushbur !

I read the pages from u links. But did not found anything related to my question. Can u please point me exactly to the docs ?