[LS1046A][DPAA][DPDK]fm1-mac9(ethernet@8) can't receive data from dpdk when running l2fwd.

[cecilia_zhong]

Hi

I have been running l2fwd with interface fm1-mac5(ethernet@4) and I can receive data from dpdk. I can run l2fwd with interface fm1-mac9(ethernet@8) but I can't receive data from dpdk.

The config data file and the pcd file we used as below.

<classification name="dpdk_mac5_classif" masks="yes">
<key>
<fieldref name ="ipv4.nextp"/>
</key>
<entry>
<vsp name="dpdk_mac5_flows" />
<data>0x11</data>
<mask>0xFF</mask>
<queue base="0x900" count="1"/>
</entry>
<entry>
<vsp name="dpdk_mac5_flows" />
<data>0x32</data>
<mask>0xFF</mask>
<queue base="0x900" count="1"/>
</entry>
<action condition="on-miss" type="distribution" name="default_mac5_dist"/>
</classification>

<distribution name="dpdk_mac5_dist">
<vsp name="dpdk_mac5_flows" />
<protocols>
<protocolref name="ipv4"/>
</protocols>
<queue base="0x900" count="1"/>
<action type="classification" name="dpdk_mac5_classif" />
</distribution>

<distribution name="default_mac5_dist">
<vsp name="shared_mac_pool" />
<queue count="1" base="0x88"/>
</distribution>

<classification name="dpdk_mac9_classif" masks="yes">
<key>
<fieldref name ="ipv4.nextp"/>
</key>
<entry>
<vsp name="dpdk_mac9_flows" />
<data>0x11</data>
<mask>0xFF</mask>
<queue base="0xb00" count="1"/>
</entry>
<entry>
<vsp name="dpdk_mac9_flows" />
<data>0x32</data>
<mask>0xFF</mask>
<queue base="0xb00" count="1"/>
</entry>
<action condition="on-miss" type="distribution" name="default_mac9_dist"/>
</classification>

<distribution name="dpdk_mac9_dist">
<vsp name="dpdk_mac9_flows" />
<protocols>
<protocolref name="ipv4"/>
</protocols>
<queue base="0xb00" count="1"/>
<action type="classification" name="dpdk_mac9_classif" />
</distribution>

<distribution name="default_mac9_dist">
<vsp name="shared_mac_pool" />
<queue count="1" base="0x8a"/>
</distribution>

What can I check to know why the fm1-mac9 can't receive data from dpdk?

Port statistics ====================================
Statistics for port 0 ------------------------------
Packets sent: 0
Packets received: 0
Packets dropped: 0
Aggregate statistics ===============================
Total packets sent: 0
Total packets received: 0
Total packets dropped: 0
====================================================

[cecilia_zhong]

For the TPM the mac9 and mac10 is used for 10g phy, in our side, we connect the 1g phy the same as the mac5, but mac5 can work, is there some limitation on mac9 with 1G phy for dpdk vsp mode?

[yipingwang]

mac9 with 1G phy cannot work.

[cecilia_zhong]

what's the meaning of mac9 with 1G phy can't work? dpdk vsp can't work? What's the limitation on it?

[yipingwang]

If the negotiation between MAC9 and your 1G PHY is successful, then it can work in Linux Kernel, it could also work in the DPDK VSP scenario. VSP has no relation with the link of PHY MAC.

[cecilia_zhong]

Based on our test, in kernel mode it is working, but vsp is not working with 1G Phy, and from the fman code in lsdk, we checked mac9 and mac10 is hardcode as 10G, does this configuration will casue the vsp not working with 1G phy? How can we debug further?

[yipingwang]

This is the fix for this issue from DPDK development team: https://github.com/NXPmicro/dpdk/commit/fc5be5f0ac99f34c801152de7f6165cf65cf8ff4

[cecilia_zhong]

Yes I have updated this code, but the issue can't be fixed. And we found that there are counters with 1a00000.fman/1a90000.port and 1a00000.fman/1ab0000.port, which are fm1-mac9 fman port. But the FQ is empty. -sh-4.4# cat /sys/devices/platform/soc/1a00000.fman/1a90000.port/statistics/* fm0-port-rx6 counter: 0 fm0-port-rx6 counter: 0 fm0-port-rx6 counter: 1042 fm0-port-rx6 counter: 1051 fm0-port-rx6 counter: 0 fm0-port-rx6 counter: 0 fm0-port-rx6 counter: 0 fm0-port-rx6 counter: 9 -sh-4.4# cat /sys/devices/platform/soc/1a00000.fman/1ab0000.port/statistics/* fm0-port-tx6 counter: 1292 fm0-port-tx6 counter: 1295 fm0-port-tx6 counter: 0 fm0-port-tx6 counter: 1301 fm0-port-tx6 counter: 0 fm0-port-tx6 counter: 1307 fm0-port-tx6 counter: 1310 fm0-port-tx6 counter: 0 fm0-port-tx6 counter: 0 -sh-4.4# echo 0xd00 > query_fq_np_fields -sh-4.4# cat query_fq_np_fields Query FQ Non Programmable Fields Result fqid 0xd00 force eligible pending: no retirement pending: no state: Tentatively Scheduled fq_link: 0x0 odp_seq: 0 orp_nesn: 0 orp_ea_hseq: 0 orp_ea_tseq: 0 orp_ea_hptr: 0x0 orp_ea_tptr: 0x0 pfdr_hptr: 0x0 pfdr_tptr: 0x0 is: ics_surp contains a surplus ics_surp: 0 byte_cnt: 0 frm_cnt: 0 ra1_sfdr: 0x800 ra2_sfdr: 0x0 od1_sfdr: 0x0 od2_sfdr: 0x0 od3_sfdr: 0x0 -sh-4.4#

[yipingwang]

Please run  debug_dump.sh script and send us the output.

This script is typically present in /usr/local/dpdk directory on the board.

Or you can copy it from dpdk/nxp/ source code.

[cecilia_zhong]

Please find the attach output file dpdk_debug__01011970_000756_mac9.txt for debug_dump.sh script .

[yipingwang]

   Can you run it with following command as well:

/home/l2fwd -w fm1-mac9 -c 0x3 -n 1 --file-prefix=p1 --socket-mem=1024 --log-level=eal,8 --log-level=dpaa,8 -- -p 0x1 -q 1

This will give use dpaa bus related logs

[cecilia_zhong]

Hi

Please find the attached files, thanks.

BR

[cecilia_zhong]

Can I modify the code to make it work? How can I do?

[cecilia_zhong]

Hi,

How to defined the queue base="0xb00" in the policy xml?

[yipingwang]

Did fm1-mac9 work normally when you use the default policy files provided in LSDK 21.08?

[yipingwang]

Did you use VSP scenario?
Did you boot the target board with dtb file fsl-ls1046a-rdb-usdpaa-shared.dtb?

Please setup VSP fmc configuration as the following to check whether ethernet@8 can receive data from DPDK.

$ fmc -c /usr/local/dpdk/dpaa/usdpaa_config_ls1046_shared_24g.xml -p /usr/local/dpdk/dpaa/usdpaa_policy_24g_classif_udp_ipsec_1queue.xml -a

Did you check whether fm1-mac9 can work in Linux?

[cecilia_zhong]

Yes, I use the VSP scenario and boot the target board with dtb file fsl-ls1046a-rdb-usdpaa-shared.dtb.

I have setuped VSP fmc configuration as you saided.

I have checked fm1-mac9 can work in Linux(I can setup my device to connect mme and make ue attach, but can not ping the device form mme). So I confirmed I can receive data from kernel, but can not receive data from dpdk.

When I change to fm1-mac5(ethernet@4), I can receive data from dpdk.

BR

[yipingwang]

Do you have ls1046ardb demo board?

If yes, please run all your configurations on LS1046ARDB to do verification.

[cecilia_zhong]

Yes, what I used to run the l2fwd is ls1046ardb board.

[yipingwang]

Please use fsl-ls1046a-rdb-usdpaa-shared.dtb and xml files /usr/local/dpdk/dpaa/usdpaa_config_ls1046_shared_24g.xml and /usr/local/dpdk/dpaa/usdpaa_policy_24g_classif_udp_ipsec_1queue.xm all from LSDK 21.08 default configuration, it seems that you have modified /usr/local/dpdk/dpaa/usdpaa_policy_24g_classif_udp_ipsec_1queue.xml.

[cecilia_zhong]

Hi NXP，

One thing need highlight here is，in our project we used the mac9 and mac10 connect with 1G phy solution, not 10G phy,I think the reference board is 10G phy based, is there anything we need to change to support 1G phy on mac9 for dpaa vsp feature.