topic Re: LS1043 dpaa missed one dhcp packet in QorIQ

LS1043 dpaa missed one dhcp packet

jiafang — Mon, 18 Dec 2023 09:00:42 GMT

Hi, all

When we use dhcp, we found that, there is a DHCPREQUEST packet missed when requesting an IP.

We tried to get an IP from DHCP server, we can see the following DHCP packets were sent in dhclient:

******our dhclient debug log******
dhclient: state_init[2:2]
dhclient: DHCPDISCOVER on eth1.3 to 255.255.255.255 port 67 interval 3 0xd1130731(3) <--- send DHCPDISCOVER
dhclient: DHCPOFFER of 192.168.100.139 from 192.168.100.120 0xd1130731(3) <--- send DHCPOFFER
dhclient: state_selecting[3:3]
dhclient: send_request cur_time[1702397658], firstsending [1702397658] state 4
dhclient: DHCPREQUEST for 192.168.100.139 on eth1.3 to 255.255.255.255 port 67 inter 19[0:10], timeout[10], 0xd1130731(4) <--- send DHCPREQUEST
dhclient: send_request: have sent 300 byte long packet over eth1.3 interface<5:6>.
dhclient: send_request: timeout tv[1702397677:352541]
dhclient: send_request cur_time[1702397677], firstsending [1702397658] state 4
dhclient: send_request cancel, interval 19, timeout 10, cur time 1702397677, firstsending 1702397658, 0xd1130731(2) <--- failed to get the DHCPACK from dhcp server
******our dhclient debug log******

By checking the souce of dhcp/client/dhclient.c, it looks like the DHCPREQUEST packet is canceled due to timeout .
void send_request (cpp)
void *cpp;
{
...... snip ......
if ((client -> state == S_REBOOTING ||
client -> state == S_REQUESTING) &&
interval > client -> config -> reboot_timeout) {
cancel:
client -> state = S_INIT;
cancel_timeout (send_request, client);
log_debug ("%s cansel, interval %d, timeout %d, cur time %ld, firstsending %ld, 0x%x(%d)", <--- the log for "failed to send DHCPREQUEST"
__func__, ntohl(client -> xid), client -> state,
interval, client -> config -> reboot_timeout,
cur_time, client -> first_sending);
state_init (client);
return;
}
...... snip ......
}

We also traced the kernel for DHCPREQUEST, we can see the DHCPDISCOVER
packet and the DHCPREQUEST packet is sent in dpa_xmit, which is from
drivers/net/ethernet/freescale/sdk_dpaa/dpaa_eth.h:

******our kernel debug log******
kernel:vlan_dev_hard_start_xmit: tid 0xd1130731 DHCPDISCOVER
kernel:__dev_queue_xmit: tid 0xd1130731 DHCPDISCOVER
kernel:xmit_one: tid 0xd1130731 DHCPDISCOVER
kernel:dpa_xmit: tid 0xd1130731 DHCPDISCOVER

kernel:vlan_dev_hard_start_xmit: tid 0xd1130731 DHCPREQUEST
kernel:__dev_queue_xmit: tid 0xd1130731 DHCPREQUEST
kernel:xmit_one: tid 0xd1130731 DHCPREQUEST
kernel:dpa_xmit: tid 0xd1130731 DHCPREQUEST
******our kernel debug log******

However, we cannot see the DHCPREQUEST packet in pcap:

******network capture******
No. Time Source Destination Protocol Length Info
17723 16200.109131 0.0.0.0 255.255.255.255 DHCP 342 DHCP Discover - Transaction ID 0xd1130731
17724 16200.110468 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
17725 16200.126369 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
17726 16200.126923 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
17727 16200.127650 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
******network capture******

My question is, is it possbile to confirm the issue is from dpaa driver or H/W?

As you can see, dpa_xmit has gotten the DHCPREQUEST packet, but the packet is
not sent out by H/W.

How we can know where the packet is lost ?

Please let me know any further requests from us.

Re: LS1043 dpaa missed one dhcp packet

yipingwang — Wed, 03 Jan 2024 05:19:52 GMT

Please check FMAN counters from sysfs and MAC counters.

An example of quick dumping of FMAN counters from sysfs(these represent FMBM_RFRC):

find /sys/devices/ -name 'port_frame' -exec cat {} \;

fm0-port-rx5 counter: 0

fm0-port-tx4 counter: 0

FM Port not configured...

fm0-port-tx0 counter: 1365

FM Port not configured...

fm0-port-tx7 counter: 0

fm0-port-rx4 counter: 47279872

FM Port not configured...

fm0-port-rx0 counter: 6800

fm0-port-tx5 counter: 43045909

fm0-port-oh1 counter: 0

FM Port not configured...

fm0-port-rx7 counter: 0

FM Port not configured...

MAC counters:

They can be found here:

cat /sys/devices/platform/soc/soc:fsl,dpaa/soc:fsl,dpaa:ethernet@2/net/eth2/mac_tx_stats

cat /sys/devices/platform/soc/soc:fsl,dpaa/soc:fsl,dpaa:ethernet@2/net/eth2/mac_rx_stats

Note in case the sysfs entries differ from above, identify the counters by:

find / -name "mac_tx_stats"

Re: LS1043 dpaa missed one dhcp packet

jiafang — Thu, 18 Jan 2024 01:55:16 GMT

Thanks very much for the info.
After the issue reproduced, we will show those info here.
Please wait for the reproduce. Thanks.

Re: LS1043 dpaa missed one dhcp packet

jiafang — Mon, 22 Jan 2024 02:04:59 GMT

Hi,

We reproduced issue again. Please help to check the logs. Thanks.

# ethtool -S eth1 [2024-01-18 18:05:24.107] NIC statistics: [2024-01-18 18:05:24.684] interrupts [CPU 0]: 55 [2024-01-18 18:05:24.684] interrupts [CPU 1]: 60 [2024-01-18 18:05:24.684] interrupts [CPU 2]: 60 [2024-01-18 18:05:24.684] interrupts [CPU 3]: 52 [2024-01-18 18:05:24.684] interrupts [TOTAL]: 227 [2024-01-18 18:05:24.684] rx packets [CPU 0]: 31 [2024-01-18 18:05:24.684] rx packets [CPU 1]: 39 [2024-01-18 18:05:24.684] rx packets [CPU 2]: 23 [2024-01-18 18:05:24.684] rx packets [CPU 3]: 30 [2024-01-18 18:05:24.684] rx packets [TOTAL]: 123 [2024-01-18 18:05:24.684] tx packets [CPU 0]: 23 [2024-01-18 18:05:24.684] tx packets [CPU 1]: 35 [2024-01-18 18:05:24.684] tx packets [CPU 2]: 11 [2024-01-18 18:05:24.684] tx packets [CPU 3]: 1 [2024-01-18 18:05:24.684] tx packets [TOTAL]: 70 [2024-01-18 18:05:24.684] tx recycled [CPU 0]: 0 [2024-01-18 18:05:24.684] tx recycled [CPU 1]: 0 [2024-01-18 18:05:24.684] tx recycled [CPU 2]: 0 [2024-01-18 18:05:24.684] tx recycled [CPU 3]: 0 [2024-01-18 18:05:24.684] tx recycled [TOTAL]: 0 [2024-01-18 18:05:24.684] tx confirm [CPU 0]: 22 [2024-01-18 18:05:24.684] tx confirm [CPU 1]: 13 [2024-01-18 18:05:24.684] tx confirm [CPU 2]: 22 [2024-01-18 18:05:24.684] tx confirm [CPU 3]: 13 [2024-01-18 18:05:24.684] tx confirm [TOTAL]: 70 [2024-01-18 18:05:24.684] tx S/G [CPU 0]: 0 [2024-01-18 18:05:24.684] tx S/G [CPU 1]: 0 [2024-01-18 18:05:24.684] tx S/G [CPU 2]: 0 [2024-01-18 18:05:24.684] tx S/G [CPU 3]: 0 [2024-01-18 18:05:24.684] tx S/G [TOTAL]: 0 [2024-01-18 18:05:24.684] rx S/G [CPU 0]: 0 [2024-01-18 18:05:24.684] rx S/G [CPU 1]: 0 [2024-01-18 18:05:24.684] rx S/G [CPU 2]: 0 [2024-01-18 18:05:24.684] rx S/G [CPU 3]: 0 [2024-01-18 18:05:24.684] rx S/G [TOTAL]: 0 [2024-01-18 18:05:24.684] tx error [CPU 0]: 0 [2024-01-18 18:05:24.684] tx error [CPU 1]: 0 [2024-01-18 18:05:24.689] tx error [CPU 2]: 0 [2024-01-18 18:05:24.689] tx error [CPU 3]: 0 [2024-01-18 18:05:24.689] tx error [TOTAL]: 0 [2024-01-18 18:05:24.689] rx error [CPU 0]: 0 [2024-01-18 18:05:24.689] rx error [CPU 1]: 0 [2024-01-18 18:05:24.689] rx error [CPU 2]: 0 [2024-01-18 18:05:24.689] rx error [CPU 3]: 0 [2024-01-18 18:05:24.689] rx error [TOTAL]: 0 [2024-01-18 18:05:24.689] bp count [CPU 0]: 88 [2024-01-18 18:05:24.689] bp count [CPU 1]: 93 [2024-01-18 18:05:24.689] bp count [CPU 2]: 82 [2024-01-18 18:05:24.689] bp count [CPU 3]: 120 [2024-01-18 18:05:24.689] bp count [TOTAL]: 383 [2024-01-18 18:05:24.689] rx dma error: 0 [2024-01-18 18:05:24.689] rx frame physical error: 0 [2024-01-18 18:05:24.689] rx frame size error: 0 [2024-01-18 18:05:24.689] rx header error: 0 [2024-01-18 18:05:24.689] rx csum error: 0 [2024-01-18 18:05:24.689] qman cg_tdrop: 0 [2024-01-18 18:05:24.689] qman wred: 0 [2024-01-18 18:05:24.689] qman error cond: 0 [2024-01-18 18:05:24.689] qman early window: 0 [2024-01-18 18:05:24.689] qman late window: 0 [2024-01-18 18:05:24.689] qman fq tdrop: 0 [2024-01-18 18:05:24.689] qman fq retired: 0 [2024-01-18 18:05:24.689] qman orp disabled: 0 [2024-01-18 18:05:24.689] congestion time (ms): 0 [2024-01-18 18:05:24.689] entered congestion: 0 [2024-01-18 18:05:24.689] congested (0/1): 0 #find /sys/devices/ -name 'port_frame' -exec cat {} \; [2024-01-18 18:05:28.800] fm0-port-rx1 counter: 0 [2024-01-18 18:05:28.800] fm0-port-rx2 counter: 107 [2024-01-18 18:05:28.800] FM Port not configured... [2024-01-18 18:05:28.805] fm0-port-rx4 counter: 2852 [2024-01-18 18:05:28.805] fm0-port-tx5 counter: 8 [2024-01-18 18:05:28.805] FM Port not configured... [2024-01-18 18:05:28.805] FM Port not configured... [2024-01-18 18:05:28.805] fm0-port-rx0 counter: 173 [2024-01-18 18:05:28.805] fm0-port-tx1 counter: 8 [2024-01-18 18:05:28.805] fm0-port-tx2 counter: 8 [2024-01-18 18:05:28.805] fm0-port-tx4 counter: 1164 [2024-01-18 18:05:28.805] FM Port not configured... [2024-01-18 18:05:28.805] fm0-port-rx5 counter: 0 [2024-01-18 18:05:28.805] FM Port not configured... [2024-01-18 18:05:28.805] FM Port not configured... [2024-01-18 18:05:28.805] fm0-port-tx0 counter: 77 #find /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net /eth1/statistics/* -exec cat {} \; [2024-01-18 18:05:34.536] 0 [2024-01-18 18:05:34.536] 0 [2024-01-18 18:05:34.536] 24228 [2024-01-18 18:05:34.536] 0 [2024-01-18 18:05:34.536] 0 [2024-01-18 18:05:34.536] 1 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 141 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 10682 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 0 [2024-01-18 18:05:34.540] 83 [2024-01-18 18:05:34.540] 0 # find /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net /eth1/upper_eth1.3/statistics/* -exec cat {} \; [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.074] 13728 [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.074] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 90 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 11098 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.092] 0 [2024-01-18 18:05:39.111] 0 [2024-01-18 18:05:39.111] 0 [2024-01-18 18:05:39.111] 83 [2024-01-18 18:05:39.111] 0 # cat /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net/ eth1/mac_tx_stats [2024-01-18 18:05:43.436] ------- [2024-01-18 18:05:43.436] [2024-01-18 18:05:43.896] [2024-01-18 18:05:43.896] FM MAC - MEMAC -0 Tx stats (0xFFFF8000801D6000) [2024-01-18 18:05:43.896] ---------------------------------------- [2024-01-18 18:05:43.896] [2024-01-18 18:05:43.896] 0xFFFF8000801D6200: 0x00003236 teoct_l [2024-01-18 18:05:43.896] 0xFFFF8000801D6204: 0x00000000 teoct_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6208: 0x00003236 toct_l [2024-01-18 18:05:43.896] 0xFFFF8000801D620C: 0x00000000 toct_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6218: 0x00000000 txpf_l [2024-01-18 18:05:43.896] 0xFFFF8000801D621C: 0x00000000 txpf_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6220: 0x0000005f tfrm_l [2024-01-18 18:05:43.896] 0xFFFF8000801D6224: 0x00000000 tfrm_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6228: 0x00000000 tfcs_l [2024-01-18 18:05:43.896] 0xFFFF8000801D622C: 0x00000000 tfcs_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6230: 0x00000057 tvlan_l [2024-01-18 18:05:43.896] 0xFFFF8000801D6234: 0x00000000 tvlan_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6238: 0x00000000 terr_l [2024-01-18 18:05:43.896] 0xFFFF8000801D623C: 0x00000000 terr_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6240: 0x00000041 tuca_l [2024-01-18 18:05:43.896] 0xFFFF8000801D6244: 0x00000000 tuca_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6248: 0x00000010 tmca_l [2024-01-18 18:05:43.896] 0xFFFF8000801D624C: 0x00000000 tmca_u [2024-01-18 18:05:43.896] 0xFFFF8000801D6250: 0x0000000e tbca_l [2024-01-18 18:05:43.896] 0xFFFF8000801D6254: 0x00000000 tbca_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6260: 0x0000005f tpkt_l [2024-01-18 18:05:43.901] 0xFFFF8000801D6264: 0x00000000 tpkt_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6268: 0x00000000 tund_l [2024-01-18 18:05:43.901] 0xFFFF8000801D626C: 0x00000000 tund_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6270: 0x00000006 t64_l [2024-01-18 18:05:43.901] 0xFFFF8000801D6274: 0x00000000 t64_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6278: 0x00000046 t127_l [2024-01-18 18:05:43.901] 0xFFFF8000801D627C: 0x00000000 t127_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6280: 0x00000000 t255_l [2024-01-18 18:05:43.901] 0xFFFF8000801D6284: 0x00000000 t255_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6288: 0x00000013 t511_l [2024-01-18 18:05:43.901] 0xFFFF8000801D628C: 0x00000000 t511_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6290: 0x00000000 t1023_l [2024-01-18 18:05:43.901] 0xFFFF8000801D6294: 0x00000000 t1023_u [2024-01-18 18:05:43.901] 0xFFFF8000801D6298: 0x00000000 t1518_l [2024-01-18 18:05:43.901] 0xFFFF8000801D629C: 0x00000000 t1518_u [2024-01-18 18:05:43.901] 0xFFFF8000801D62A0: 0x00000000 t1519x_l [2024-01-18 18:05:43.901] 0xFFFF8000801D62A4: 0x00000000 t1519x_u [2024-01-18 18:05:43.901] 0xFFFF8000801D62C0: 0x00000000 tcnp_l [2024-01-18 18:05:43.901] 0xFFFF8000801D62C4: 0x00000000 tcnp_u # cat /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net/ eth1/mac_rx_stats [2024-01-18 18:05:49.094] ------- [2024-01-18 18:05:49.094] [2024-01-18 18:05:49.094] [2024-01-18 18:05:49.094] FM MAC - MEMAC -0 Rx stats (0xFFFF8000801D6000) [2024-01-18 18:05:49.094] ---------------------------------------- [2024-01-18 18:05:49.094] [2024-01-18 18:05:49.094] 0xFFFF8000801D6100: 0x0000b0b2 reoct_l [2024-01-18 18:05:49.094] 0xFFFF8000801D6104: 0x00000000 reoct_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6108: 0x0000b0b2 roct_l [2024-01-18 18:05:49.094] 0xFFFF8000801D610C: 0x00000000 roct_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6110: 0x00000000 raln_l [2024-01-18 18:05:49.094] 0xFFFF8000801D6114: 0x00000000 raln_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6118: 0x00000000 rxpf_l [2024-01-18 18:05:49.094] 0xFFFF8000801D611C: 0x00000000 rxpf_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6120: 0x000000e0 rfrm_l [2024-01-18 18:05:49.094] 0xFFFF8000801D6124: 0x00000000 rfrm_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6128: 0x00000000 rfcs_l [2024-01-18 18:05:49.094] 0xFFFF8000801D612C: 0x00000000 rfcs_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6130: 0x00000064 rvlan_l [2024-01-18 18:05:49.094] 0xFFFF8000801D6134: 0x00000000 rvlan_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6138: 0x00000000 rerr_l [2024-01-18 18:05:49.094] 0xFFFF8000801D613C: 0x00000000 rerr_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6140: 0x00000060 ruca_l [2024-01-18 18:05:49.094] 0xFFFF8000801D6144: 0x00000000 ruca_u [2024-01-18 18:05:49.094] 0xFFFF8000801D6148: 0x0000002c rmca_l [2024-01-18 18:05:49.094] 0xFFFF8000801D614C: 0x00000000 rmca_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6150: 0x00000054 rbca_l [2024-01-18 18:05:49.101] 0xFFFF8000801D6154: 0x00000000 rbca_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6158: 0x00000000 rdrp_l [2024-01-18 18:05:49.101] 0xFFFF8000801D615C: 0x00000000 rdrp_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6160: 0x000000e0 rpkt_l [2024-01-18 18:05:49.101] 0xFFFF8000801D6164: 0x00000000 rpkt_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6168: 0x00000000 rund_l [2024-01-18 18:05:49.101] 0xFFFF8000801D616C: 0x00000000 rund_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6170: 0x0000002e r64_l [2024-01-18 18:05:49.101] 0xFFFF8000801D6174: 0x00000000 r64_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6178: 0x00000063 r127_l [2024-01-18 18:05:49.101] 0xFFFF8000801D617C: 0x00000000 r127_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6180: 0x00000010 r255_l [2024-01-18 18:05:49.101] 0xFFFF8000801D6184: 0x00000000 r255_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6188: 0x00000023 r511_l [2024-01-18 18:05:49.101] 0xFFFF8000801D618C: 0x00000000 r511_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6190: 0x0000001c r1023_l [2024-01-18 18:05:49.101] 0xFFFF8000801D6194: 0x00000000 r1023_u [2024-01-18 18:05:49.101] 0xFFFF8000801D6198: 0x00000000 r1518_l [2024-01-18 18:05:49.101] 0xFFFF8000801D619C: 0x00000000 r1518_u [2024-01-18 18:05:49.101] 0xFFFF8000801D61A0: 0x00000000 r1519x_l [2024-01-18 18:05:49.105] 0xFFFF8000801D61A4: 0x00000000 r1519x_u [2024-01-18 18:05:49.105] 0xFFFF8000801D61A8: 0x00000000 rovr_l [2024-01-18 18:05:49.105] 0xFFFF8000801D61AC: 0x00000000 rovr_u [2024-01-18 18:05:49.105] 0xFFFF8000801D61B0: 0x00000000 rjbr_l [2024-01-18 18:05:49.105] 0xFFFF8000801D61B4: 0x00000000 rjbr_u [2024-01-18 18:05:49.105] 0xFFFF8000801D61B8: 0x00000000 rfrg_l [2024-01-18 18:05:49.105] 0xFFFF8000801D61BC: 0x00000000 rfrg_u [2024-01-18 18:05:49.105] 0xFFFF8000801D61C0: 0x00000000 rcnp_l [2024-01-18 18:05:49.105] 0xFFFF8000801D61C4: 0x00000000 rcnp_u [2024-01-18 18:05:49.105] 0xFFFF8000801D61C8: 0x00000000 rdrntp_l [2024-01-18 18:05:49.105] 0xFFFF8000801D61CC: 0x00000000 rdrntp_u

Re: LS1043 dpaa missed one dhcp packet

yipingwang — Mon, 22 Jan 2024 03:29:18 GMT

You are using multiple Ethernet ports now.

Please check the exact port of DPAA statics with the following command.

/sys/devices/platform/soc/1a00000.fman/*.port/statistics/port_frame

For the port number, please refer to qoriq-fman3-*-1g-*.dtsi in Linux Kernel dts file.

For example, for FM1 mEMAC1: 1AE_0000h, the tx port number is 0x1aa8000

Re: LS1043 dpaa missed one dhcp packet

jiafang — Wed, 24 Jan 2024 09:54:44 GMT

OK, We will do the next reproduce for those info.

BTW, I have one more question, we found that after dpa_xmit() the broadcast packet such as DHCPDISCOVER and DHCPREQUEST, there will be a tx irq hardware event to call portal_isr() and a rx hardware irq evernt to call portal_isr().
Could you tell me which code triggers this kind of irq events ?

Re: LS1043 dpaa missed one dhcp packet

jiafang — Thu, 07 Mar 2024 09:39:02 GMT

When check this issue, we found a upstream commit

commit 89857a8a5c89a406b967ab2be7bd2ccdbe75e73d
Author: Madalin Bucur <madalin.bucur@nxp.com>
Date: Fri Dec 21 16:41:42 2018 +0200

soc: fsl: qbman: avoid race in clearing QMan interrupt

By clearing all interrupt sources, not only those that
already occurred, the existing code may acknowledge by
mistake interrupts that occurred after the code checks
for them.

But this patch is for drivers/soc/fsl/qbman/qman.c.

Is it necessary to port this patch in drivers/staging/fsl_qbman/bman_high.c ? If not, could you tell us the reason ?

Thanks

Re: LS1043 dpaa missed one dhcp packet

jiafang — Wed, 03 Apr 2024 10:05:36 GMT

We still have 3 questions about this question, If you have some time, could you please help to check ? thanks very much

Q1: Do you know who update "dq->contextB" ? hardware or driver ?

portal_isr
__poll_portal_fast
fq = get_fq_table_entry(dq->contextB); ==> (*1) priv_tx_conf_default_dqrr or priv_rx_default_dqrr
res = fq->cb.dqrr(p, fq, dq);

Q2: From log, it seems like the tid 0xad16bf61 has been sent out ? (The peer server still can't receive this DHCPREQUEST packet )

dhclient-2144 [002] ..s1 28764.986600: net_dev_queue: dev=eth1.3 skbaddr=ffff80003f230200 len=342
dhclient-2144 [002] ..s1 28764.986606: net_dev_start_xmit: dev=eth1.3 queue_mapping=0 skbaddr=ffff80003f230200 vlan_tagged=0 vlan_proto=0x0000 vlan_tci=0x0000 protocol=0x0003 ip_summed=0 len=342 data_len=0 network_offset=18 transport_offset_valid=1 transport_offset=18 tx_flags=0 gso_size=0 gso_segs=0 gso_type=0x0
dhclient-2144 [002] ..s1 28764.986610: dh_tp: vlan_dev_hard_start_xmit:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986611: net_dev_queue: dev=eth1 skbaddr=ffff80003f230200 len=342
dhclient-2144 [002] ..s1 28764.986613: dh_tp: __dev_queue_xmit:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986621: net_dev_start_xmit: dev=eth1 queue_mapping=2 skbaddr=ffff80003f230200 vlan_tagged=0 vlan_proto=0x8100 vlan_tci=0x0000 protocol=0x8100 ip_summed=0 len=346 data_len=0 network_offset=22 transport_offset_valid=1 transport_offset=22 tx_flags=0 gso_size=0 gso_segs=0 gso_type=0x0
dhclient-2144 [002] ..s1 28764.986623: dh_tp: xmit_one:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986627: dh_tp: dpa_xmit:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986629: dpa_tx_fd: [eth1] fqid=281, fd: addr=0xb8befc1c, format=contig, off=64, len=346, status=0x80000113 is=0x00000000:0x00000000 stat=0x1000 skbaddr=ffff80003f230200
dhclient-2144 [002] ..s1 28764.986633: net_dev_xmit: dev=eth1 skbaddr=ffff80003f230200 len=346 rc=0
dhclient-2144 [002] ..s1 28764.986634: net_dev_xmit: dev=eth1.3 skbaddr=ffff80003f230200 len=342 rc=0
<idle>-0 [001] d.h2 28764.986722: irq_handler_entry: irq=59 name=QMan portal 1
<idle>-0 [001] d.h2 28764.986726: dh_tp: priv_tx_conf_default_dqrr:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
<idle>-0 [001] d.h2 28764.986728: dpa_tx_conf_fd: [eth1] fqid=275, fd: addr=0xb8befc1c, format=contig, off=64, len=346, status=0x80000113 is=0x10020000:0x00000000 stat=0x0090 skbaddr=ffff80003f230200
<idle>-0 [001] d.h2 28764.986730: softirq_raise: vec=3 [action=NET_RX]
<idle>-0 [001] d.h2 28764.986731: dpa_tx_fd_stop: [eth1] fqid=275 len=346 skbaddr=ffff80003f230200
<idle>-0 [001] d.h2 28764.986732: irq_handler_exit: irq=59 ret=handled
<idle>-0 [001] ..s2 28764.986734: softirq_entry: vec=3 [action=NET_RX]
<idle>-0 [001] ..s2 28764.986736: dh_tp: priv_tx_conf_default_dqrr:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
<idle>-0 [001] ..s2 28764.986737: dpa_tx_conf_fd: [eth1] fqid=275, fd: addr=0xb8befc1c, format=contig, off=64, len=346, status=0x80000113 is=0x18000000:0x08000000 stat=0x0090 skbaddr=ffff80003f230200
<idle>-0 [001] ..s2 28764.986741: napi_poll: napi poll on napi struct ffff800021e21ce8 for device eth1 work:[1/64]
<idle>-0 [001] ..s2 28764.986742: softirq_exit: vec=3 [action=NET_RX]

Q3: It seems like the EQCI and EQCR is not used. why only use "DQRR" is for RX interrupt for QMan portal [0-3] IRQ.

Re: LS1043 dpaa missed one dhcp packet

jiafang — Tue, 09 Apr 2024 03:46:40 GMT

We reproduced this issue again. Please check the logs:
# find /sys/devices/platform/soc/1a00000.fman/1a88000.port/st atistics/* -exec cat {} \;
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 36796
fm0-port-rx0 counter: 36796
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0

# find /sys/devices/platform/soc/1a00000.fman/1aa8000.port/st atistics/* -exec cat {} \;
fm0-port-tx0 counter: 13513
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 0
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 0
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 0
fm0-port-tx0 counter: 0