LS1043 dpaa missed one dhcp packet

jiafang · ‎12-18-2023

Hi, all

When we use dhcp, we found that, there is a DHCPREQUEST packet missed when requesting an IP.

We tried to get an IP from DHCP server, we can see the following DHCP packets were sent in dhclient:

******our dhclient debug log******
dhclient: state_init[2:2]
dhclient: DHCPDISCOVER on eth1.3 to 255.255.255.255 port 67 interval 3 0xd1130731(3) <--- send DHCPDISCOVER
dhclient: DHCPOFFER of 192.168.100.139 from 192.168.100.120 0xd1130731(3) <--- send DHCPOFFER
dhclient: state_selecting[3:3]
dhclient: send_request cur_time[1702397658], firstsending [1702397658] state 4
dhclient: DHCPREQUEST for 192.168.100.139 on eth1.3 to 255.255.255.255 port 67 inter 19[0:10], timeout[10], 0xd1130731(4) <--- send DHCPREQUEST
dhclient: send_request: have sent 300 byte long packet over eth1.3 interface<5:6>.
dhclient: send_request: timeout tv[1702397677:352541]
dhclient: send_request cur_time[1702397677], firstsending [1702397658] state 4
dhclient: send_request cancel, interval 19, timeout 10, cur time 1702397677, firstsending 1702397658, 0xd1130731(2) <--- failed to get the DHCPACK from dhcp server
******our dhclient debug log******

By checking the souce of dhcp/client/dhclient.c, it looks like the DHCPREQUEST packet is canceled due to timeout .
void send_request (cpp)
void *cpp;
{
...... snip ......
if ((client -> state == S_REBOOTING ||
client -> state == S_REQUESTING) &&
interval > client -> config -> reboot_timeout) {
cancel:
client -> state = S_INIT;
cancel_timeout (send_request, client);
log_debug ("%s cansel, interval %d, timeout %d, cur time %ld, firstsending %ld, 0x%x(%d)", <--- the log for "failed to send DHCPREQUEST"
__func__, ntohl(client -> xid), client -> state,
interval, client -> config -> reboot_timeout,
cur_time, client -> first_sending);
state_init (client);
return;
}
...... snip ......
}

We also traced the kernel for DHCPREQUEST, we can see the DHCPDISCOVER
packet and the DHCPREQUEST packet is sent in dpa_xmit, which is from
drivers/net/ethernet/freescale/sdk_dpaa/dpaa_eth.h:

******our kernel debug log******
kernel:vlan_dev_hard_start_xmit: tid 0xd1130731 DHCPDISCOVER
kernel:__dev_queue_xmit: tid 0xd1130731 DHCPDISCOVER
kernel:xmit_one: tid 0xd1130731 DHCPDISCOVER
kernel:dpa_xmit: tid 0xd1130731 DHCPDISCOVER

kernel:vlan_dev_hard_start_xmit: tid 0xd1130731 DHCPREQUEST
kernel:__dev_queue_xmit: tid 0xd1130731 DHCPREQUEST
kernel:xmit_one: tid 0xd1130731 DHCPREQUEST
kernel:dpa_xmit: tid 0xd1130731 DHCPREQUEST
******our kernel debug log******

However, we cannot see the DHCPREQUEST packet in pcap:

******network capture******
No. Time Source Destination Protocol Length Info
17723 16200.109131 0.0.0.0 255.255.255.255 DHCP 342 DHCP Discover - Transaction ID 0xd1130731
17724 16200.110468 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
17725 16200.126369 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
17726 16200.126923 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
17727 16200.127650 192.168.100.120 192.168.100.139 DHCP 342 DHCP Offer - Transaction ID 0xd1130731
******network capture******

My question is, is it possbile to confirm the issue is from dpaa driver or H/W?

As you can see, dpa_xmit has gotten the DHCPREQUEST packet, but the packet is
not sent out by H/W.

How we can know where the packet is lost ?

Please let me know any further requests from us.

jiafang · ‎04-03-2024

Hi

We still have 3 questions about this question, If you have some time, could you please help to check ? thanks very much

Q1: Do you know who update "dq->contextB" ? hardware or driver ?

portal_isr
__poll_portal_fast
fq = get_fq_table_entry(dq->contextB); ==> (*1) priv_tx_conf_default_dqrr or priv_rx_default_dqrr
res = fq->cb.dqrr(p, fq, dq);

Q2: From log, it seems like the tid 0xad16bf61 has been sent out ? (The peer server still can't receive this DHCPREQUEST packet )

dhclient-2144 [002] ..s1 28764.986600: net_dev_queue: dev=eth1.3 skbaddr=ffff80003f230200 len=342
dhclient-2144 [002] ..s1 28764.986606: net_dev_start_xmit: dev=eth1.3 queue_mapping=0 skbaddr=ffff80003f230200 vlan_tagged=0 vlan_proto=0x0000 vlan_tci=0x0000 protocol=0x0003 ip_summed=0 len=342 data_len=0 network_offset=18 transport_offset_valid=1 transport_offset=18 tx_flags=0 gso_size=0 gso_segs=0 gso_type=0x0
dhclient-2144 [002] ..s1 28764.986610: dh_tp: vlan_dev_hard_start_xmit:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986611: net_dev_queue: dev=eth1 skbaddr=ffff80003f230200 len=342
dhclient-2144 [002] ..s1 28764.986613: dh_tp: __dev_queue_xmit:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986621: net_dev_start_xmit: dev=eth1 queue_mapping=2 skbaddr=ffff80003f230200 vlan_tagged=0 vlan_proto=0x8100 vlan_tci=0x0000 protocol=0x8100 ip_summed=0 len=346 data_len=0 network_offset=22 transport_offset_valid=1 transport_offset=22 tx_flags=0 gso_size=0 gso_segs=0 gso_type=0x0
dhclient-2144 [002] ..s1 28764.986623: dh_tp: xmit_one:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986627: dh_tp: dpa_xmit:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
dhclient-2144 [002] ..s1 28764.986629: dpa_tx_fd: [eth1] fqid=281, fd: addr=0xb8befc1c, format=contig, off=64, len=346, status=0x80000113 is=0x00000000:0x00000000 stat=0x1000 skbaddr=ffff80003f230200
dhclient-2144 [002] ..s1 28764.986633: net_dev_xmit: dev=eth1 skbaddr=ffff80003f230200 len=346 rc=0
dhclient-2144 [002] ..s1 28764.986634: net_dev_xmit: dev=eth1.3 skbaddr=ffff80003f230200 len=342 rc=0
<idle>-0 [001] d.h2 28764.986722: irq_handler_entry: irq=59 name=QMan portal 1
<idle>-0 [001] d.h2 28764.986726: dh_tp: priv_tx_conf_default_dqrr:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
<idle>-0 [001] d.h2 28764.986728: dpa_tx_conf_fd: [eth1] fqid=275, fd: addr=0xb8befc1c, format=contig, off=64, len=346, status=0x80000113 is=0x10020000:0x00000000 stat=0x0090 skbaddr=ffff80003f230200
<idle>-0 [001] d.h2 28764.986730: softirq_raise: vec=3 [action=NET_RX]
<idle>-0 [001] d.h2 28764.986731: dpa_tx_fd_stop: [eth1] fqid=275 len=346 skbaddr=ffff80003f230200
<idle>-0 [001] d.h2 28764.986732: irq_handler_exit: irq=59 ret=handled
<idle>-0 [001] ..s2 28764.986734: softirq_entry: vec=3 [action=NET_RX]
<idle>-0 [001] ..s2 28764.986736: dh_tp: priv_tx_conf_default_dqrr:[eth1] tid 0xad16bf61 DHCPREQUEST(0x59d7)
<idle>-0 [001] ..s2 28764.986737: dpa_tx_conf_fd: [eth1] fqid=275, fd: addr=0xb8befc1c, format=contig, off=64, len=346, status=0x80000113 is=0x18000000:0x08000000 stat=0x0090 skbaddr=ffff80003f230200
<idle>-0 [001] ..s2 28764.986741: napi_poll: napi poll on napi struct ffff800021e21ce8 for device eth1 work:[1/64]
<idle>-0 [001] ..s2 28764.986742: softirq_exit: vec=3 [action=NET_RX]

Q3: It seems like the EQCI and EQCR is not used. why only use "DQRR" is for RX interrupt for QMan portal [0-3] IRQ.

jiafang · ‎03-07-2024

When check this issue, we found a upstream commit

commit 89857a8a5c89a406b967ab2be7bd2ccdbe75e73d
Author: Madalin Bucur <madalin.bucur@nxp.com>
Date: Fri Dec 21 16:41:42 2018 +0200

soc: fsl: qbman: avoid race in clearing QMan interrupt

By clearing all interrupt sources, not only those that
already occurred, the existing code may acknowledge by
mistake interrupts that occurred after the code checks
for them.

But this patch is for drivers/soc/fsl/qbman/qman.c.

Is it necessary to port this patch in drivers/staging/fsl_qbman/bman_high.c ? If not, could you tell us the reason ?

Thanks

jiafang · ‎01-21-2024

Hi,

We reproduced issue again. Please help to check the logs. Thanks.

# ethtool -S eth1
[2024-01-18 18:05:24.107] NIC statistics:
[2024-01-18 18:05:24.684]      interrupts [CPU 0]: 55
[2024-01-18 18:05:24.684]      interrupts [CPU 1]: 60
[2024-01-18 18:05:24.684]      interrupts [CPU 2]: 60
[2024-01-18 18:05:24.684]      interrupts [CPU 3]: 52
[2024-01-18 18:05:24.684]      interrupts [TOTAL]: 227
[2024-01-18 18:05:24.684]      rx packets [CPU 0]: 31
[2024-01-18 18:05:24.684]      rx packets [CPU 1]: 39
[2024-01-18 18:05:24.684]      rx packets [CPU 2]: 23
[2024-01-18 18:05:24.684]      rx packets [CPU 3]: 30
[2024-01-18 18:05:24.684]      rx packets [TOTAL]: 123
[2024-01-18 18:05:24.684]      tx packets [CPU 0]: 23
[2024-01-18 18:05:24.684]      tx packets [CPU 1]: 35
[2024-01-18 18:05:24.684]      tx packets [CPU 2]: 11
[2024-01-18 18:05:24.684]      tx packets [CPU 3]: 1
[2024-01-18 18:05:24.684]      tx packets [TOTAL]: 70
[2024-01-18 18:05:24.684]      tx recycled [CPU 0]: 0
[2024-01-18 18:05:24.684]      tx recycled [CPU 1]: 0
[2024-01-18 18:05:24.684]      tx recycled [CPU 2]: 0
[2024-01-18 18:05:24.684]      tx recycled [CPU 3]: 0
[2024-01-18 18:05:24.684]      tx recycled [TOTAL]: 0
[2024-01-18 18:05:24.684]      tx confirm [CPU 0]: 22
[2024-01-18 18:05:24.684]      tx confirm [CPU 1]: 13
[2024-01-18 18:05:24.684]      tx confirm [CPU 2]: 22
[2024-01-18 18:05:24.684]      tx confirm [CPU 3]: 13
[2024-01-18 18:05:24.684]      tx confirm [TOTAL]: 70
[2024-01-18 18:05:24.684]      tx S/G [CPU 0]: 0
[2024-01-18 18:05:24.684]      tx S/G [CPU 1]: 0
[2024-01-18 18:05:24.684]      tx S/G [CPU 2]: 0
[2024-01-18 18:05:24.684]      tx S/G [CPU 3]: 0
[2024-01-18 18:05:24.684]      tx S/G [TOTAL]: 0
[2024-01-18 18:05:24.684]      rx S/G [CPU 0]: 0
[2024-01-18 18:05:24.684]      rx S/G [CPU 1]: 0
[2024-01-18 18:05:24.684]      rx S/G [CPU 2]: 0
[2024-01-18 18:05:24.684]      rx S/G [CPU 3]: 0
[2024-01-18 18:05:24.684]      rx S/G [TOTAL]: 0
[2024-01-18 18:05:24.684]      tx error [CPU 0]: 0
[2024-01-18 18:05:24.684]      tx error [CPU 1]: 0
[2024-01-18 18:05:24.689]      tx error [CPU 2]: 0
[2024-01-18 18:05:24.689]      tx error [CPU 3]: 0
[2024-01-18 18:05:24.689]      tx error [TOTAL]: 0
[2024-01-18 18:05:24.689]      rx error [CPU 0]: 0
[2024-01-18 18:05:24.689]      rx error [CPU 1]: 0
[2024-01-18 18:05:24.689]      rx error [CPU 2]: 0
[2024-01-18 18:05:24.689]      rx error [CPU 3]: 0
[2024-01-18 18:05:24.689]      rx error [TOTAL]: 0
[2024-01-18 18:05:24.689]      bp count [CPU 0]: 88
[2024-01-18 18:05:24.689]      bp count [CPU 1]: 93
[2024-01-18 18:05:24.689]      bp count [CPU 2]: 82
[2024-01-18 18:05:24.689]      bp count [CPU 3]: 120
[2024-01-18 18:05:24.689]      bp count [TOTAL]: 383
[2024-01-18 18:05:24.689]      rx dma error: 0
[2024-01-18 18:05:24.689]      rx frame physical error: 0
[2024-01-18 18:05:24.689]      rx frame size error: 0
[2024-01-18 18:05:24.689]      rx header error: 0
[2024-01-18 18:05:24.689]      rx csum error: 0
[2024-01-18 18:05:24.689]      qman cg_tdrop: 0
[2024-01-18 18:05:24.689]      qman wred: 0
[2024-01-18 18:05:24.689]      qman error cond: 0
[2024-01-18 18:05:24.689]      qman early window: 0
[2024-01-18 18:05:24.689]      qman late window: 0
[2024-01-18 18:05:24.689]      qman fq tdrop: 0
[2024-01-18 18:05:24.689]      qman fq retired: 0
[2024-01-18 18:05:24.689]      qman orp disabled: 0
[2024-01-18 18:05:24.689]      congestion time (ms): 0
[2024-01-18 18:05:24.689]      entered congestion: 0
[2024-01-18 18:05:24.689]      congested (0/1): 0

#find /sys/devices/  -name 'port_frame' -exec cat {} \;
[2024-01-18 18:05:28.800] 	fm0-port-rx1 counter: 0
[2024-01-18 18:05:28.800] 	fm0-port-rx2 counter: 107
[2024-01-18 18:05:28.800] 	FM Port not configured...
[2024-01-18 18:05:28.805] 	fm0-port-rx4 counter: 2852
[2024-01-18 18:05:28.805] 	fm0-port-tx5 counter: 8
[2024-01-18 18:05:28.805] 	FM Port not configured...
[2024-01-18 18:05:28.805] 	FM Port not configured...
[2024-01-18 18:05:28.805] 	fm0-port-rx0 counter: 173
[2024-01-18 18:05:28.805] 	fm0-port-tx1 counter: 8
[2024-01-18 18:05:28.805] 	fm0-port-tx2 counter: 8
[2024-01-18 18:05:28.805] 	fm0-port-tx4 counter: 1164
[2024-01-18 18:05:28.805] 	FM Port not configured...
[2024-01-18 18:05:28.805] 	fm0-port-rx5 counter: 0
[2024-01-18 18:05:28.805] 	FM Port not configured...
[2024-01-18 18:05:28.805] 	FM Port not configured...
[2024-01-18 18:05:28.805] 	fm0-port-tx0 counter: 77

#find /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net /eth1/statistics/* -exec cat {} \;
[2024-01-18 18:05:34.536] 0
[2024-01-18 18:05:34.536] 0
[2024-01-18 18:05:34.536] 24228
[2024-01-18 18:05:34.536] 0
[2024-01-18 18:05:34.536] 0
[2024-01-18 18:05:34.536] 1
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 141
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 10682
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 0
[2024-01-18 18:05:34.540] 83
[2024-01-18 18:05:34.540] 0

# find /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net /eth1/upper_eth1.3/statistics/* -exec cat {} \;
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.074] 13728
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.074] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 90
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 11098
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.092] 0
[2024-01-18 18:05:39.111] 0
[2024-01-18 18:05:39.111] 0
[2024-01-18 18:05:39.111] 83
[2024-01-18 18:05:39.111] 0

# cat /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net/ eth1/mac_tx_stats
[2024-01-18 18:05:43.436] ------- 
[2024-01-18 18:05:43.436] 
[2024-01-18 18:05:43.896] 
[2024-01-18 18:05:43.896] FM MAC - MEMAC -0 Tx stats (0xFFFF8000801D6000)
[2024-01-18 18:05:43.896] ----------------------------------------
[2024-01-18 18:05:43.896] 
[2024-01-18 18:05:43.896] 0xFFFF8000801D6200: 0x00003236        	teoct_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D6204: 0x00000000        	teoct_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6208: 0x00003236        	toct_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D620C: 0x00000000        	toct_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6218: 0x00000000        	txpf_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D621C: 0x00000000        	txpf_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6220: 0x0000005f        	tfrm_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D6224: 0x00000000        	tfrm_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6228: 0x00000000        	tfcs_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D622C: 0x00000000        	tfcs_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6230: 0x00000057        	tvlan_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D6234: 0x00000000        	tvlan_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6238: 0x00000000        	terr_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D623C: 0x00000000        	terr_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6240: 0x00000041        	tuca_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D6244: 0x00000000        	tuca_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6248: 0x00000010        	tmca_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D624C: 0x00000000        	tmca_u
[2024-01-18 18:05:43.896] 0xFFFF8000801D6250: 0x0000000e        	tbca_l
[2024-01-18 18:05:43.896] 0xFFFF8000801D6254: 0x00000000        	tbca_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6260: 0x0000005f        	tpkt_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D6264: 0x00000000        	tpkt_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6268: 0x00000000        	tund_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D626C: 0x00000000        	tund_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6270: 0x00000006        	t64_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D6274: 0x00000000        	t64_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6278: 0x00000046        	t127_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D627C: 0x00000000        	t127_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6280: 0x00000000        	t255_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D6284: 0x00000000        	t255_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6288: 0x00000013        	t511_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D628C: 0x00000000        	t511_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6290: 0x00000000        	t1023_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D6294: 0x00000000        	t1023_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D6298: 0x00000000        	t1518_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D629C: 0x00000000        	t1518_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D62A0: 0x00000000        	t1519x_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D62A4: 0x00000000        	t1519x_u
[2024-01-18 18:05:43.901] 0xFFFF8000801D62C0: 0x00000000        	tcnp_l
[2024-01-18 18:05:43.901] 0xFFFF8000801D62C4: 0x00000000        	tcnp_u

# cat /sys/devices/platform/fsl,dpaa/fsl,dpaa:ethernet@1/net/ eth1/mac_rx_stats
[2024-01-18 18:05:49.094] ------- 
[2024-01-18 18:05:49.094] 
[2024-01-18 18:05:49.094] 
[2024-01-18 18:05:49.094] FM MAC - MEMAC -0 Rx stats (0xFFFF8000801D6000)
[2024-01-18 18:05:49.094] ----------------------------------------
[2024-01-18 18:05:49.094] 
[2024-01-18 18:05:49.094] 0xFFFF8000801D6100: 0x0000b0b2        	reoct_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D6104: 0x00000000        	reoct_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6108: 0x0000b0b2        	roct_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D610C: 0x00000000        	roct_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6110: 0x00000000        	raln_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D6114: 0x00000000        	raln_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6118: 0x00000000        	rxpf_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D611C: 0x00000000        	rxpf_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6120: 0x000000e0        	rfrm_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D6124: 0x00000000        	rfrm_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6128: 0x00000000        	rfcs_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D612C: 0x00000000        	rfcs_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6130: 0x00000064        	rvlan_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D6134: 0x00000000        	rvlan_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6138: 0x00000000        	rerr_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D613C: 0x00000000        	rerr_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6140: 0x00000060        	ruca_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D6144: 0x00000000        	ruca_u
[2024-01-18 18:05:49.094] 0xFFFF8000801D6148: 0x0000002c        	rmca_l
[2024-01-18 18:05:49.094] 0xFFFF8000801D614C: 0x00000000        	rmca_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6150: 0x00000054        	rbca_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D6154: 0x00000000        	rbca_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6158: 0x00000000        	rdrp_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D615C: 0x00000000        	rdrp_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6160: 0x000000e0        	rpkt_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D6164: 0x00000000        	rpkt_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6168: 0x00000000        	rund_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D616C: 0x00000000        	rund_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6170: 0x0000002e        	r64_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D6174: 0x00000000        	r64_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6178: 0x00000063        	r127_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D617C: 0x00000000        	r127_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6180: 0x00000010        	r255_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D6184: 0x00000000        	r255_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6188: 0x00000023        	r511_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D618C: 0x00000000        	r511_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6190: 0x0000001c        	r1023_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D6194: 0x00000000        	r1023_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D6198: 0x00000000        	r1518_l
[2024-01-18 18:05:49.101] 0xFFFF8000801D619C: 0x00000000        	r1518_u
[2024-01-18 18:05:49.101] 0xFFFF8000801D61A0: 0x00000000        	r1519x_l
[2024-01-18 18:05:49.105] 0xFFFF8000801D61A4: 0x00000000        	r1519x_u
[2024-01-18 18:05:49.105] 0xFFFF8000801D61A8: 0x00000000        	rovr_l
[2024-01-18 18:05:49.105] 0xFFFF8000801D61AC: 0x00000000        	rovr_u
[2024-01-18 18:05:49.105] 0xFFFF8000801D61B0: 0x00000000        	rjbr_l
[2024-01-18 18:05:49.105] 0xFFFF8000801D61B4: 0x00000000        	rjbr_u
[2024-01-18 18:05:49.105] 0xFFFF8000801D61B8: 0x00000000        	rfrg_l
[2024-01-18 18:05:49.105] 0xFFFF8000801D61BC: 0x00000000        	rfrg_u
[2024-01-18 18:05:49.105] 0xFFFF8000801D61C0: 0x00000000        	rcnp_l
[2024-01-18 18:05:49.105] 0xFFFF8000801D61C4: 0x00000000        	rcnp_u
[2024-01-18 18:05:49.105] 0xFFFF8000801D61C8: 0x00000000        	rdrntp_l
[2024-01-18 18:05:49.105] 0xFFFF8000801D61CC: 0x00000000        	rdrntp_u

yipingwang · ‎01-21-2024

You are using multiple Ethernet ports now.

Please check the exact port of DPAA statics with the following command.

/sys/devices/platform/soc/1a00000.fman/*.port/statistics/port_frame

For the port number, please refer to qoriq-fman3-*-1g-*.dtsi in Linux Kernel dts file.

For example, for FM1 mEMAC1: 1AE_0000h, the tx port number is 0x1aa8000

jiafang · ‎04-08-2024

We reproduced this issue again. Please check the logs:
# find /sys/devices/platform/soc/1a00000.fman/1a88000.port/st atistics/* -exec cat {} \;
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 36796
fm0-port-rx0 counter: 36796
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0
fm0-port-rx0 counter: 0

# find /sys/devices/platform/soc/1a00000.fman/1aa8000.port/st atistics/* -exec cat {} \;
fm0-port-tx0 counter: 13513
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 0
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 0
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 13381
fm0-port-tx0 counter: 0
fm0-port-tx0 counter: 0

jiafang · ‎01-24-2024

OK, We will do the next reproduce for those info.

BTW, I have one more question, we found that after dpa_xmit() the broadcast packet such as DHCPDISCOVER and DHCPREQUEST, there will be a tx irq hardware event to call portal_isr() and a rx hardware irq evernt to call portal_isr().
Could you tell me which code triggers this kind of irq events ?

yipingwang · ‎01-02-2024

Please check FMAN counters from sysfs and MAC counters.

An example of quick dumping of FMAN counters from sysfs(these represent FMBM_RFRC):

find /sys/devices/ -name 'port_frame' -exec cat {} \;

fm0-port-rx5 counter: 0

fm0-port-tx4 counter: 0

FM Port not configured...

fm0-port-tx0 counter: 1365

FM Port not configured...

fm0-port-tx7 counter: 0

fm0-port-rx4 counter: 47279872

FM Port not configured...

fm0-port-rx0 counter: 6800

fm0-port-tx5 counter: 43045909

fm0-port-oh1 counter: 0

FM Port not configured...

fm0-port-rx7 counter: 0

FM Port not configured...

MAC counters:

They can be found here:

cat /sys/devices/platform/soc/soc:fsl,dpaa/soc:fsl,dpaa:ethernet@2/net/eth2/mac_tx_stats

cat /sys/devices/platform/soc/soc:fsl,dpaa/soc:fsl,dpaa:ethernet@2/net/eth2/mac_rx_stats

Note in case the sysfs entries differ from above, identify the counters by:

find / -name "mac_tx_stats"

jiafang · ‎01-17-2024

Thanks very much for the info.
After the issue reproduced, we will show those info here.
Please wait for the reproduce. Thanks.