P-Series中的主题 Re: P4080DS Bad Network Performance

P4080DS Bad Network Performance

sharathchandra — Fri, 27 Mar 2015 15:22:56 GMT

Hi,

I got a new P4080DS board, and tried a sample UDP sender program on the board to send packets, but I see there is a packet loss. I am no table to find it in DPA counters, or when I check under command "ethtool fm1-gb1", the tx errors it show as 0.

I am sure they are lost inside the board itself, as even when I connect the board directly to another system, I see packet loss. I even tried changing the cable but no use.

If I try to send some 17 or 18 packets at once, there is always a loss. I wanted to send more packets from my telecom application otherwise it is of no use.

Could any one please suggest on how to find the cause/ and resolve this issue?

Thanks,

Sharath Chandra

Re: P4080DS Bad Network Performance

adeel — Mon, 30 Mar 2015 07:34:37 GMT

Hi,

Did you check the BMI counters?

Re: P4080DS Bad Network Performance

sharathchandra — Mon, 30 Mar 2015 12:54:39 GMT

Hi,

Yes, I checked both in BMI counters and DPA counters. The Tx packets which are lost somewhere in the system are not shown either in BMAN, FMAN or QMAN.

And one more thing, could you please suggest on how do I check the MAC counters on the board?

Counters info:

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_dealloc_buf

fm0-port-tx1 counter: 0

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_deq_from_default

fm0-port-tx1 counter: 0

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_discard_frame

fm0-port-tx1 counter: 0

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_frame

fm0-port-tx1 counter: 462128

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_unsupprted_format

fm0-port-tx1 counter: 0

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_deq_confirm

fm0-port-tx1 counter: 467478

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_deq_total

fm0-port-tx1 counter: 468954

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_enq_total

fm0-port-tx1 counter: 470972

root@p4080ds:/sys# cat devices/ffe000000.soc/ffe400000.fman/ffe4a9000.port/statistics/port_length_err

fm0-port-tx1 counter: 0

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_errors

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_heartbeat_errors

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_packets

201591

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_window_errors

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_aborted_errors

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_dropped

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_carrier_errors

root@p4080ds:/sys# cat class/net/fm1-gb1/statistics/tx_compressed

root@p4080ds:/sys#

(For your information, there are Rx errors displayed in BMI counters and also under ethtool as rx errors, which is not an issue for my application, my one and only concern was about Tx frames, which are lost and not displayed anywhere).

Thanks,

Sharath Chandra

Re: P4080DS Bad Network Performance

lunminliang — Thu, 02 Apr 2015 02:38:01 GMT

Hi Sharath Chandra,

Can you please share your code?

Have a great day,

Lunmin

Re: P4080DS Bad Network Performance

sharathchandra — Wed, 08 Apr 2015 12:03:05 GMT

Hi Lunmin,

I want to send a lot of packets at once, as it was not working for my application, I tried to test with a sample udp program, which just sends packet to other destination.

Please find the code below:

#include <sys/socket.h>

#include <netinet/in.h>

#include <stdio.h>

#include <string.h>

#include <stdlib.h>

int main()

{

int sockfd = 0, n = 0;

struct sockaddr_in servaddr,cliaddr;

char sendline[1400];

memset(&sendline,'\0',sizeof(sendline));

memset(&servaddr,'\0',sizeof(servaddr));

for(n = 0;n < 1400; n++)

sendline[n] = 'a';

sockfd=socket(AF_INET,SOCK_DGRAM,0);

servaddr.sin_family = AF_INET;

servaddr.sin_addr.s_addr=inet_addr("10.10.10.155");

servaddr.sin_port=htons(32000);

n=0;

{

sendto(sockfd,sendline,strlen(sendline),0, \

(struct sockaddr *)&servaddr,sizeof(servaddr));

n++;

}while (n < 800);

return 0;

}

I experienced packet loss in the above code too. The packet loss is variable, but it is there most of the times.

I checked DPA counters and BMI counters for packet loss but did not find anything, and how do I check the MAC counters?

Probably thinking they are lost at the MAC.

Do I have to set any PCD policy in the board using FMC tool?

Thanks,

Sharath Chandra

Re: P4080DS Bad Network Performance

adeel — Mon, 13 Apr 2015 14:01:59 GMT

Hi Sharath,

When you say you are sending 16-17 UDP packets in one go, it is nothing for Kernel and definitely not for Hardware. I have tried with the same P4080 about tens of thousands of packets and I never saw any single drop. They can be overflowed in Kernel UDP stack which you can check with netstat or other statistics commands. The MAC statistics were correct:

cat class/net/fm1-gb1/statistics/tx_packets... it will show you tx'd packets

Could you please explain your system setup? Which DTB files are you using? are you running any DPAA application?

You can first transmit 100 packets and check in netstat if they are queued in UDP stack, later check it in MAC counters and then BMI.

Adeel

Re: P4080DS Bad Network Performance

lunminliang — Thu, 16 Apr 2015 06:37:20 GMT

Hello Sharath Chandra,

What's your host IP address, and whether is the target host (10.10.10.155) is alive or not? In other words, if your run the command "ping 10.10.10.155", does it works or not? How do you conclude the packet loss? In your code, you do not assert the return value of sendto.

Regards

Lunmin