Introduction
Background
There is not an official data for PCIe latency and performance, while some customers pay attention to and request these data. This paper utilizes Lmbench lat_mem_rd tool and DPDK qdma_demo to test the PCIe latency and performance separately.
Requirement
1) Plug Advantech iNIC (LX2160A) into LX2160ARDB.
2) Configure EP ATU outbound window at console.
3) Apply the patch to lmbench-3.0-a9, and recompile lmbench tool.
4) There is qdma_demo in iNIC kernel rootfs by default.
Test Environment
PCIe Latency Overview
|
Direction
|
Description
|
Latency(ns)
|
|
PCIe(Gen3 x8) – DDR
|
read from EP to RC
|
900
|
|
PCIe – PCIe – DDR
|
Read from EP to EP
(through CCN-508)
|
1550
|
|
PCIe – PCIe – DDR
|
Read from EP to EP
(through HSIO NOC)
|
1500
|
Setup
1) LX2160ARDB
2) iNIC – PCIe EP Gen3 x8 with LX2160A
3) Test App running at iNIC: Lmbench lat_mem_rd
# ./lat_mem_rd_pcie -P 1 -t 1m
PCIe Performance Overview
|
Direction
|
Throughput (Gbps)
|
|
PCIe EP to EP
|
50
|
Setup
1) LX2160ARDB
2) iNIC – PCIe EP Gen3 x8 with LX2160A
3) Test App : qdma_demo running at iNIC
$./qdma_demo -c 0x8001 -- --pci_addr=0x924fa00000 --packet_size=1024 --test_case=mem_to_pci
Peer to Peer On LX2 Rev. 2
Products
Tools