2090755_en-US

[LX2160ARDB-Rev C] 25G port in U-boot

Hi,

I am trying to use SFP+ (10G) with the LX2160ARDB (rev C) from U-boot.
FYI my QSFP link (40G) is already properly working from U-Boot.

It may sound like a duplicate of "[LX2160ARDB-Rev C] 25G port compatibility", solved with "Modify LX2160ARDB SFPs from 25G to 10G".
However it doesn't solve my problem yet.

I currently develop from LLDP, not from lsdk2108 as described in the pdf file. I just ported the different modifications.
I want to use these SFP+ interfaces from U-boot, not from Linux.
I had to modify the provided PBI instructions:
- to keep my QSFP interface working:
  "write 0x01EA10B0, 0x99999999" --> "write 0x01EA10B0, 0x88889999"
- to get my router SFP+ links up:
  "write 0x01EA0D30, 0x10808307" --> "write 0x01EA0D30, 0x10808000"
  It somehow replicates the Serdes configuration of the QSFP, 4x10G, for my 1x10G SFP+.
  This way my router detects an uplink, with both my "SFP+ - SFP+ 10G" cable and my "SFP28 - SFP28 (25G)" cable (which supports 1G/10G/25G).

So now links are up, but I you can guess I don't see packets (yet).

Would you have some info or experience regarding these "25G to 10G" modifications in LLDP (hence for Yocto) and would you know how to use these SFP+ (10G) from u-boot?

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Hi

Since our last messages I mainly tried (for some time) to use the 25G ports from Linux, using the LSDK21.08 link you kindly provided (and even the LSDK24.12), without success so far. Hence I guess it could come from my SFP28 adapters, from my LX2160ARDB board configuration, from my network switch... or from some software configuration.

I trust you when you tell me 25G link is working. Usually you ask people to send logs to show errors they get. Could we make it the other way round : as it is working on your side could you just send me (existing) logs showing it working (from power up, u-boot, linux, network config, ping)? That way I could easily see how different my system is.
Can you provide me such logs?

FYI next step I am also going to try is "network communication over the 25G link between 2 LX2160ARDB", this way I should see whether the network switch is responsible for my problem.

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Would you try the LSDK2108 and LSDK2412 follow the default setting on the LX2160ARDB-REV2?

Both in the Linux could be tested for the 25G and 10G.

Such command:

LSDK21.08, page 65

To automatically download and deploy LSDK images to the target storage drive on a Linux host machine or a reference board.

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Just to add more info about when the 25G link goes up or down:

25G link goes UP after (or during) a call to "in112525_s03_lane_recovery(4)" ('4' meaning 'ALL_LANES') from 'in112525_s03_phy_init()'.

Then during my 'ping' command my 25G link goes DOWN after a call
- to 'in112525_s03_lane_recovery(3)' (for DPMAC5@25g-aui)
- to 'in112525_s03_lane_recovery(2)' (for DPMAC6@25g-aui)

So during a 'lane recovery ALL_LANES' link goes UP, but after a 'single lane recovery' link goes down...

Other info: When debug trace are enabled in the 'in112525.c' files I always get a
'TX PLL not locked on ALL lanes' message during the call to "in112525_s03_lane_recovery(ALL_LANES)" but NO error message "TX PLL not locked on lane %d\n" appears later during the ping and the 'single lane recovery' so in theory my 'TX PLL is properly locked on the lane we try to use'... however my 25G goes down.

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Hi,

I attached log files of u-boot & linux tests, with 2 binaries version.
"MC 10.35" logs are done booting my current build, boot from SD card,
"MC 10.24" when booting from the native LX2160ARDB binaries in xspi flash.

Regarding Linux, for now with both versions (SD/xspi boot) I don't see any network interface and the "ls-listni", "ls-listmac", "ls-addni"... return "error: Did not find a device file".
So I guess I need to configure something, just started investigating.

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Please share your full-logs in the u-boot, how about the Linux result?

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Hi

Thanks for your answer "If you insert the SFP-25G-SR into the LX2160ARDB(setting to 25G), and other device is the same SFP28(SFP-25G-SR, with 25G setting) you could use it as 25G, it could be used without other setting.".

Now with two identical SFP-25G-SR and an OM4 optical fiber.

Board configured to boot from the original ATF + u-boot installed on my LX2160ARDB rev C3:
"BL2: v2.3():v2.3-LSDK-20.12" + "U-Boot 2020.04-00006-g0f2cfcb048 (Apr 19 2021 - 22:20:08 +0530)".

ethprime=DPMAC5@25g-aui.

After board reboot and u-boot start my 25G link goes up.
However, as soon as I launch a 'ping' (from u-boot) the link goes down and (of course) ping fails.

Sure I am also going to try with Linux (just to validate my HW & network config, I don't want to use Linux), then also with MC 10.38 as you suggested... but isn't it supposed to work 'out of the box' with my ATF & U-boot versions? What do I miss?

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

If you insert the SFP-25G-SR into the LX2160ARDB(setting to 25G), and other device is the same SFP28(SFP-25G-SR, with 25G setting) you could use it as 25G, it could be used without other setting.

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

Hi

Thanks for your answer. I currently use MC version 10.35, so I am going to try 10.38 .

In the meantime I want to confirm everything is working in the 'native' 25G mode.
I plan to use Mellanox MMA2P00-AS as shown in LX2RDBKIT2-25G content description (or compatible FS SFP-25GSR-85) SFP28 adapters.
Can you confirm that communication with such SFP28 (between 2 LX2160ARDB boards or a LX2160ARDB + router with SPF28) will work 'out of the box' in native 25G mode?

Thanks

Re: [LX2160ARDB-Rev C] 25G port in U-boot

MC version 10.38 could change the support for 10G <-> 25G reconfiguration in the LX2160A.

Please see the following documentation chapter - https://docs.nxp.com/bundle/UG10143/page/topics/Ethernet_Serdes.html

Thanks