Failure in SVD test cases while WiFi Certification.

[Abhijeet_Therokar]

Hello NXP team,

We are performing WiFi certification for W8897 chipset having driver release package
SD-WLAN-SD-BT-8897-AO_LINUX_4_9_70-BG4CT-W15.68.19.p59-15.26.19.p59-C4X15698_B0B1-GPL.zip running on Android 11 OS.
While performing QTT test cases mentioned below:
CT_Security_WPA2Personal_STA_4wayHandshakeVulnerability-EncryptedM3Retransmission_10002_2
WFA lab reported 'The percentage of ARP packets received from the STAUT is not as expected' in case of SVD tests.

Kindly help us to identify the issue.

Attached are the log files of the failed test items.

BR,
Abhijeet Therokar

[weidong_sun]

Hello @nandan-khant ,

Official release will be placed on nxp website.

Regards,

weidong

[weidong_sun]

Hello @nandan-khant ,

I am waiting for feedback from internal team.

Regards,

weidong

[ocourson]

Dear @nandan-khant @Abhijeet_Therokar 

The release is available at nxp.com:

SD-WLAN-SD-BT-8897-AO_LINUX_4_9_70-BG4CT-W15.68.19.p59.1-15.26.19.p59.1-CS4X15698.P1_B0B1-GPL

Regards,

Olivier

[nandan-khant]

Hello @ocourson,

The customer is on vacation to celebrate the Chinese new year.

We will resume the testing and provide feedback once the customer is back.

Please wait and don't close the ticket.

Thanks and Regards,

Nandan Khant

[weidong_sun]

Hello @nandan-khant ,

According to questions on the link:

https://community.nxp.com/t5/Wireless-Connectivity/11nWPA2-test-case-failure-in-QTT/td-p/1567456

11nWPA2 test case failure in QTT

Issues on wpa2 connections to AP have not been resolved yet, Failure of other connections should not be avoidable.

On your side, 2 persions or more are responsible for the WFA Cert?

If yes, you had better submit questions  via one interface, which is very helpful for us to analyze issues step by step.

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,

This test case is different then the previously reported case. Please refer test case IDs.

The issue reported in this ticket have ID of 10002_2. However the issue reported in previous ticket are having IDs of 10280_1 and 10278_1.

It will be easier to track two different issues in two different tickets. So lets track it on different tickets.

The failure reason for this ticket is as follows:
The percentage of ARP packets received from the STAUT less than excepted.

Kindly check the logs and share the updates.

Thanks and Regards,

Nandan Khant

[nandan-khant]

Hello @weidong_sun,

Can you share the updates?

The issues are critical for us and we are already behind the planned schedule so we are expecting prompt response from NXP team.

Again, This issue is not similar as reported earlier in different ticket of 11nWPA2.

Thanks and Regards,

Nandan Khant

[weidong_sun]

Hello @Abhijeet_Therokar ,

The question of the post is the same as that of the link below:

https://community.nxp.com/t5/Wireless-Connectivity/11nWPA2-test-case-failure-in-QTT/m-p/1572263/emcs...

So let discuss it on above link, OK?

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,

This is a new failure case of the certification. This is different then reported earlier.

The failure test case ID is CT_Security_WPA2Personal_STA_4wayHandshakeVulnerability-EncryptedM3Retransmission_10002_2

Attaching the failure logs for your reference. Please share the updates.

If required please ask the internal team and share feedback from the internal team as well.

As we are already passed the expected timeline, I would request to get the responses as early as possible and consider this as the highest/critical priority issue. 

Thanks and Regards,

Nandan Khant

[weidong_sun]

Hello @nandan-khant ,

I will confirm your questions with internal team. and your question has been shared with internal team.

Let us wait for the analysis result from internal team.

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,
Any updates from your side or internal team?

Please help to share the updates. It is becoming a blocker for us.

Thanks and Regards,

Nandan Khant

[weidong_sun]

Hello @nandan-khant ,

Check below, please!

=========================

We have checked with the team and this issue is generally observed if Qualcomm AP is used.

As per QTT's Document, Qualcomm AP does not support this feature and we are supposed to use an Intel testbed device as the AP (tool platform).

Can you please help to confirm which Access Point is used while testing SVD?

=========================

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,

Lab is using Intel testbed AP for this test case.

Please refer the attached screenshot.

Let me know if any further details are required.

Thanks and Regards,

Nandan Khant

[nandan-khant]

Hello @weidong_sun,

Can you please share the updates?

Thanks and Regards,

Nandan Khant

[nandan-khant]

Hello @weidong_sun ,

Can you please check for the updates with the internal team and share if there are any?

Please help to share the updates by today EOD (IST), we might miss the scheduled timeline for the certification.

Thanks and Regards,

Nandan Khant

[weidong_sun]

Hello @nandan-khant ,

Internal team needs some logs, check below, please!

==========================

Can you please help get the test observation and complete logs with testBed DUT and Intel reference AP for this test?

==========================

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,

Please find the logs attached as requested with the testbed STA and Intel AP.

Please help to get the analysis of the failure case logs that we have shared previously.

Can you please ask the internal team to share the updates?

Thanks and Regards,

Nandan Khant 

[weidong_sun]

Hello @nandan-khant ,

Got it and shared it with internal team.

Thanks!

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,

Can you ask the internal team to share the updates?

Please help to share the analysis of logs and get the root cause of the issue as soon as possible.

Thanks and Regards,

Nandan Khant

[weidong_sun]

Hello @nandan-khant ,

I got feedback from internal team, check it, please!

============================

We are attaching a test FW (w8897_p255_combo.bin) with the potential fix. Please get the test results from the customer and logs.

File name: w8897_p255_combo.bin

md5sum: b7fc8fb3f61ac64aacd0333445bc1c3a

Please note, this is only for test case verification and should not use for other purpose, also this is not tested locally.

============================

I will send it to you via personal email, check it, please!

Regards,

weidong

[nandan-khant]

Hello @weidong_sun,

Thank you for sharing the updates.

Can you please share the test binary over email?

I have not received any test binary over email. Can you please share again, if already shared? 

Thanks and Regards,

Nandan Khant