Having problem using the Windows USB3 API with USB3 Loopback Plugs

[fsim]

Hi,
We just bought USB3.0 Loopback plugs. The objective is to use them with your windows USB3 Application Programming Interface in our own application.
After fixing some issues with the API, I still have a major problem I don't understand.

I run a Benchmark Read-then-Write test in a loop. I have about 2.2-2.5 Gb/s in both way 6 to 15 times. After that, bandwidth is almost halved.

I was wondering if anyone else have seen this issue or if it is a known problem?

With the debug I made, I noticed that the time to transfert the exact same amount of DATA doubled.

QueryPerformanceCounter(&t0);    //Get current high res counter value
BenchmarkContext = params->InEndpt->BeginDataXfer(BMinBuffer, CurrentTransferSize, &params->BenchmarkOvLapRead);
WaitResult = params->InEndpt->WaitForXfer(&params->BenchmarkOvLapRead, 500); 
QueryPerformanceCounter(&t1);    //Get current high res counter value

I use :
Cypress EZ-USB FX3 SDK V1.3
4x Passmark USB3.0 Loopback with Firmware V1.4 (Problems also happens with only 1 plug)
Intel i7 3.4GHz with 12Gb of RAM

Thanks,
fsim

[Tim (PassMark)]

Do you have the same issues when using USB3Test (http://www.passmark.com/products/usb3test.htm) to run a number of benchmark tests in a row?

Does the USB3 plug show the same behavior on different USB3 ports or on another system?

[fsim]

Thanks for replying

Yes I have the same problem with other ports on other computers
I was using the API i found there : http://www.passmark.com/products/usb3api.htm and I had the same issue.

I just tried the application usb3Tester you mentionned in your last post and yes I have the same issue. Here is the log and the step I made to reproduce the error :

1. Duration 1 Minute
2. Bulk Endpoint
3. Benchmark
4. Read Then Write
(All the rest is default)

I pressed Start -> Stop -> Start -> Stop -> .... severals times

I have a nice bandwidth until an error happens and then Bandwidth is Halved

I'm having trouble attaching logfile (Invalid format) i'll post certain sections of it in the next post but if you have an Email I could send them there.

[fsim]

PASSMARK USB3.0Test Log file
==========================
Number of records logged: 3000


Fri Nov 15 08:15:16 2013: Benchmark - Write and Read Status: Loop 2924, Speed 748.2 Mb/s (93.5 MB/s)
Fri Nov 15 08:15:16 2013: Benchmark - Write and Read Status: Loop 2925, Speed 777.0 Mb/s (97.1 MB/s)
[...]
Fri Nov 15 08:15:18 2013: Benchmark - Write and Read Status: Loop 4059, Speed 889.5 Mb/s (111.2 MB/s)
Fri Nov 15 08:15:18 2013: Benchmark - Write and Read Status: Loop 4060, Speed 885.7 Mb/s (110.7 MB/s)
Fri Nov 15 08:15:18 2013: Benchmark - Write and Read Status: Loop 4061, Speed 840.8 Mb/s (105.1 MB/s)
Fri Nov 15 08:15:18 2013: Benchmark - Write and Read Status: Loop 4062, Speed 730.4 Mb/s (91.3 MB/s)
Fri Nov 15 08:15:18 2013: Benchmark - Write and Read Status: Loop 4063, Speed 745.5 Mb/s (93.2 MB/s)
Fri Nov 15 08:15:18 2013: PASS - RESULTS:
Fri Nov 15 08:15:18 2013: PASS - Test Start time: Fri Nov 15 08:15:12 2013
Fri Nov 15 08:15:18 2013: PASS - Duration: 000h 00m 05s
Fri Nov 15 08:15:18 2013: PASS - 4063 operations. 0 verification errors.
Fri Nov 15 08:15:18 2013: Loopback - END OF USB LOOPBACK TEST
Fri Nov 15 08:15:24 2013: Information- Starting plug re-enumeration due to config change
Fri Nov 15 08:15:24 2013: Information- PMYL1S0H (SuperSpeed) re-enumerated
Fri Nov 15 08:15:26 2013: Benchmark - START OF USB BENCHMARK TEST
Fri Nov 15 08:15:26 2013: Loopback - Device: FX3-0 (SuperSpeed)
Fri Nov 15 08:15:26 2013: Benchmark - READING FROM USB DEVICE (4194304 byte blocks).
Fri Nov 15 08:15:26 2013: Benchmark - (1) Read: 2169.6 Mb/s (271.2 MB/s)
Fri Nov 15 08:15:26 2013: Benchmark - (1) Read: 2416.4 Mb/s (302.0 MB/s)
Fri Nov 15 08:15:26 2013: Benchmark - (1) Read: 2432.0 Mb/s (304.0 MB/s)
[...]
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2403.6 Mb/s (300.4 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2409.9 Mb/s (301.2 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2412.7 Mb/s (301.6 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2411.1 Mb/s (301.4 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2412.8 Mb/s (301.6 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2412.2 Mb/s (301.5 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - (1) Read: 2408.5 Mb/s (301.1 MB/s)
Fri Nov 15 08:15:32 2013: Benchmark - OVERALL BENCHMARK RESULT:
Fri Nov 15 08:15:32 2013: Benchmark - Test Start time: Fri Nov 15 08:15:26 2013
Fri Nov 15 08:15:32 2013: Benchmark - Duration: 000h 00m 05s
Fri Nov 15 08:15:32 2013: Benchmark - Maximum Read Data Rate: 2497.2 Mb/s
Fri Nov 15 08:15:32 2013: Benchmark - Average Read Data Rate: 2412.8 Mb/s
Fri Nov 15 08:15:32 2013: Benchmark - Average Data Rate: 2412.8 Mb/s
Fri Nov 15 08:15:32 2013: Benchmark - Minimum Data Rate: 2169.6 Mb/s
Fri Nov 15 08:15:44 2013: Benchmark - START OF USB BENCHMARK TEST
Fri Nov 15 08:15:44 2013: Loopback - Device: FX3-0 (SuperSpeed)
Fri Nov 15 08:15:44 2013: Benchmark - (1) Read: 2408.5 Mb/s (301.1 MB/s)
Fri Nov 15 08:15:44 2013: Benchmark - (1) Read: 2312.4 Mb/s (289.0 MB/s)
Fri Nov 15 08:15:44 2013: Benchmark - (1) Write: 2697.5 Mb/s (337.2 MB/s)
Fri Nov 15 08:15:44 2013: Benchmark - (1) Read: 2371.2 Mb/s (296.4 MB/s)
Fri Nov 15 08:15:44 2013: Benchmark - (1) Write: 2781.2 Mb/s (347.6 MB/s)
[...]
Fri Nov 15 08:15:49 2013: Benchmark - (1) Read: 2409.6 Mb/s (301.2 MB/s)
Fri Nov 15 08:15:49 2013: Benchmark - (1) Write: 2669.3 Mb/s (333.7 MB/s)
Fri Nov 15 08:15:49 2013: Benchmark - (1) Read: 2411.4 Mb/s (301.4 MB/s)
Fri Nov 15 08:15:49 2013: Benchmark - (1) Write: 2746.3 Mb/s (343.3 MB/s)
Fri Nov 15 08:15:49 2013: Benchmark - OVERALL BENCHMARK RESULT:
Fri Nov 15 08:15:49 2013: Benchmark - Test Start time: Fri Nov 15 08:15:44 2013
Fri Nov 15 08:15:49 2013: Benchmark - Duration: 000h 00m 04s
Fri Nov 15 08:15:49 2013: Benchmark - Maximum Write Data Rate: 2838.9 Mb/s
Fri Nov 15 08:15:49 2013: Benchmark - Maximum Read Data Rate: 2439.2 Mb/s
Fri Nov 15 08:15:49 2013: Benchmark - Average Write Data Rate: 2684.7 Mb/s
Fri Nov 15 08:15:49 2013: Benchmark - Average Read Data Rate: 2405.8 Mb/s
Fri Nov 15 08:15:49 2013: Benchmark - Average Data Rate: 2537.3 Mb/s
Fri Nov 15 08:15:49 2013: Benchmark - Minimum Data Rate: 2312.4 Mb/s
Fri Nov 15 08:15:51 2013: Benchmark - START OF USB BENCHMARK TEST
Fri Nov 15 08:15:51 2013: Loopback - Device: FX3-0 (SuperSpeed)
Fri Nov 15 08:15:51 2013: Benchmark - (1) Read: 2411.4 Mb/s (301.4 MB/s)
Fri Nov 15 08:15:51 2013: Benchmark - (1) Write: 2746.3 Mb/s (343.3 MB/s)
Fri Nov 15 08:15:51 2013: Benchmark - (1) Read: 2302.5 Mb/s (287.8 MB/s)
Fri Nov 15 08:15:51 2013: Benchmark - (1) Write: 2728.7 Mb/s (341.1 MB/s)
[...]
Fri Nov 15 08:15:56 2013: Benchmark - (1) Read: 2408.7 Mb/s (301.1 MB/s)
Fri Nov 15 08:15:56 2013: Benchmark - (1) Write: 2684.6 Mb/s (335.6 MB/s)
Fri Nov 15 08:15:56 2013: Benchmark - (1) Read: 2410.3 Mb/s (301.3 MB/s)
Fri Nov 15 08:15:56 2013: Benchmark - (1) Write: 2650.0 Mb/s (331.3 MB/s)
Fri Nov 15 08:15:56 2013: Benchmark - OVERALL BENCHMARK RESULT:
Fri Nov 15 08:15:56 2013: Benchmark - Test Start time: Fri Nov 15 08:15:51 2013
Fri Nov 15 08:15:56 2013: Benchmark - Duration: 000h 00m 05s
Fri Nov 15 08:15:56 2013: Benchmark - Maximum Write Data Rate: 2902.7 Mb/s
Fri Nov 15 08:15:56 2013: Benchmark - Maximum Read Data Rate: 2491.9 Mb/s
Fri Nov 15 08:15:56 2013: Benchmark - Average Write Data Rate: 2674.0 Mb/s
Fri Nov 15 08:15:56 2013: Benchmark - Average Read Data Rate: 2409.4 Mb/s
Fri Nov 15 08:15:56 2013: Benchmark - Average Data Rate: 2534.8 Mb/s
Fri Nov 15 08:15:56 2013: Benchmark - Minimum Data Rate: 2302.5 Mb/s
Fri Nov 15 08:15:58 2013: Benchmark - START OF USB BENCHMARK TEST
Fri Nov 15 08:15:58 2013: Loopback - Device: FX3-0 (SuperSpeed)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2410.3 Mb/s (301.3 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2650.0 Mb/s (331.3 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2302.9 Mb/s (287.9 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2620.5 Mb/s (327.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2409.6 Mb/s (301.2 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2661.0 Mb/s (332.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2399.7 Mb/s (300.0 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2629.9 Mb/s (328.7 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2401.6 Mb/s (300.2 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2674.1 Mb/s (334.3 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2405.0 Mb/s (300.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2629.0 Mb/s (328.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2405.9 Mb/s (300.7 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2735.0 Mb/s (341.9 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2404.1 Mb/s (300.5 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2626.0 Mb/s (328.2 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2405.8 Mb/s (300.7 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2676.5 Mb/s (334.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2420.5 Mb/s (302.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2627.7 Mb/s (328.5 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2399.9 Mb/s (300.0 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2704.9 Mb/s (338.1 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2407.9 Mb/s (301.0 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Write: 2636.4 Mb/s (329.6 MB/s)
Fri Nov 15 08:15:58 2013: Benchmark - (1) Read: 2406.9 Mb/s (300.9 MB/s)
Fri Nov 15 08:15:59 2013: ERROR - Serial PMYL1S0H: Test start time: Fri Nov 15 08:15:58 2013
Fri Nov 15 08:15:59 2013: ERROR - Test Stopped due to Error: Benchmark write failed (996)
Fri Nov 15 08:15:59 2013: ERROR - Overlapped I/O event is not in a signaled state.
Fri Nov 15 08:15:59 2013: ERROR - Overlapped I/O operation is in progress.
Fri Nov 15 08:15:59 2013: Benchmark - (1) Write: 0.0 Mb/s (0.0 MB/s)
Fri Nov 15 08:15:59 2013: Benchmark - Errors 0, 0, 1
Fri Nov 15 08:17:08 2013: Benchmark - START OF USB BENCHMARK TEST
Fri Nov 15 08:17:08 2013: Loopback - Device: FX3-0 (SuperSpeed)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Read: 1916.4 Mb/s (239.6 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Read: 1300.8 Mb/s (162.6 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Write: 1297.6 Mb/s (162.2 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Read: 1330.2 Mb/s (166.3 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Write: 1312.1 Mb/s (164.0 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Read: 1336.5 Mb/s (167.1 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Write: 1323.1 Mb/s (165.4 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Read: 1330.9 Mb/s (166.4 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Write: 1316.7 Mb/s (164.6 MB/s)
Fri Nov 15 08:17:09 2013: Benchmark - (1) Write: 1339.9 Mb/s (167.5 MB/s)
[...]
Fri Nov 15 08:17:16 2013: Benchmark - (1) Write: 1334.0 Mb/s (166.8 MB/s)
Fri Nov 15 08:17:16 2013: Benchmark - (1) Read: 1317.7 Mb/s (164.7 MB/s)
Fri Nov 15 08:17:16 2013: Benchmark - (1) Read: 1332.9 Mb/s (166.6 MB/s)
Fri Nov 15 08:17:16 2013: Benchmark - (1) Write: 1319.5 Mb/s (164.9 MB/s)
Fri Nov 15 08:17:16 2013: Benchmark - (1) Read: 1335.7 Mb/s (167.0 MB/s)
Fri Nov 15 08:17:16 2013: Benchmark - OVERALL BENCHMARK RESULT:
Fri Nov 15 08:17:16 2013: Benchmark - Test Start time: Fri Nov 15 08:17:11 2013
Fri Nov 15 08:17:16 2013: Benchmark - Duration: 000h 00m 05s
Fri Nov 15 08:17:16 2013: Benchmark - Maximum Write Data Rate: 1351.3 Mb/s
Fri Nov 15 08:17:16 2013: Benchmark - Maximum Read Data Rate: 1351.2 Mb/s
Fri Nov 15 08:17:16 2013: Benchmark - Average Write Data Rate: 1319.0 Mb/s
Fri Nov 15 08:17:16 2013: Benchmark - Average Read Data Rate: 1324.3 Mb/s
Fri Nov 15 08:17:16 2013: Benchmark - Average Data Rate: 1321.7 Mb/s
Fri Nov 15 08:17:16 2013: Benchmark - Minimum Data Rate: 687.7 Mb/s

[Tim (PassMark)]

Our contact details are here, could you please send us the full log.

[fsim]

Problem is fixed in new release of the API
It was related to thread synchronisation

Thanks Tim