Test Report PCM-i7 Rogers LTE Lab December 2011

Overall Management Summary

-

PCM-i7 Performance Tests

-> No issues found

PCM-i7 USB Tests

-> No issues found

MCM Hookup Performance Tests

-> No issues found
-> Data measurement at 60Mbit/s didnt show any degradation if there is a voice measurement running (POLQA)

PCM CD vs. PCM-i7 Comparison

-> On PCM CD:
- Up to 30 Mbit/s, we are on the safe side
- Between 30 and 40 Mbit/s possible IP Trace packet loss
- Above 40 Mbit/s we have an impact on the throughput
-> On PCM-i7:
- No issues found

Lab Tests Sierra Wireless AirPrime MC7700

-> No issues found
-> Avg. throughput as expected ~60Mbit/s

Lab Tests Novatel Expedite E371

-> Throughput limited at 43Mbit/s (even with latest FW/HW)

Live Tests Huawei E398u-15

-> No issues found
-> ~65 Mbit/s

Results located here:

\\10.23.1.174\media\Measurement Files\Rogers Canada\2011\2011_12_16 LTE Tests PCM-i7\
and here:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\

PCM-i7 Performance Tests

PCM-i7 performs as expected at 60Mbit/s

MC7700 in Hookup - NO Phone - MCM FDDI Channels Disabled

-

Thats basically our reference at the moment since we cannot use the internal embedded module slot due to the
known issue with Sierra Wireless and the TI xHCI USB 3.0 controller.
The throughputs are as expected and correlate pretty much with the speedtest results (which reflects peak
throughputs)
CPU load around 35%
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime
MC7700\Hookup - NO Phone - MCM FDDI Disabled

MC7700 in Hookup Nokia C7 running POLQA in parallel

-

The throughputs are as expected, no significant influence

CPU load still around 35%
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime
MC7700\Hookup - Nokia C7 - POLQA

Remarks:
Were using a beta version of the 64bit IP Tracer which runs in a dedicated process. This seems to have a very good influence on
the CPU load. The IPTracer generates only around %10 CPU load. That is unexpected low. Plus, we havent seen *any* missing
packets from Netmon.

PCM-i7 USB Tests

All major combinations have been tested using Philips Capacity Test Tool. No significant influence has been seen.
Please refer to the screen shots in the respective folders:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\USB Tests\

MCM Hookup Performance Tests

NO Phone - MCM FDDI Disabled

Nokia C7 - POLQA

Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime MC7700\

PCM CD vs. PCM-i7 Comparison

Focused on the PCM CD (with SSD) and the question if Rogers will see degradation in their measurements at the throughputs
they currently have.
1:1 Comparison PCM CD vs. PCM-i7 using Rogers current Job
-

Since we still couldnt answer Rocks question if the data they collect today is valid, we captured a measurement file
with their current job one the PCM CD and on the PCM-i7. The results are in line with our statement, we provided to
AT&T this summer.
Up until 30 Mbit/s, we are on the safe side.
Between 30 and 40 Mbit/s we are in a gray zone, but do not expect a big impact (except some dropped IP Packets in
the IP Trace)
Above 40 Mbit/s we have an impact on the throughputs
For sure, we have to carefully discuss the results, but from what we can see now in the comparison, we have to be
aware of the limitations
The throughputs below are from their 50MB HTTP download. Capacity would be even worse

The above graph shows pretty well, that we have to expect degradation above ~50Mbit/s. The conditions in the lab are very
stable and you can see on the left side that using the Capacity test, we properly fill the pipe in UL at around 25Mbit/s. In DL
however, when we expect a steady line at around 55Mbit/s, we have a lot of up and downs around 50Mbit/s. To the right, we
can see the same DL Capacity test without Diversity (mainly IPTracer) running.

If we add a POLQA voice test in parallel, it gets a bit worse.

All tests have been performed with Tom/Philips new external IP Tracer. So there is not a lot we currently have in our pockets ;-)
Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\Comparison
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-CD\Sierra Wireless AirCard 313U

Lab Tests Sierra Wireless AirPrime MC7700

Max Duration [s]

Min Duration [s]

Avg Duration [s]

Max Throughput [kbps]

Min Throughput [kbps]

Avg Throughput [kbps]

Total bytes transferred [kByte]

Direction
Uplink
Downlink

Data Session Completed Rate

Total Number of Tests

Throughputs are consistent and at an expected level around 58Mbit/s avg.

7 100.0% 22435.77 17966.09 23812.97 29.96 29.94 29.97 588120.1

7 100.0% 58009.71 55054.84 59383.79 59.96 59.93 59.98 3043414.2

Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\MC7700 - Nokia C7 - Nokia 6720 II\

Lab Tests Novatel Expedite E371

th

Even after getting the latest version of the module (just received on Thursday 15 from Rhonda Bass
[RBass@dcsbusiness.com]), the Novatel Expedite shows the same limitations on the PCM-i7 as seen before.
The throughput is limited at around 45Mbit/s:

Looking at the network performance monitor, we can see an unsteady peak:

In comparison, here an example of the MC7700 at around 60Mbit/s

Example files:
\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\USB Tests\E371 PCIe Slot - MCM
disconnected\

Live Tests Huawei E398u-15

Rogers provided us with special SIM cards to perform some first tests in their new 2600MHz (20MHz bandwidth) network. They
told us that they still have some issues and are expecting around 60Mbit/s. On a drive test weve got an average throughput of
59Mbit/s. They plan to go nationwide in June 2012.

Example files:
\\10.23.1.174\media\Measurement Files\Rogers Canada\2011\2011_12_16 LTE Tests PCM-i7\2011_12_11\Huawei E398u-15
LTE Only RAW LOG\