You are on page 1of 51

LTE Trial, Phase 1

Test Case Report


CONTROL AND USERPLANE LATENCY
JDSU TC #3

SINGTEL OPTUS

Version Owner Date


Final 1.0.0 Riku Luostari September 27, 2010

Nokia Siemens Networks 1 (51)


Contents

1 Test Objective ...................................................................................... 4

2 Background Information ...................................................................... 5


2.1 References............................................................................................. 5
2.2 Theoretical Background ......................................................................... 5

3 Test Method .......................................................................................... 7


3.1 Description ............................................................................................. 7
3.2 Parameter Variations ............................................................................. 7
3.3 Test Case Table ..................................................................................... 8
3.4 Test Setup.............................................................................................. 9
3.5 Network Elements & Equipment ............................................................. 9
3.6 Test Locations........................................................................................ 9
3.7 O&M Parameters for eNB ...................................................................... 9

4 Test Results........................................................................................ 10
4.1 Summary ............................................................................................. 11
4.1.1 Latency Test with 70% UL/DL Interference .......................................... 11
4.1.2 Latency Test with 0% UL/DL Interference ............................................ 13
4.2 Results ................................................................................................. 15
4.2.1 CUP.0001 ............................................................................................ 15
4.2.2 CUP.0002 ............................................................................................ 16
4.2.3 CUP.0003 ............................................................................................ 17
4.2.4 CUP.0004 ............................................................................................ 18
4.2.5 CUP.0005 ............................................................................................ 19
4.2.6 CUP.0006 ............................................................................................ 20
4.2.7 CUP.0007 ............................................................................................ 21
4.2.8 CUP.0008 ............................................................................................ 22
4.2.9 CUP.0009 ............................................................................................ 23
4.2.10 CUP.0010 ............................................................................................ 24
4.2.11 CUP.0011 ............................................................................................ 25
4.2.12 CUP.0012 ............................................................................................ 26
4.2.13 CUP.0013 ............................................................................................ 27
4.2.14 CUP.0014 ............................................................................................ 28
4.2.15 CUP.0015 ............................................................................................ 29
4.2.16 CUP.0016 ............................................................................................ 30
4.2.17 CUP.0017 ............................................................................................ 31
4.2.18 CUP.0018 ............................................................................................ 32
4.2.19 CUP.0019 ............................................................................................ 33
4.2.20 CUP.0020 ............................................................................................ 34
4.2.21 CUP.0021 ............................................................................................ 35
4.2.22 CUP.0023 ............................................................................................ 37
4.2.23 CUP.0024 ............................................................................................ 38
4.2.24 CUP.0025 ............................................................................................ 39
4.2.25 CUP.0026 ............................................................................................ 40

Nokia Siemens Networks 2 (51)


4.2.26 CUP.0027 ............................................................................................ 41
4.2.27 CUP.0028 ............................................................................................ 42
4.2.28 CUP.0029 ............................................................................................ 43
4.2.29 CUP.0030 ............................................................................................ 44
4.3 Additional Test Case: Control Plane Latency in RL09 .......................... 45
4.3.1 Objective .............................................................................................. 45
4.3.2 Location ............................................................................................... 45
4.3.3 Signalling procedures: ......................................................................... 45
4.3.4 Results................................................................................................. 45

5 Analysis .............................................................................................. 48

6 Notes................................................................................................... 50
6.1 RL09 vs. RL10 impact ............................. Error! Bookmark not defined.
6.2 UE impact ............................................................................................ 51

Nokia Siemens Networks 3 (51)


1 Test Objective
The objective of the test is to verify the performance of user plane of LTE eNB. It is
an end-to-end test, which includes Uu, S1-MME, S1-U and SGi interfaces.
The test includes user plane Round Trip Time (RTT) and in addition also control
plane measurements of the time different procedure take. Tests are executed in
field.
For the user plane, the following parameters are varied in the different test cases:
Variety of SINR conditions
1 UE does ping with various packet sizes in the cell without load and
cell loaded with 3UEs doing TCP/UDP data UL/DL transferring
simultaneously.
For the control plane:
Location in field: stationary UEs in the target cell at locations with
SINR = good
Signalling procedures under investigation: UE attach procedure ,
Radio Bearer setup procedure and UE detach procedure from active
state
All tests are executed for multiple times. The average and peak performance are
acquired. MIMO will not be tested explicitly. OL adaptive MIMO will be used during
the test.

Nokia Siemens Networks 4 (51)


2 Background Information

2.1 References

Related Specifications
[TS 36.331] Evolved Universal Terrestrial Radio Access (E-UTRA); Radio Resource Control
(RRC); Protocol specification
[TS 36.411] Evolved Universal Terrestrial Radio Access Network (E-UTRAN); S1 layer 1
[TS 36.412] Evolved Universal Terrestrial Radio Access Network (E-UTRAN); S1 signalling
transport
[TS 36.413] Evolved Universal Terrestrial Radio Access (E-UTRA) ; S1 Application Protocol
(S1AP)
[TS 36.414] Evolved Universal Terrestrial Radio Access Network (E-UTRAN); S1 data
transport

2.2 Theoretical Background


The purpose of the tests is to verify the control plane/ user plane message
handling. Radio signal will be set to SINR good and poor. Adaptive MIMO is
involved implicitly.
The performance test of control plane is based on measuring how long the system
takes to finish different end-to-end signalling processes. Key procedures are UE
attach, radio bearer setup and detach. And also, the total time UE takes to finish
the f

is not involved. The purpose of the test is to verifying the efficiency of control plane
message handling and the RRM processes involved. Each test should be executed
for multiple times to get the average and peak value (by default, test will be
executed for 100 times).

Nokia Siemens Networks 5 (51)


The performance test of user plane is based on the measurement of the round trip
time (RTT) of ping from UE to IP host 1 hop away from SAE-GW, meaning end-to-
end user plane delay is measured.
The round trip time from UE to S1 port of S-GW may not be feasible, because of
the network security issue (UE should not be able to ping network entities).
The one way delay, which can be more accurate to evaluate the user plane
performance on both directions, is not included in this test scope, because it is
difficult to reach high time synchronization between UE (and PC connected to it)
and the IP host connected to EPC.

Nokia Siemens Networks 6 (51)


3 Test Method

3.1 Description
The user plane latency was measured with UE1 using Ping sizes 32, 1000 and
1500 bytes. UE1 was placed in field conditions of SINR outdoor very good, good,
average and poor SINR ranges with interference off.
Then the above test cases were repeated with simultaneous 70% load in UL and
DL & background load of 1 UE in good SINR with full DL UDP & 1 UE in poor SINR
with full UDP UL.
Antenna configuration everywhere is adaptive MIMO in DL and SIMO in UL. While
performing pings started in UL with UE1, the user plane was logged to measure the
latency. Each test was repeated 100 or more times.
Logging was done using both SART & NixT.

3.2 Parameter Variations

Parameters Network Load 0% 70% UL & DL interference & simultaneous UL/DL UDP
background
SINR 5 conditions in (good, average, poor)
Service Type Ping UL
Antenna scheme Adaptive MIMO DL, SIMO UL
Environment Outdoor
Mobility Stationary
Number of Users 3
Power Control Open loop
Payload 32, 1000, 1500 bytes
Table 1: Parameter variations

Nokia Siemens Networks 7 (51)


3.3 Test Case Table

Test ID UEs Application DL Antenna Scheme Link SINR Interference


CUP.0001 3 Ping 32 Byte OL/CL Adaptive MIMO very good 70% UL/DL
CUP.0002 3 Ping 1000 Byte OL/CL Adaptive MIMO very good 70% UL/DL
CUP.0003 3 Ping 1500 Byte OL/CL Adaptive MIMO very good 70% UL/DL
CUP.0004 3 Ping 32 Byte OL/CL Adaptive MIMO Good1 70% UL/DL
CUP.0005 3 Ping 1000 Byte OL/CL Adaptive MIMO Good1 70% UL/DL
CUP.0006 3 Ping 1500 Byte OL/CL Adaptive MIMO Good1 70% UL/DL
CUP.0007 3 Ping 32 Byte OL/CL Adaptive MIMO average1 70% UL/DL
CUP.0008 3 Ping 1000 Byte OL/CL Adaptive MIMO average1 70% UL/DL
CUP.0009 3 Ping 1500 Byte OL/CL Adaptive MIMO average1 70% UL/DL
CUP.00010 3 Ping 32 Byte OL/CL Adaptive MIMO average2 70% UL/DL
CUP.00011 3 Ping 1000 Byte OL/CL Adaptive MIMO average2 70% UL/DL
CUP.00012 3 Ping 1500 Byte OL/CL Adaptive MIMO average2 70% UL/DL
CUP.00013 3 Ping 32 Byte OL/CL Adaptive MIMO Poor1 70% UL/DL
CUP.00014 3 Ping 1000 Byte OL/CL Adaptive MIMO Poor1 70% UL/DL
CUP.00015 3 Ping 1500 Byte OL/CL Adaptive MIMO Poor1 70% UL/DL
CUP.00016 1 Ping 32 Byte OL/CL Adaptive MIMO very good 0%
CUP.00017 1 Ping 1000 Byte OL/CL Adaptive MIMO very good 0%
CUP.00018 1 Ping 1500 Byte OL/CL Adaptive MIMO very good 0%
CUP.00019 1 Ping 32 Byte OL/CL Adaptive MIMO Good1 0%
CUP.00020 1 Ping 1000 Byte OL/CL Adaptive MIMO Good1 0%
CUP.00021 1 Ping 1500 Byte OL/CL Adaptive MIMO Good1 0%
CUP.00022 1 Ping 32 Byte OL/CL Adaptive MIMO average1 0%
CUP.00023 1 Ping 1000 Byte OL/CL Adaptive MIMO average1 0%
CUP.00024 1 Ping 1500 Byte OL/CL Adaptive MIMO average1 0%
CUP.00025 1 Ping 32 Byte OL/CL Adaptive MIMO average2 0%
CUP.00026 1 Ping 1000 Byte OL/CL Adaptive MIMO average2 0%
CUP.00027 1 Ping 1500 Byte OL/CL Adaptive MIMO average2 0%
CUP.00028 1 Ping 32 Byte OL/CL Adaptive MIMO Poor1 0%
CUP.00029 1 Ping 1000 Byte OL/CL Adaptive MIMO Poor1 0%
CUP.00030 1 Ping 1500 Byte OL/CL Adaptive MIMO Poor1 0%
Table 2: Tast cases

Nokia Siemens Networks 8 (51)


3.4 Test Setup

Figure 1: Test Setup

3.5 Network Elements & Equipment


The test equipment is described in the general part of the documentation.

3.6 Test Locations


The test locations for stationary tests and test routes for drive testing are as
described in the general part of the documentation.

3.7 O&M Parameters for eNB


The parametrisation is as described in the general part of the documentation.
CFI=3.

Nokia Siemens Networks 9 (51)


4 Test Results
Thousands of PING messages were sent and with absence of analysis tools for
JDSU SART and the large amount of manual work involved in analysing each PING
message, SART logs were not evaluated and the results below are extracted from
NixT logs and reflecting the total end user RTT experience.
All testing was done using RL09 software in the network. RL10 offers much
advanced features, but it was decided that the SW is not upgraded during the
testing phase in order to be able to compare different results measured in different
conditions. More information on RL10 performance can be found in chapter 6 in this
document.
Also it has been noted that different UE models can have different performance, an
example is shown in chapter 6 as well.

Nokia Siemens Networks 10 (51)


4.1 Summary
Latency was not much impacted by the amount of loading in the network nor is it by
the packet size really. The round trip time seems to be quite consistant all the way
to the point where the radio conditions are getting very poor only then does the
performance start to degrade.
RL10 provides noticeable improvement to this where pre-scheduling can be used.
Results from RL10 measurements are shown in chapter 6.1. Also different UE
manufacturers seem to have different performance. In chapter 6.2 there is are
example results shown using other UE brand in similar network setup.

4.1.1 Latency Test with 70% UL/DL Interference

Ping Round Trip Time (ms) - 32 BYTES


Maximum Minimum Average

60

49
50

39
40 36 36
34
32
30
25 25 25 24

20 17 17 17 17 18

SNR : 20.55 dB SNR : 19.70 dB SNR : 15.57 dB SNR : 17.48 dB SNR : 3.60 dB
10 RSRP : -84.60 dBm RSRP : -85.68 dBm RSRP : -85.67 dBm RSRP : --105.68 dBm RSRP : -122.06 dBm
RSSI : -66.35 dBm RSSI : -65.68 dBm RSSI : -66.32 dBm RSSI : -86.61 dBm RSSI : -98.95 dBm
RSRQ : -14.51 dB RSRQ : -16.26 dB RSRQ : -14.49 dB RSRQ : -14.77 dB RSRQ : -17.68 dB
0
Very Good Good Average 1 Average 2 Poor

Nokia Siemens Networks 11 (51)


Ping Round Trip Time (ms) - 1000 BYTES
Maximum Minimum Average

90
79
80

70

60 56
52 51
48 49
50 44
40 34 34 35 35

30 27 27 27 26

20 SNR : 21.36 dB SNR : 20.04 dB SNR : 11.73 dB SNR : 10.36 dB SNR : 3.13 dB
RSRP : -85.12 dBm RSRP : -85.92 dBm RSRP : -86.72 dBm RSRP : -108.81 dBm RSRP : -122.98 dBm
10 RSSI : -66.22 dBm RSSI : -65.66 dBm RSSI : -68.47 dBm RSSI : -87.37 dBm RSSI : -87.37 dBm
RSRQ : -15.18 dB RSRQ : -15.66 dB RSRQ : -14.12 dB RSRQ : -14.94 dB RSRQ : -18.45 dB
0
Very Good Good Average 1 Average 2 Poor

Ping Round Trip Time (ms) - 1500 BYTES


Maximum Minimum Average

100
91
90

80
69
70 63
59
60 53
48 49
50
39 41 40 40
40
28 28 29 29
30

20 SNR : 20.97 dB SNR : 19.79 dB SNR : 14.73 dB SNR : 15.52 dB SNR : 2.37 dB
RSRP : -84.87 dBm RSRP : -86.12 dBm RSRP : -85.01 dBm RSRP : -106.87 dBm RSRP : -120.30 dBm
10 RSSI : -69.42 dBm RSSI : -65.92 dBm RSSI : -68.28 dBm RSSI : -86.78 dBm RSSI : -99.25dBm
RSRQ : -14.53 dB RSRQ : -16.05 dB RSRQ : -13.90 dB RSRQ : -15.76 dB RSRQ : -17.68 dB
0
Very Good Good Average 1 Average 2 Poor

Nokia Siemens Networks 12 (51)


4.1.2 Latency Test with 0% UL/DL Interference

Ping Round Trip Time (ms) - 32 BYTES


Maximum Minimum Average

50
46
45

40 37
35 35 34
35

30 28
25 24 25 24
25

20 17 17 17 17
16
15

10 SNR : 23.14 dB SNR : 20.52 dB SNR : 22.09 dB SNR : 23.76 dB SNR : 8.79 dB
RSRP : -69.81 dBm RSRP : -78.24 dBm RSRP : -96.91 dBm RSRP : -97.16 dBm RSRP : -119.66 dBm
5 RSSI : -43.67 dBm RSSI : -54.07 dBm RSSI : -68.52 dBm RSSI : -73.75 dBm RSSI : -91.07 dBm
RSRQ : -12.14 dB RSRQ : -10.17 dB RSRQ : -14.39 dB RSRQ : -9.41 dB RSRQ : -14.58 dB
0
Very Good Good Average 1 Average 2 Poor

Ping Round Trip Time (ms) - 1000 BYTES


Maximum Minimum Average

100
92
90

80

70 63
60

50 44 43 44 44
41
40 33 33 33
32
30 26 26 26 27

20 SNR : 23.14 dB SNR : 20.52 dB SNR : 22.09 dB SNR : 23.76 dB SNR : 8.79 dB
RSRP : -69.81 dBm RSRP : -78.24 dBm RSRP : -96.91 dBm RSRP : -97.16 dBm RSRP : -119.66 dBm
10 RSSI : -43.67 dBm RSSI : -54.07 dBm RSSI : -68.52 dBm RSSI : -73.75 dBm RSSI : -91.07 dBm
RSRQ : -12.14 dB RSRQ : -10.17 dB RSRQ : -14.39 dB RSRQ : -9.41 dB RSRQ : -14.58 dB
0
Very Good Good Average 1 Average 2 Poor

Nokia Siemens Networks 13 (51)


Ping Round Trip Time (ms) - 1500 BYTES
Maximum Minimum Average

120 113
110
100
90
80
70 66
63
60
48 49
50 44
37 38 37 38
40 32
29 29 29 31
30
SNR : 23.36 dB SNR : 20.80 dB SNR : 22.98 dB SNR : 24.55 dB SNR : 8.84 dB
20 RSRP : -73.48 dBm RSRP : -77.73 dBm RSRP : -91.71 dBm RSRP : -94.15 dBm RSRP : -117.36 dBm
10 RSSI : -47.43 dBm RSSI : -53.35 dBm RSSI : -68.40 dBm RSSI : -70.60 dBm RSSI : -91.14 dBm
RSRQ : -12.06 dB RSRQ : -10.38 dB RSRQ : -9.31 dB RSRQ : -9.55 dB RSRQ : -12.21 dB
0
Very Good Good Average 1 Average 2 Poor

Nokia Siemens Networks 14 (51)


4.2 Results

4.2.1 CUP.0001

One UE is placed in stationary position and ping is started in very good RF


condition with 70% UL/DL inteference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0001
Ping RTT Average SNR Average RSRP
Maximum 34 ms
Minimum 17 ms 20.55 dB -84.60 dBm
Average 25 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97
103
109
115
1
7

Ping RTT (ms)

Nokia Siemens Networks 15 (51)


4.2.2 CUP.0002

One UE is placed in stationary position and ping is started in very good RF


condition with 70% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0002
Ping RTT Average SNR Average RSRP
Maximum 48 ms
Minimum 27 ms 21.36 dB -85.12 dBm
Average 34 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97
103
109
115
1
7

Ping RTT (ms)

Nokia Siemens Networks 16 (51)


4.2.3 CUP.0003

One UE is placed in stationary position and ping is started in very good RF


condition with 70% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0003
Ping RTT Average SNR Average RSRP
Maximum 48 ms
Minimum 28 ms 20.97 dB -84.87 dBm
Average 39 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 17 (51)


4.2.4 CUP.0004

One UE is placed in stationary position and ping is started in good1 RF condition


with 70% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0004
Ping RTT Average SNR Average RSRP
Maximum 36 ms
Minimum 17 ms 19.70 dB -85.68 dBm
Average 25 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97
103
109
115
1
7

Ping RTT (ms)

Nokia Siemens Networks 18 (51)


4.2.5 CUP.0005

One UE is placed in stationary position and ping is started in good1 RF condition


with 70% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0005
Ping RTT Average SNR Average RSRP
Maximum 52 ms
Minimum 27 ms 20.04 dB -85.92 dBm
Average 34 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 19 (51)


4.2.6 CUP.0006

One UE is placed in stationary position and ping is started in good1 RF condition


with 70% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0006
Ping RTT Average SNR Average RSRP
Maximum 53 ms
Minimum 28 ms 19.79 dB -86.12 dBm
Average 41 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 20 (51)


4.2.7 CUP.0007

One UE is placed in stationary position and ping is started in average RF condition


1 with 70% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0007
Ping RTT Average SNR Average RSRP
Maximum 36 ms
Minimum 17 ms 15.57 dB -85.67 dBm
Average 25 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 21 (51)


4.2.8 CUP.0008

One UE is placed in stationary position and ping is started in average RF condition


1 with 70% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
1
5
9

CUP.0008
Ping RTT Average SNR Average RSRP
Maximum 49 ms
Minimum 27 ms 11.73 dB -86.72 dBm
Average 35 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 22 (51)


4.2.9 CUP.0009

One UE is placed in stationary position and ping is started in average RF condition


1 with 70% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0009
Ping RTT Average SNR Average RSRP
Maximum 49 ms
Minimum 29 ms 14.73 dB -85.01 dBm
Average 40 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 23 (51)


4.2.10 CUP.0010

One UE is placed in stationary position and ping is started in average RF condition


2 with 70% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0010
Ping RTT Average SNR Average RSRP
Maximum 39 ms
Minimum 17 ms 17.48 dB -105.68 dBm
Average 24 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 24 (51)


4.2.11 CUP.0011

One UE is placed in stationary position and ping is started in average RF condition


2 with 70% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0011
Ping RTT Average SNR Average RSRP
Maximum 51 ms
Minimum 26 ms 10.36 dB -108.81 dBm
Average 35 ms

-110.17 RTT Count


70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 25 (51)


4.2.12 CUP.0012

One UE is placed in stationary position and ping is started in average RF condition


2 with 70% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
1
5
9

CUP.0012
Ping RTT Average SNR Average RSRP
Maximum 63 ms
Minimum 29 ms 15.52 dB -106.87 dBm
Average 40 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 26 (51)


4.2.13 CUP.0013

One UE is placed in stationary position and ping is started in poor RF condition with
70% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
1
5
9

CUP.0013
Ping RTT Average SNR Average RSRP
Maximum 49 ms
Minimum 18 ms 3.60 dB -122.06 dBm
Average 32 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 27 (51)


4.2.14 CUP.0014

One UE is placed in stationary position and ping is started in poor RF condition with
70% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
1
5
9

CUP.0014
Ping RTT Average SNR Average RSRP
Maximum 79 ms
Minimum 44 ms 3.13 dB -122.98 dBm
Average 56 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 28 (51)


4.2.15 CUP.0015

One UE is placed in stationary position and ping is started in poor RF condition with
70% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0015
Ping RTT Average SNR Average RSRP
Maximum 91 ms
Minimum 59 ms 2.37 dB -120.30 dBm
Average 69 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 29 (51)


4.2.16 CUP.0016

One UE is placed in stationary position and ping is started in very good RF


condition with 0% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0016
Ping RTT Average SNR Average RSRP
Maximum 37 ms
Minimum 16 ms 23.14 dB -69.81 dBm
Average 25 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 30 (51)


4.2.17 CUP.0017

One UE is placed in stationary position and ping is started in very good RF


condition with 0% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0017
Ping RTT Average SNR Average RSRP
Maximum 44 ms
Minimum 26 ms 23.33 dB -69.78 dBm
Average 33 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 31 (51)


4.2.18 CUP.0018

One UE is placed in stationary position and ping is started in very good RF


condition with 0% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0018
Ping RTT Average SNR Average RSRP
Maximum 48 ms
Minimum 29 ms 23.36 dB -73.48 dBm
Average 37 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 32 (51)


4.2.19 CUP.0019

One UE is placed in stationary position and ping is started in good RF condition


with 0% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0019
Ping RTT Average SNR Average RSRP
Maximum 35 ms
Minimum 17 ms 20.52 dB -78.24 dBm
Average 24 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 33 (51)


4.2.20 CUP.0020

One UE is placed in stationary position and ping is started in good RF condition


with 0% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0020
Ping RTT Average SNR Average RSRP
Maximum 41 ms
Minimum 26 ms 20.70 dB -77.69 dBm
Average 32 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 34 (51)


4.2.21 CUP.0021

One UE is placed in stationary position and ping is started in good RF condition


with 0% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0021
Ping RTT Average SNR Average RSRP
Maximum 49 ms
Minimum 29 ms 20.80 dB -77.73 dBm
Average 38 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 35 (51)


4.2.21.1 CUP.0022
One UE is placed in stationary position and ping is started in average RF condition
1 with 0% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0022
Ping RTT Average SNR Average RSRP
Maximum 35 ms
Minimum 17 ms 22.09 dB -96.91 dBm
Average 25 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 36 (51)


4.2.22 CUP.0023

One UE is placed in stationary position and ping is started in average RF condition


1 with 0% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0023
Ping RTT Average SNR Average RSRP
Maximum 43 ms
Minimum 26 ms 22.73 dB -90.81 dBm
Average 33 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 37 (51)


4.2.23 CUP.0024

One UE is placed in stationary position and ping is started in average RF condition


1 with 0% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
100 40.00
90 35.00
80
30.00
70
60 25.00
50 20.00
40 15.00
30
10.00
20
10 5.00
0 0.00
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0024
Ping RTT Average SNR Average RSRP
Maximum 44 ms
Minimum 29 ms 22.98 dB -91.71 dBm
Average 37 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 38 (51)


4.2.24 CUP.0025

One UE is placed in stationary position and ping is started in average RF condition


2 with 0% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0025
Ping RTT Average SNR Average RSRP
Maximum 34 ms
Minimum 17 ms 23.76 dB -97.16 dBm
Average 24 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 39 (51)


4.2.25 CUP.0026

One UE is placed in stationary position and ping is started in average RF condition


2 with 0% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0026
Ping RTT Average SNR Average RSRP
Maximum 44 ms
Minimum 27 ms 23.96 dB -93.58 dBm
Average 33 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 40 (51)


4.2.26 CUP.0027

One UE is placed in stationary position and ping is started in average RF condition


2 with 0% UL/DL interference. Ping size is 1500 bytes.

Ping Round Trip Time (ms) RS SNR


100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0027
Ping RTT Average SNR Average RSRP
Maximum 63 ms
Minimum 31 ms 24.55 dB -94.15 dBm
Average 38 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 41 (51)


4.2.27 CUP.0028

One UE is placed in stationary position and ping is started in poor RF condition with
0% UL/DL interference. Ping size is 32 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
65
69
73
77
81
85
89
93
97
101
105
109
113
117
121
125
129
133
137
141
145
149
1
5
9

CUP.0028
Ping RTT Average SNR Average RSRP
Maximum 46 ms
Minimum 17 ms 8.79 dB -119.66 dBm
Average 28 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 42 (51)


4.2.28 CUP.0029

One UE is placed in stationary position and ping is started in poor RF condition with
0% UL/DL interference. Ping size is 1000 bytes.
Ping Round Trip Time (ms) RS SNR
100 40
90 35
80
30
70
60 25
50 20
40 15
30
10
20
10 5
0 0
13
17
21
25
29
33
37
41
45
49
53
57
61
67
71
75
79
83
87
91
95
99
103
107
111
115
119
123
127
131
135
139
143
147
1
5
9

CUP.0029
Ping RTT Average SNR Average RSRP
Maximum 92 ms
Minimum 44 ms 6.21 dB -120.97 dBm
Average 63 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
1
6
11
16
21
26
31
36
41
46
51
56
61
66
71
76
81
86
91
96

Ping RTT (ms)

Nokia Siemens Networks 43 (51)


4.2.29 CUP.0030

One UE is placed in stationary position and ping is started in poor RF condition with
0% UL/DL interference. Ping size is 1500 bytes.
Ping Round Trip Time (ms) RS SNR
120 40
110
35
100
90 30
80
25
70
60 20
50
15
40
30 10
20
5
10
0 0
13
17
21
25
29
33
37
42
46
50
54
58
62
66
70
74
78
82
86
90
94
98
102
106
110
114
118
122
126
130
134
138
142
146
150
1
5
9

CUP.0030
Ping RTT Average SNR Average RSRP
Maximum 113 ms
Minimum 32 ms 8.84 dB -117.36 dBm
Average 66 ms

RTT Count
70
60
50
Samples

40
30
20
10
0
103
109
115
1
7
13
19
25
31
37
43
49
55
61
67
73
79
85
91
97

Ping RTT (ms)

Nokia Siemens Networks 44 (51)


4.3 Additional Test Case: Control Plane Latency in RL09

4.3.1 Objective

Measure the control plane signalling processing time and the end-to-end user plane
delay, i.e. Round Trip Time (RTT). Tests will be executed in the field at good SINR
conditions.

4.3.2 Location

stationary UEs in the target cell at good SINR locations

4.3.3 Signalling procedures:

UE Attach, Radio Bearer Setup and UE Detaches from active state.

4.3.4 Results
4.3.4.1 Control Plane Latency Attach & Bearer Setup
Total time for UE to attach (EMM-registered) and setup default bearer (ECM-
Connected) takes around 125 ms (including UE processing delay).

Nokia Siemens Networks 45 (51)


Total time for UE to attach (EMM-registered) and setup default bearer (ECM-
Connected) takes around 125 ms (including UE processing delay).

4.3.4.2 Control Plane Latency Service Request


Total time of 93 ms (including UE processing delay) from idle (RRC Idle & EMM-
Registered) to active (RRC & ECM Connected) transition meets 100ms 3GPP
requirement (as per specification 25.913).

Nokia Siemens Networks 46 (51)


Total time of 93 ms (including UE processing delay) from idle (RRC Idle & EMM-
Registered) to active (RRC & ECM Connected) transition meets 100ms 3GPP
requirement (as per specification 25.913).

4.3.4.3 Control Plane Latency UE Detach


Total time of UE detach from active state takes around 39 ms.

Nokia Siemens Networks 47 (51)


5 Analysis
The loading of the network doesnt seem to have great impact on the RTT. It is only
at the cell edge in poor readio condition where RTT starts deteriorating. Impact
could be more noticeable with RL10 release as the RTT of 32B is pushed to around
11ms levels (see chapter 6).

Nokia Siemens Networks 48 (51)


MTU size in the system was 1460B. Ping size of 1500B RTT possibly impacted by
the fact that the Ping packet is segmented.
Also Ping size does have very little negative impact on RTT.

Nokia Siemens Networks 49 (51)


6 Notes

6.1 Impact of pre-scheduling


These cases reported in this document were done using RL09 software which does
not contain the pre-scheduling feature. In RL10 is much advanced in comparison
and provides features like pre-scheduling is.
Even if RL10 came available during the testing phase, the software was not
upgraded to RL10 during the testing. This is because the test cases were designed
to compare different loading and environments and would have made the
environment and load comparisons invalid.
RTT was tested using RL10 with Samsung device pinging 32B in average radio
conditions on the field in an unloaded NW with the following result:

Pre-Scheduling Feature
Proactive UL Resource Assignment provides the possibility to demonstrate ping
response times of below 10 ms in low load field environments.
eNB supports a Proactive UL Resource Assignment mode by always assigning a
minimum bandwidth uplink resource to a UE even if UE UL buffer is empty. Thus,
UE can send small packets such as a ping packet of 32 byte size immediately
without adding latency for a resource request via SRI / resource grant cyle.

Nokia Siemens Networks 50 (51)


Conditions in this test were:
On field, SNR ~20dB
20MHz bandwidth
2600MHz
No loading, only UE in nework.
Ping size 32 bytes.

6.2 UE impact
With the same RL09 software version using different UE from another manufacturer
the results can be different, the following was measured in average radio
conditions, unloaded cell and 32B ping. The results are clearly better than in
SingTel-Optus trial where LGE device was used.

Conditions in this test:


On field, SNR ~20dB +
20MHz bandwidth
2600MHz
No loading, only UE in nework.
Ping size 32 bytes.

Nokia Siemens Networks 51 (51)