Mobile Network Testing

INTERACTIVITY TEST
 MEASURING QOS AND QOE OF 5G APPLICATIONS
5G
GBs in 3D Video Cloud Work Industry Mission Self-Driving
AR/VR Smart City
a second UHD & Play Automation Critical Vehicles

The number of application and use cases will increase by folds in 5G.
Good Performance and QOE

CAPACITY
Minimum amount
of data rate

Minimum
response time LATENCY Interactivity

CONTINUITY
Maximum length
of interruptions

2 Rohde & Schwarz 2022-10-24 5G NR Mobile Network Testing Overview

Industry applications:
Packets to be sent frequently, max latency, max packet loss
Interactivity Test

TWAMP Reflector

SW

► TWAMP: Two-Way Active Measurement Protocol – specified by IETF (RFC 5357) Ping
(Traffic can be emulated; TWAMP defined for latency SLA verifications)

► Interactivity Score: combines latency, delay variation and packet loss into a single score

Rohde & Schwarz 6-Oct-2022 MNT Sales Meeting - Private Networks - market and solutions
Examples of industry applications
► Remote maintenance / training: Virtual Reality / full HD video
(emulates a Full-HD@60fps video stream: 60 packets per second, ´VR / full HD@60fps´
Traffic pattern 'CloudGaming'
6000
5.460 / 10.920 bytes each, PER: 2 * 10-3) RTT budget: 100ms
5000

Traffic pattern 'I4.0 Process automatization'

4000

data rate / kbit/s

2000 downlink
1800 RTT budget: 20ms 3000
1600
1400 2000

data rate / kbit/s

uplink
► I4.0 process automation
1200
1000
1000

(625 packets per second, 800

up- and downlink
0
0 1 2 3 4 5 6 7 8 9 10
100bytes each → 500 kbps DL+UL, 600
400 time / s
PER: 2 * 10-4) 200
0
0 5 10 15 20 25 30

time / s

► Workpiece monitoring (predictive maintenance of e.g. a drilling machine)

(100 packets per second, 1024 bytes each → 800 kbps UL; RTT budget: 20 ms; PER: ?) – similar to I4.0 process autom.

► Large machines – safety-relevant monitoring (cranes, etc.)

CANopen safety bus (CANopen Framework for Safety-Relevant Communication - CAN in Automation e.V.)
(a pair of packets to be received within 20 ms; 20 packet pairs per second)
Source: CiA DSP 304 V 1.0
Rohde & Schwarz 6-Oct-2022 MNT Sales Meeting - Private Networks - market and solutions
What happens if … latency is not sufficient and packets get lost
► Virtual Reality / Cloud-gaming HD

► I4.0 process automation

► Workpiece monitoring (predictive maintenance of e.g. a drilling machine)

► Large machines – safety-relevant monitoring (cranes, etc.)

► Many industry applications require reliable network operation

► Interruptions in production / logistics / processes compromise productivity gains
Rohde & Schwarz 6-Oct-2022 MNT Sales Meeting - Private Networks - market and solutions
A scalable QoE model for interactive applications
(also for machines)
Interactivity Score: e-Gaming real time Interactivity Score: VR retail shopping Interactivity Score: I4.0 process control
100 100 100
Packet loss
90
Perfect 90 90
80 Delay variation 80 80
70 70 70
60 Tolerable 60 60
50 50 50
40
Critical 40 40
30 30 30

Fail
20 20 20
10 10 10
0 0 0
0 20 40 60 80 100 120 140 160 0 20 40 60 80 100 120 140 160 0 20 40 60 80 100 120 140 160
RTT / ms RTT / ms RTT / ms

Referenced in ETSI TR 103 702: QoS parameters and test scenarios for
assessing network capabilities in 5G performance measurements
ITU-T Recommendation G.1051 (part 8)
► The parametrization of the Interactivity Test and Score is individual
for each application class

Rohde & Schwarz 6-Oct-2022 MNT Sales Meeting - Private Networks - market and solutions
SUPPORTED TRAFFIC PROFILES
► End-user application patterns
► E-gaming (multiplayer real-time games) - bursty
► VR / Cloud-gaming HD (emulates a Full-HD@60fps video stream)
► Online Meetings - bursty
► Video Chat HD - changing
► I4.0 process automation

► Engineering patterns
► Constant data rate (high-15Mbps, med-1Mbps, low-100kbps, long-300kbps)
► Asymmetric (constant DL / UL dominant; stepwise DL dominant)
► Step-wise patterns
Traffic pattern 'CloudGaming' 'Interactive remote meeting' Traffic pattern 'I4.0 Process automatization'
6000 2000 2000
1800 1800
5000
1600 1600
1400 1400
4000

data rate / kbit/s

data rate / kbit/s

data rate / kbit/s

downlink
1200 1200
3000 1000 1000
800 800
2000 up- and downlink
600 600
uplink
400 400
1000 up- and downlink
200 200
0 0 0
0 1 2 3 4 5 6 7 8 9 10 0 1 2 3 4 5 6 7 8 9 10 0 5 10 15 20 25 30
time / s time / s time / s

Rohde & Schwarz

INTERACTIVITY TEST UPDATE

Rohde & Schwarz

ROUNDTRIP LATENCY EXAMPLE
Constant long profile:
▪ 150 packets per sec.
▪ 250 bytes each
→ 300 kbps data rate
▪ Lost packets orange

Significant gaps / packet

loss
Buffer overload →
discarded packets

Rohde & Schwarz

ROOT CAUSES FOR LOST PACKETS

► Cell changes (handover, carrier aggregation additions / deletions)

► 5G NSA (5G carrier lost)
► Bad channel quality

Rohde & Schwarz