Professional Documents
Culture Documents
Measurements and Qos Analysis of Live-World Mobile Telecommunication Networks
Measurements and Qos Analysis of Live-World Mobile Telecommunication Networks
A. Accessibility Diversity
Benchmarker
1. PDP Context Activation Duration and Success Rate: Fig. 2. Measurement System Architecture
indicates the time required for the service access as
well as the success rate. Diversity is a portable, highly scalable platform for drive-
2. Setup Time: The interval of time from the moment the test systems that allows the user to measure more than one
user service requests until the first byte is sent or cellular network of different technology. The system is mobile
in automotive setting or carried by a pedestrian. The interface The session of voice tests contains both mobile phone to
to the mobile network is through special models of cellular mobile phone test as well as mobile to PSTN phone test. In
phones that give access to internal network parameters [4],[5]. both cases A-side and B-side are defined and exchange short
The measurement system sets up calls, records cellular voice recordings alternately in order to emulate a call
network parameters, measures voice quality calls using Voice conversation. The conversation schema is presented at Fig.2.
Server as well as the quality of other payload such as data,
email, ping and video using Media Server. Diversity provides
QoS evaluation, benchmarking, and RF and network
optimization.
It is designed for both wireless and fixed networks. The
quality of service in voice and data tests is performed through
related speed and audio quality algorithms. Tests execution is
configured and controlled by Test Manager and also
measurements data can be displayed live on NQView. Test
Manager and NQView are software applications running on
the laptop during the measurements. In this scenario, laptop
user in the vehicle monitors the process of measurements.
B. Measurement Campaign
The measurement system is placed in a car while executing a
measurement campaign [6]. In the campaign a session of tests
is consecutively repeated.
Fig. 4 Quality of voice measurement tasks configuration.
The data session contains the following actions and tests:
1. Activation Packet Data Protocol (PDP Context
V. ANALYSIS – POST PROCESSING RESULTS
Activation)
2. Reception of 10 MB file (FTP Download) from a A. Analysis Tool
public server broadband connected to the internet.
3. Sent a 3 MB file to the public server (FTP Upload). Measurements are imported in the post processing application
4. Web browsing at NTUA (www.ntua.gr) website of size based on SwissQual’s NQDI (NetQual Database Interface)
of 1 MB. which is connected with a relational time-spatial database.
5. 10 Ping with 400 Bytes Packet Size. NQDI offers enhanced drill down analysis, filtering and data
mining, KPI statistics, map plotting, database querying/mining
6. Deactivation Packet Data Protocol (PDP Context and reporting.
Deactivation). Using NQDI the measurement data can be filtered by using
complicated queries in order to analyze specific part of all the
data located in the database.
A typical structure of a query based filter applied in the data
base aims to show up performance parameter values and
compute statistics from a set of well organized measurements
or/and network information tables where crucial criteria and
combined conditions take place. A general query form is
presented:
SELECT <List_of_Parameters>, <Statistics_Functions>
FROM <List_of_Measurements_Tables> OR/AND
<List_of_Radio_Network_Parameters>
WHERE <List_of_Combined_Criteria/Conditions>
Download time is used to evaluate HTTP performance, Fig. 9. Data Serving Technology distribution.
which is considered to be more efficient than throughput. In
the diagram, the average and minimum download time is 2) Circuit Switched Services – Telephony
presented, as well as the Overall Service Success, tests that Speech Quality indicator is the major factor determining
have successfully completed without drop or setup failure. customer satisfaction, since it represents the quality of
The average download time 7,1sec is capable for loading a listener’s reception. It is generally expressed as a Mean
website of 1 MB. Opinion Score (MOS) which is valued between 1, bad level,
and 5, excellent level. Most objective algorithms [8][9][10]
are based on a comparison between a reference sample and a
coded version of the reference. The most widely used models
of algorithms are ITU-T P.862 standardized in 2001. In
contrast with subjective experiments, this model enables
extensive testing to be performed over short periods. The
results of ITU-T P.862 algorithm are displayed in the
following figures.
TABLE III
PING RTT STATISTICS
Count 528
% 99,62%
Avg [ms] 194
Min [ms] 101
Max [ms] 3454
StDev [ms] 165
95% Cut-Off 345
Fig. 11 Listening Quality distribution.
For each test, Diversity stored the duration of the provided 3) KPIs Map Plotting
data service technology. Combining all types of tests, in the Finally, Fig.12 and Fig.13 display crucial QoS parameters –
Channel Quality Indicator and Listening Quality - having Consequently, it is necessary and obligatory (by independent
applied a spatial filter on a polygon which contains a route of national regulatory authority [11]) for mobile operators to
the NTUA Campus. The result of the spatial query has been perform continuously measurements so as to audit and
plotted on a GIS Viewer (Google Earth) giving us an optimize the efficiency of radio access networks as well as for
opportunity to locate problematic areas regarding performance benchmarking reasons. Open and frequent publication of
or RF coverage. crucial KPIs will lead mobile operators to robust competition
introducing innovative and qualitative services. Contemporary
technologies like Long Term Evolution UMTS, also known as
HSPA+, will explicitly uplift the provided bitrates. Future
work may be performing large scale measurements campaigns
in differentiated environments of interest in order to
extensively examine QoS parameters.
REFERENCES
[1] H.Holma and A.Toskala, “HSDPA/HSUPA FOR UMTS, High Speed
Radio Access for Mobile Communications”, Ed. John Wiley & Sons,
LTD, 2006.
[2] ETSI TS 102 250-1, “Speech Processing, Transmission and Quality
Aspects (STQ); QoS aspects for popular services in GSM and 3G
networks; Part 1: Identification of Quality of Service aspects”, V1.2.1,
Technical Specification, 2007.
[3] ETSI TS 102 250-2, “Speech Processing, Transmission and Quality
Aspects (STQ); QoS aspects for popular services in GSM and 3G
networks; Part 2: Definition of Quality of Service parameters and their
computation”, V1.6.2, Technical Specification, 2008.
[4] ETSI TS 102 250-3, "Speech Processing, Transmission and Quality
Aspects (STQ); QoS aspects for popular services in GSM and 3G
networks; Part 3: Typical procedures for Quality of Service
measurement equipment", V1.3.2, Technical Specification, 2005.
Fig. 12 Channel Quality Indicator (CQI) plotted on Google Earth [5] ETSI TS 102 250-4, “Speech Processing, Transmission and Quality
Aspects (STQ); QoS aspects for popular services in GSM and 3G
networks; Part 4: Requirements for Quality of Service measurement
equipment”, V1.2.1, Technical Specification, 2007.
[6] ETSI TS 102 250-5, “Speech Processing, Transmission and Quality
Aspects (STQ); QoS aspects for popular services in GSM and 3G
networks; Part 5: Definition of typical measurement profile”, V1.5.1,
Technical Specification, 2008.
[7] ETSI TS 102 250-6, "Speech Processing, Transmission and Quality
Aspects (STQ); QoS aspects for popular services in GSM and 3G
networks; Part 6: Post processing and statistical methods", V1.2.1,
Technical Specification, 2004.
[8] ITU-T Rec. P.862, “Perceptual evaluation of speech quality (PESQ): An
objective method for end-to-end speech quality assessment of narrow-
band telephone networks and speech codecs”, 2/2001.
[9] ITU-T Rec. P.862.1, “Mapping function for transforming P.862 raw
result scores to MOS-LQO”, 11/2003.
[10] ITU-T Rec. P.862.2, “Wideband extension to Recommendation P.862
for the assessment of wideband telephone networks and speech codecs”,
11/2007.
[11] Hellenic Telecommunications and Post Commission (EETT), Desicion,
No.480/017, "Definition of quality indicators of public provided
electronic communication services and specification of the content and
the form of the reported information as well as the method and the time
Fig. 13 Listening Quality (LQ P.862.1) plotted on Google Earth. of the publication by the electronic communication services providers",
Official Government Gazette of Hellenic Republic, OGG/1153/B/2008,
VI. CONCLUSIONS 2008.