MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

Procedure

PRC-001

Drive Test Procedure

Voice

Statement of Confidentiality
Copyright in this document is the property of MIC S.A. and its contents shall be held in strict confidence by the recipient
hereof and shall be used solely for the purposes of MIC S.A. Neither this document nor its contents shall be disclosed to any
other person or used for any other purpose without prior written permission of MIC S.A.
Approval section
Proposed by (name/title)

Approved by (name/title)

Madhawa Gunatilake

Xavier Rocoplan

Head of RNE (Sri Lanka)

Quality Assurance Manager

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 1 of 7

MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

I
I.1

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

INTRODUCTION
SCOPE

The procedure documents (PRC) aim at describing a standard way to perform an activity.
This procedure describes the way to perform voice drive test data gathering.
I.2

CONTACT LIST

This guideline was delivered by the Benchmarking Task Force:

Sponsor - Xavier Rocoplan / Quality Assurance, Cluster CTO Asia,
Leader - Sanath Pilapitiya / CTO Sri Lanka
The following members are contributing to the Task Force:
Madhawa Gunatilake, Head of RNE, Tigo Sri Lanka
Asela Gamage, Technical Analyst

I.3

OBJECTIVES

The objective of the document is to ensure drive test campaigns are performed the same way.
I.4

DISTRIBUTION LIST

Distribution List Name

Max Leiva
Xavier Rocoplan
[Cluster CTO group]
[CTOs group]
[Analysts group]
[Benchmarking Task Force group]
I.5

Title
CTO
Quality Assurance Manager
Cluster CTOs
CTOs
MIC HQ Analysts
Benchmarking Task Force

VERSION CONTROL
Version
RevA
RevB

I.6

Date
1-Jun-08
4-Jun-08

Owner
Madhawa/Xavier
Asela Gamage

Details
First release
Second release

TABLE OF CONTENT
INTRODUCTION..................................................................................................................................................................................................................... 2

I.1
I.2
I.3
I.4
I.5
I.6
II

SCOPE............................................................................................................................................................................................................................... 2
CONTACT LIST ................................................................................................................................................................................................................. 2
OBJECTIVES ..................................................................................................................................................................................................................... 2
DISTRIBUTION LIST .......................................................................................................................................................................................................... 2
VERSION CONTROL .......................................................................................................................................................................................................... 2
TABLE OF CONTENT ......................................................................................................................................................................................................... 2
DRIVE TEST METHODOLOGY - VOICE BENCHMARKING ................................................................................................................................ 3

II.1
II.2
II.3
II.3.1
II.3.2
II.4
II.4.1
II.4.2
II.4.3
II.4.4
II.4.5
II.4.6
II.4.7
III

GENERAL SET UP.............................................................................................................................................................................................................. 3

MINIMUM NUMBER OF CALLS .......................................................................................................................................................................................... 3
CALL PATTERN ................................................................................................................................................................................................................. 3
Call sequence ............................................................................................................................................................................................................ 3
B-number ................................................................................................................................................................................................................... 3
KPIS AND COLOR CODES ................................................................................................................................................................................................. 3
RxLev ......................................................................................................................................................................................................................... 3
RxQual....................................................................................................................................................................................................................... 4
Speech Quality Index (SQI)....................................................................................................................................................................................... 4
Call Setup Success Rate ............................................................................................................................................................................................ 4
Dropped Call Rate .................................................................................................................................................................................................... 4
Blocked Call Rate...................................................................................................................................................................................................... 4
Handover Failures Rate............................................................................................................................................................................................ 4
RANKING METHODOLOGY ...................................................................................................................................................................................... 5

III.1
III.2
III.3
III.4
IV

WEIGHT ACCORDING TO KPI........................................................................................................................................................................................... 5

RANKING BASED ON VALUES........................................................................................................................................................................................... 5
WEIGHT ACCORDING TO NUMBER OF OPERATORS .......................................................................................................................................................... 6
WEIGHTED RANKING ....................................................................................................................................................................................................... 6
ANNEX 1 - DRIVE TEST CHECK LIST ..................................................................................................................................................................... 7

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 2 of 7

MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

II

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

DRIVE TEST METHODOLOGY - VOICE BENCHMARKING

This section describes the methodology to be used in case of a BENCHMARKING exercise.

II.1

GENERAL SET UP

Drive test was carried out with as many sets of mobiles as necessary with external antenna to avoid body loss and in-car
penetration loss.
II.2

MINIMUM NUMBER OF CALLS

Minimum 3000 samples per drive test campaign per network to ensure the drive test is statistically meaningful.

II.3

CALL PATTERN

II.3.1

Call sequence

call duration of 60 seconds,

Idle mode between 2 calls of 10 seconds,
Automatic redial in case of blocked calls or dropped calls,
call timeout of 5 attempts.

II.3.2

B-number

II.3.2.1

Own network

Tigo originated to Tigo terminated calls.

II.3.2.2

Competitor's networks

- Mobile originating and mobile terminating calls are recorded.

It is recommended to do mobile originated & mobile terminated calls in both cases. This will make sure an apple to apple
comparison & no advantage to either Tigo or competitors.
II.4

KPIS AND COLOR CODES

II.4.1

RxLev

This is a measure of the receive signal strength (RxLev) of the mobile in the downlink which is measured during drive test.
Tigo coverage threshold criteria are taken into consideration which kind of product is planned to have in this area, whether
its an Urban product or a Rural product. Depending on the product two different colour codes will be used. For all operators
same colour code will be used.
II.4.1.1

Urban Colour code

Range RXLEV
0 dBm <RXLEV<=
-65 dBm <RXLEV<=
-75 dBm <RXLEV<=
-85 dBm <RXLEV<=
-95 dBm <RXLEV<=

II.4.1.2

- 65 dBm
- 75 dBm
- 85 dBm
- 95 dBm
-120 dBm

Colour settings
Green
Yellow
Orange
Blue
Red

Rural Colour code

Range RXLEV
0 dBm <RXLEV<= - 70 dBm
- 70 dBm <RXLEV<= - 80 dBm
- 80 dBm <RXLEV<= - 90 dBm
- 90 dBm <RXLEV<= -100 dBm
-100 dBm <RXLEV<= -120 dBm

Colour settings
Green
Yellow
Orange
Blue
Red

In addition to the coverage plots, histograms are also provided depicting the distribution of recorded sample values.

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 3 of 7

MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

II.4.2

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

RxQual

This is a measure of the call quality (i.e., Bit Error Rate) of the received signal at street level as measured during the drive
test. The value of RxQual ranges from 0 to 7. The eight possible RxQual levels (0 to 7) are categorized in three criteria of
signal quality, each with their own colour code as mentioned below:
Range RXQUAL
0<RXQUAL<=2
3<=RXQUAL<=4
5<=RXQUAL<=7

Status
Good signal quality
Acceptable signal quality
Bad signal quality

Colour settings
Green
Yellow
Red

Along with the plots of RxQual, histograms are also provided showing the distribution of samples with their mean, median
and standard deviation values.
II.4.3

Speech Quality Index (SQI)

This is a measure of the speech quality of the network, and is based on Bit Error Rate (BER), Frame Erasure Rate (FER),
data on handover events, and statistics on the distributions of each of these parameters. The possible SQI levels are
categorized here into four distinct levels of speech quality, each with their own colour code:
Range SQI
22 <SQI<=30
18 <SQI<=22
13 <SQI<=18
-20 <SQI<=13

Status
Very Good
Good
Acceptable
Bad

Colour settings
Green
Yellow
Orange
Red

Along with the plots of SQI, histograms showing the distribution of samples and their mean, median and standard deviation
are also included.
II.4.4

Call Setup Success Rate

This is computed as the number of calls setup over the number of calls attempted.
II.4.5

Dropped Call Rate

This is the ratio of number of calls abnormally ended after Call has established over the total number of calls established.
II.4.6

Blocked Call Rate

This is the ratio of calls abnormally ended prior to Call Establishment (for example: during busy traffic channels), and is
computed based on the number of calls blocked over the number of call attempts.
II.4.7

Handover Failures Rate

This is the ratio of total number of handover attempt failed over the total number of handover attempted.

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 4 of 7

MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

III RANKING METHODOLOGY

Ranking will be based on following criterions.

Coverage (based on mean RxLev)

Voice Quality (based on mean SQI)
Drop Calls (based on Drop call Rate)
Connectivity (based on CSSR)
Signal Quality (based on RxQual)
Out of these first four can be considered as commercial KPI's because they are linked to customer perception & the last
one as a technical KPI.

III.1

WEIGHT ACCORDING TO KPI

Above mentioned KPI's are given weight according to their importance in customer perception point of view.
Coverage & Voice quality are weighted as the most important KPI's, followed by connectivity & Drop calls.
Least important KPI from customer point of view will be RxQual, so it's given the least weight.
Voice Quality
(SQI)

Coverage
Weight

III.2

25%

Drop calls

Connectivity
(CSSR)

Signal Quality
(RxQual)

20%

20%

10%

25%

RANKING BASED ON VALUES

Depending on mean KPI values each operator will be ranked.

Step 1:
Sri Lanka (Kaluthara)
Tigo

Dialog

Mobitel

Hutch

Mean RxLev
(dBm)

-79.55

-82.54

-75.09

-85.42

Mean SQI

22.61

27.13

26.02

26.57

0.00%

1.40%

8.55%

1.89%

87.72%

85.12%

82.39%

58.56%

0.95

0.9

0.41

1.05

Dropped
Call Rate
Call
Setup
Success
Rate
Mean
RxQual
Step 2:

Sri Lanka (Kaluthara)

Ranking
criteria

per

Tigo

Dialog

Mobitel

Hutch

Coverage

Voice Quality
(SQI)

Drop calls

Connectivity
(CSSR)

Signal Quality
(RxQual)

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 5 of 7

MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

III.3

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

WEIGHT ACCORDING TO NUMBER OF OPERATORS

Depending on the number of available operators and Tigo ranking in the benchmarked area, a specific weight will be given
Below table will be used to specify this weight.
Number of operators

Rank
2

100%

100%

100%

100%

100%

0%

50%

67%

75%

80%

0%

33%

50%

60%

0%

25%

40%

0%

20%

3
4
5
6

III.4

0%

WEIGHTED RANKING

Overall Ranking for each operator will be generated taking into account KPI weight; Value based Ranking & Number of
Operators.
Step 3:
Ranking
criteria

per

Tigo

Dialog

Mobitel

Hutch

Coverage

17%

8%

25%

0%

Voice Quality
(SQI)

3%

7%

10%

0%

Drop calls

0%

25%

8%

17%

Connectivity
(CSSR)

20%

13%

0%

7%

Signal
Quality
(RxQual)

20%

13%

7%

0%

Tigo Sri Lanka (Kaluthara territory / Kaluthara city)

Overall Score

60%

67%

50%

23%

Ranking

End of document

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 6 of 7

MIC S.A.

Voice Drive Test Procedure

Xavier Rocoplan/ Asela Gamage

Jun-08

RevA

GDL-001-VoiceDriveTestProcedure

IV ANNEX 1 - DRIVE TEST CHECK LIST

Laptop is working

Dongle is present

SAGEM OT290/ OT490 phone is working

GPS is working

SAGEM Data cable is present

GPS data cable is present

Batteries for the GPS is present (including a replacement)

New sites are updated in the drive test tool

Drive test request with the specifications is present

DOC/ PCMCIA card is present

Power adaptors/ Power cables for the GPS is present and working conditions

Power adaptors/ Power cables for the Laptop is present and working conditions

Power adaptors/ Power cables for the DOC is present and working conditions

Inverter is working

Compass is there (Especially for new sites and also antenna azimuth testing)

SIM's are working & has Sufficient Credit

Requested route is provided and loaded on the laptop (if electronic copy)

No alarm is present in the area to drive test

Measurement tapes are present

Binocular is present

Rigger is there with Alan Key and other tools (Especially tower belt)

Keys for the sites are present

End of Annex 1

T-Ref. T-PRC-RevA.dot

PRC-001-VoiceDriveTestProcedure-RevA.doc

Page 7 of 7