GSM Key Performance

Indicator(KPI(Guidebook
Version: V1.1
Security Category: Secret
Serviceable range: adio Planning Section
GSM Network Planning & Optimization Dept. of Engineering Service Division
!"# Cor$oration
%
1&
1%


Secret▲
Work Guie!ook for GSM P&O Dept.
"ersion #ntrouction
Version Date Writer Assessor Amendment Records
V1.& '&&()&1)'1 C*en C*un !*eng +ao ,one
V1.1 '&&()1')&- .ang /ia0*i
!*eng +ao1
C*en C*un1
2ei 3i$ing
1(V4 KPI and #5G# KPI 6ere added.
' (3mendment: mainly directed at V'.7-
and V8.&.
4(Some classic KPI cases and comments
6ere added.
9 ( Princi$les for KPI risk analysis 6ere
added.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%


Secret▲
CONTENTS
$ Overview.................................................................................................................................................$
% &S 'aio Service Statistical (P#.........................................................................................................)
'.1 3vailability .....................................................................................................................................9
'.1.1 S5CC+ availability;S5CC+ .............................................................................................9
'.1.' "C+ availability;"C+ ........................................................................................................9
'.1.4 Cell utili0ation.....................................................................................................................9
'.' 3ccessibility ...................................................................................................................................%
'.'.1 andom 3ccess Success rate ..............................................................................................%
'.'.' S5CC+ blocking rate ........................................................................................................%
'.'.4 "C+ blocking rate ..............................................................................................................8
'.'.9 adio connection ratio ........................................................................................................8
'.'.% S5CC+ dro$ rate................................................................................................................-
'.'.8 S5CC+ assignment success rate.........................................................................................-
'.'.- "C+ assignment success rate..............................................................................................-
'.'.( Call setu$ success rate ........................................................................................................(
'.4 Mobility ..........................................................................................................................................7
'.4.1 +andover success rate ........................................................................................................7
'.9 eliability........................................................................................................................................7
'.9.1 "C+ Call 5ro$ ate ...........................................................................................................7
'.9.' "raffic Call 5ro$ ..............................................................................................................1&
'.9.4 Call Com$letion rate .........................................................................................................1&
'.9.9 <= :>ual &)9 .................................................................................................................1&
'.9.% 5= :>ual &)9 .................................................................................................................11
'.% Call Setu$ time...............................................................................................................................11
'.%.1 Call setu$ time ?GSM to PS",@ .......................................................................................11
'.%.' Call setu$ time ?GSM to GSM@ .......................................................................................1'
* &S 'aio Service +est (P#.................................................................................................................$*
4.1 Call Setu$ Success ate ...............................................................................................................14
4.' +andover Success ate ................................................................................................................14
4.4 Call 5ro$ ate ..............................................................................................................................14
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%
1&
1%
'&
'%
4&


Secret▲
4.9 Coverage ?5rive "est@...................................................................................................................14
4.9.1 S>I ...................................................................................................................................19
4.9.' MAS .................................................................................................................................19
4.9.4 MAS B PS#>...................................................................................................................1%
) PS 'aio Service Statistical (P#.......................................................................................................$,
9.1 3ccessibility..................................................................................................................................1(
9.1.1 5= "C2 establis*ment success rate ..................................................................................1(
9.1.' <= "C2 establis*ment success rate ..................................................................................1(
9.1.4 GPS =C .......................................................................................................................17
9.1.9 GPS =C .......................................................................................................................17
9.1.% #GPS =C .....................................................................................................................'&
9.1.8 #GPS =C .....................................................................................................................'&
- PS 'aio Service +est (P#..................................................................................................................%%
%.1 3ccessibility..................................................................................................................................''
%.1.1 3ttac* success rate ...........................................................................................................''
%.1.' 3verage GPS attac* time ...............................................................................................''
%.1.4 P5P conte:t activation success rate .................................................................................''
%.1.9 P5P conte:t activation time .............................................................................................'4
%.1.% PI,G test success rate ......................................................................................................'4
%.1.8 3verage PI,G test time ....................................................................................................'4
%.' Mobility ........................................................................................................................................'9
%.'.1 outing 3rea <$date Successful rate ...............................................................................'9
%.4 5ata "*roug*$ut ...........................................................................................................................'9
%.4.1 3verage 2"P do6nload rate...............................................................................................'9
%.4.' 3verage 2"P u$load rate...................................................................................................'%
%.4.4 "*roug*$ut........................................................................................................................'%
%.9 eliability .....................................................................................................................................'%
%.9.1 P5"C+ 5ro$ ate ...........................................................................................................'%
. #ntrouction to &N Statistical (P#....................................................................................................%/
8.1 Paging success rate .......................................................................................................................'-
8.' =ocation u$date success rate ........................................................................................................'-
8.4 3ttac* success rate ........................................................................................................................'-
8.9 GPS average attac* time ............................................................................................................'(
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%
1&
1%
'&
'%
4&


Secret▲
8.% P5P conte:t activation success rate .............................................................................................'(
8.8 outing 3rea <$date Success rate ................................................................................................'(
/ &omments on (P# &ases.....................................................................................................................*0
-.1 Pengs*ui ?C*ongDing@ PS "est esult...........................................................................................4&
-.' /is*ou ?+unan@ C*ina Mobile #5G# "est esult.........................................................................41
-.4 3cce$tance reDuirements for #5G# KPI of 5ata Service of a net6ork......................................44
-.9 A$eration B Maintenance KPI of a ,et6ork................................................................................49
-.% A$eration B Maintenance KPI of a net6ork in Sout*east 3sia ...................................................48
-.8 KPI reDuirements for Indonesia "elkomsel net6ork......................................................................9&
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements.
%


Secret▲
1 Overview
"*is guidebook collected t*e Key Performance Indicators ?KPI@ for CS and PS
services1 6*ic* are no6 commonly ado$ted in $resales bidding $roEectsF and t*e
definitions of different KPIs and counter formulas for V';V4 are e:$lained *ere as
6ell. Mean6*ile1 6it* t*e aim to unify res$onse on KPIs and avoid t*e $ossible
market risks1 after analy0ing t*e $erformance indicators of current net6orks of bot*
domestic and overseas key $roEects1 t*e 6riter $rovides t*e reference values and risk
values of different KPIs in t*is guide. If t*e KPIs listed in t*e bidding documents go
beyond t*e reference values and risk values ?su$$ose risk value of t*e KPI is
$rovidedF ot*er6ise1 suggested values s*all be a$$lied.@1 6e need to conduct risk
analysis and evaluation1 mean6*ile1 try to avoid t*e risk and send out $re)6arning.
"*e KPIs can be Duite different due to t*e differences in net6ork structure and
dimension. "o make sure t*at our KPI can meet reDuirements in bidding documents1
6e need not only su$$ort from t*eories1 but accumulation of 6ork e:$erience as
6ell. "*e suggested values and risk values of KPI mentioned in t*is guide are
reference suggestions concluded from t*e current conditions of GSM net6ork. 3s
GSM tec*niDues and skills are develo$ing and eDui$ment $erformance is im$roving
constantly1 t*e reference standards for KPI 6ill c*ange accordingly.
"*e key reDuirement for engineers engaged in $resales net6ork $lanning is to
t*oroug*ly understand and master t*e related KPIs1 6*ic* is also t*e basic but
*ig*est demand for radio net6ork $lanning engineers.
G*y net6ork o$erators set u$ KPIs and 6*at are t*ey aimed atH
+o6 to define KPI and 6*at can be resulted from deviation of KPIH
+o6 muc* influence can t*e value of KPI im$ose on $resales biddingH
+o6 to clarify KPI and *o6 to ac*ieve favorable negotiation results during KPI
clarificationH
+o6 to avoid and $re)6arn KPI risksH
G*at is t*e develo$ment direction of KPI assessmentH
#ac* $resales radio net6ork $lanning engineer s*all $ossess related tec*niDues of
and u$)to)date ans6ers to t*e si: Duestions above. 2or lack of s$ace1 t*e si:
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 1(Total 46 pages
%
1&
1%
'&
'%
4&


Secret▲
Duestions 6ill not be furt*er discussed in t*is guidebook. "*e engineers 6ill be able
to e:$erience and get to kno6 t*em in $resales $lanning 6ork in future.
Generally1 KPI can be classified into four ty$es: statistical KPI1 testing KPI1
eDui$ment $erformance KPI1 customer $erce$tion KPI. Anly statistical KPI and
testing KPI are elaborated *ere. 3s for eDui$ment $erformance KPI and customer
$erce$tion KPI1 t*ey are focused on in anot*er guidebook. ,o6adays1 net6ork
o$erators are attac*ing more and more im$ortance to KPI during negotiations.
Cesides t*e four ty$es mentioned above1 a lot more as$ects are involved in KPI. KPI
is also closely related to t*e basic net6ork environment. "*erefore1 KPI is affected
by various factors. "*at is 6*y o$erators are no6 regarding KPI as a very im$ortant
leverage to s*ift risk and decrease net6ork investment and maintenance cost.
#Dui$ment manufacturers must commit t*emselves to suitable1 reasonable and
timely KPI1 so as to bring do6n contract risk and ensure $rofits. Iationali0e
commitment1 s*are risksJ is an im$ortant $rinci$le in $resales $lanning 6ork.
"*e follo6ing are t*e factors t*at s*all be taken into consideration 6*en 6e 6ork on
KPI:
1. net6ork dimensionF
'. net6ork ty$eF
4. degree of subscriber?number@ gro6t*F
9. geogra$*ical distribution of net6ork?urban1 countryside1 village@
%. eDui$ment ty$esF t*ere is difference in KPI for V' and V4.
2unctional $rinci$les for t*is guidebook ?mainly directed at KPI@:
1. "*is guide is only available to t*e radio net6ork $lanning engineers engaged in
$resales bidding. ,o one is entitled to s$read it outside or e:tensively s$read it
inside t*e com$any. "*e rig*t to inter$ret t*e serviceable range of t*is guide
remains 6it* GSM "ec*nical esearc* Section B esources Section.
'. It is suggested to release t*e guidebook in encry$ted document. It can not be
$rocured unless logging into document security soft6are.
4. "*e guide is a reference to radio net6ork $lanning staff engaged in $resales
bidding. It can not re$lace t*e $resales KPI $roEect evaluation.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 2(Total 46 pages
%
1&
1%
'&
'%
4&


Secret▲
9. "*e KPI values enclosed in t*is guide are valid 6it*in only *alf a year since t*e
release of it. 3fter *alf a year1 it needs to be u$dated and reassessed.
%. "*e guide is mostly a$$licable to V'.7- of V' and V8.& ?ISMG@ and V8.1
?Minos@ of V4.
,otes: V8.& ?ISMG@1 V8.1 ?Minos@1 sic $assim
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 3(Total 46 pages
%


Secret▲
2 CS Radio Service Statistical KPI
2.1 Availability
2.1.1 SDCCH availabilitySDCCH
KPI S5CC+ availability ?S5CC+ in service rate@
KPI reference
value
77K
Indicator
definition
S5CC+ usable totalL1&&K;?S5CC+ usable total MS5CC+ unusable total(
Counter
formula
V' C118&1L1&&K;?C118&1MC118&'@
V4
V8.& C1&&&4&1''L1&&K;? C1&&&4&1''M C1&&&4&1'4@
V8.1 C7&&&8&1''L1&&K;?C7&&&8&1''MC7&&&8&1'4@
,otes
"*e ratio of t*e S5CC+ usable total to t*e total S5CC+ allocated in net6ork is mainly
used to e:amine eDui$ment $erformance1 es$ecially to ins$ect t*e utili0ation of S5CC+ in
t*e cells. It is directly related to t*e stability of eDui$ment (transmission and $o6er su$$ly1
etc.. It reflects t*e utili0ation ratio of net6ork eDui$ment and t*e stability of initial net6ork
o$eration.
2.1.2 TCH availabilityTCH
KPI "C+ availability ?"C+ in service rate@
KPI
reference
value
7(K
Indicator
definition
"C+ usable totalL1&&K;?"C+ usable totalM "CC+ unusable total(
Counter
formula
V'
C118&-L1&&K;?C118&-MC118&(@
V4
V8.&
?C1&&&4&1'%MC1&&&4&149MC1&&&4&1%%@L1&&K ; ?C1&&&4&1'% M
C1&&&4&149 M C1&&&4&1%% M 1&&&4&1'8M C1&&&4&'1-M C1&&&4&'1(@
V8.1
?C7&&&8&1'%MC7&&&8&149MC7&&&8&1%%@ L1&&K;
?C7&&&8&1'%MC7&&&8&149M
C7&&&8&1%%MC7&&&8&1'8MC7&&&8&'1-MC7&&&8&'1(@
,otes
"*e ratio of t*e S5CC+ usable total to t*e total S5CC+ allocated in net6ork is mainly used
to e:amine eDui$ment $erformance1 es$ecially to ins$ect t*e utili0ation of S5CC+ in t*e cells. It
is directly related to t*e stability of eDui$ment(transmission and $o6er su$$ly1 etc..
2.1.! Cell "tili#atio$
KPI Cell utili0ation
KPI reference (&K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 4(Total 46 pages
%


Secret▲
value
Indicator
definition
Cells1 in 6*ic* ratio of actual traffic ; desired trafficN1
Counter
formula
,one
,otes
"*is is mainly to com$are $erformance of $re$lanning net6ork 6it* t*at of actual
net6ork. "*e $rereDuisite is t*at $recise traffic model ( traffic dis$ersion ( net6ork
ca$acity and redundancy rate s*all be $rovided in $re$lanning $eriod. "*is KPI is also
related 6it* net6ork configuration and traffic distribution.
2.2 Accessibility
2.2.1 Ra$do% Access S"ccess rate
KPI andom 3ccess Success rate
KPI reference
value
Suggested value 77K
isk value 77.%K
Indicator
definition
andom access success times L1&&K ; andom access call attem$t times
Counter
formula
V'
?C118'8MC11878)C1187-@L1&&K;?C118'%MC11878@
V4
V8.&
?C1&&&4&&&9MC1&&&4&&1&MC1&&&4&&4()?C1&&&4&&11 MC1&&&4&&47@@
L1&&K;?C1&&&4&&&4MC1&&&4&&1&MC1&&&4&&4(@
V8.1
?C7&&&8&&&9MC7&&&8&&1&MC7&&&8&&4()?C7&&&8&&11 MC7&&&8&&47@@
L1&&K;?C7&&&8&&&4MC7&&&8&&1&MC7&&&8&&4(@
,otes S5CC+ congestion rate s*all be taken into consideration1 because of its direct influence on
t*is KPI.
2.2.2 SDCCH bloc&i$' rate
KPI S5CC+ blocking rate
KPI reference
value
1K
Indicator
definition
Signaling c*annel congestion timesL1&&K ; signaling c*annel call attem$t times
Counter
formula
V'
?C118'%)C118'8MC1187-@L1&&K;?C118'%MC11878@
V4
V8.&
?C1&&&4&&&%MC1&&&4&&11MC1&&&4&&47@ L1&&K; ?C1&&&4&&&4M
C1&&&4&&1&MC1&&&4&&4(@
V8.1
?C7&&&8&&&%MC7&&&8&&11MC7&&&8&&47@L1&&K;?C7&&&8&&&4M
C7&&&8&&1&MC7&&&8&&4(@
,otes "*is is mainly to evaluate t*e fitness bet6een $re$lanned net6ork and actual net6ork. It 6ill
be affected by t*e follo6ing factors:
1. t*e fitness bet6een net6ork desired ca$acity and actual ca$acityF fitness bet6een $reset
traffic model and t*e actual oneF '. burst trafficF 4. lack of S5CC+ ca$acityF 9. internal B
e:ternal interferenceF %. $re$lanned redundancy rateF 8. o$eratorsO s$ecial reDuestsF -. 2 and
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 5(Total 46 pages


Secret▲
+ used as signaling c*annel.
2.2.! TCH bloc&i$' rate
KPI "C+ blocking rate
KPI
reference
value
'K
Indicator
definition
"C+ congestion timesL1&&K; "C+ call attem$ts
Counter
formula
V' (C1181')C11877(L1&&K;(C11811)C1187((
V
4
V8.&
?C1&&&4&&'&MC1&&&4&&41MC1&&&4&&94MC1&&&4&&9-MC1&&&4&&'' M
C1&&&4&&44MC1&&&4&&9%MC1&&&4&&97@L1&&K;?C1&&&4&&17MC1&&&4&&4&M
C1&&&4&&9'MC1&&&4&&98MC1&&&4&&'1MC1&&&4&&4' MC1&&&4&&99MC1&&&4&&9(@
V8.1
?C7&&&8&&'&MC7&&&8&&41MC7&&&8&&94MC7&&&8&&9-MC7&&&8&&''MC7&&&8&&44M
C7&&&8&&9%MC7&&&8&&97@L1&&K;?C7&&&8&&17MC7&&&8&&4&MC7&&&8&&9'MC7&&&8&&98M
C7&&&8&&'1MC7&&&8&&4'MC7&&&8&&99MC7&&&8&&9(@
,otes
"*is is mainly to evaluate t*e fitness bet6een $re$lanned net6ork and actual net6ork1 and t*e $recondition is
t*at $recise traffic model ( traffic dis$ersion ( net6ork ca$acity and redundancy rate s*all be $rovided in
$re$lanning $eriod. It is related to t*e follo6ing factors:
1. t*e fitness bet6een net6ork desired ca$acity and actual ca$acityF fitness bet6een $reset traffic model and
t*e actual oneF '. burst trafficF 4. lack of "C+ ca$acityF 9. internal B e:ternal interferenceF %. $re$lanned
redundancy rateF 8. *andovers.
2.2.( Radio co$$ectio$ ratio
KPI adio connection ratio
KPI
reference
value
7-K
Indicator
definition
(1)signalling c*annel congestion rate(L?1)voice c*annel congestion rate@L1&&K
Counter
formula
V'
?1)?C118'%)C118'8MC1187-@L1&&K;?C118'%MC11878@@L?1)?C1181')C11877@;?C11811)C1187(@@
V
4
V8.&
?1)?C1&&&4&&&%MC1&&&4&&&-@L1&&K ; ?C1&&&4&&&4MC1&&&4&&&8@@ L ?1)?C1&&&4&&11
MC1&&&4&&'&M C1&&&4&&41MC1&&&4&&47 MC1&&&4&&94 M C1&&&4&&9- MC1&&&4&&14M
C1&&&4&&'' MC1&&&4&&44MC1&&&4&&91 MC1&&&4&&9%MC1&&&4&&97@ ; ?C1&&&4&&1&M
C1&&&4&&17M C1&&&4&&4& M C1&&&4&&4(M C1&&&4&&9'MC1&&&4&&98M C1&&&4&&1'M
C1&&&4&&'1 MC1&&&4&&4'MC1&&&4&&9& MC1&&&4&&99MC1&&&4&&9(@@
V8.1 ?1)?C7&&&8&&&%MC7&&&8&&11MC7&&&8&&47@L1&&K;
?C7&&&8&&&4MC7&&&8&&1&MC7&&&8&&4(@@L?1)
?C7&&&8&&'&MC7&&&8&&41MC7&&&8&&94MC7&&&8&&9-MC7&&&8&&''MC7&&&8&&44M
C7&&&8&&9%MC7&&&8&&97@;?C7&&&8&&17MC7&&&8&&4&MC7&&&8&&9'MC7&&&8&&98M
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 6(Total 46 pages


Secret▲
C7&&&8&&'1MC7&&&8&&4'MC7&&&8&&99MC7&&&8&&9(@@
,otes
"*is is mainly to com$are $erformance of $re$lanned net6ork 6it* t*at of actual net6ork. "*e $rereDuisite is t*at
$recise traffic model (traffic dis$ersion (net6ork ca$acity and redundancy rate s*all be $rovided in $re$lanning
$eriod. "*is KPI is in direct tie)in constraint 6it* S5CC+ blocking rate and "C+ blocking rate.
2.2.) SDCCH dro* rate
KPI S5CC+ dro$ rate
KPI reference
value
Suggested value &.1K
isk value &.&%K
Indicator
definition
S5CC+ call dro$ totalL1&&K;?random access call attem$ts M voice c*annel call attem$ts total
?*andover e:cluded@(signalling(@
Counter
formula
V' C118&%L1&&K;?C118'%MC11878@
V4 V8.& C1&&&4&&%4L1&&K;?C1&&&4&&&4MC1&&&4&&1&MC1&&&4&&4(@
V8.1 C7&&&8&&%4L1&&K;?C7&&&8&&&4MC7&&&8&&1&MC7&&&8&&4(@
,otes
C118&% accumulates S5CC+ call dro$s resulted from all reasons1 including radio link
failure ( =3P5 link breaks ( *andover failure1 etc.1 but e:ce$t t*e follo6ing four reasons: lost
connection 6it* SMM1 forced AMC) disconnection1 forced disconnection by ot*er calls1 and ot*er
causes. If 6e com$ute according to t*e formula above1 S5CC+ call dro$ rate 6ill be rat*er lo6. If
counter 11814% is included ?CSS call dro$ times on S5CC+@1 t*e suggested KPI value is &.8K1 and
suggested risk value &.9K.
C1&&&4&&%4;C7&&&8&&%4 is used to find out t*e freDuency of call dro$s resulted from radio link
failure(=3P5 link breaks(*andover failure. "*is KPI value is relatively lo6er.
2.2.+ SDCCH assi'$%e$t s"ccess rate
KPI S5CC+ assignment success rate
KPI reference
value
Suggested value 78K
isk value 7(K
Indicator
definition
S5CC+ assignment success rateL1&&;?S5CC+ assignment success times MS5CC+ assignment
failure times@
Counter
formula
V' C11899L1&&K;? C11899M C1189%@
V4
V8.
&
C1&&9'&&19L1&&K;(C1&&9'&&19MC1&&9'&&1%@
V8.
1
C7&1'%&&19L1&&K;?C7&1'%&&19MC7&1'%&&1%@
,otes
S5CC+ assignment success rate is involved 6it* many factors1 suc* as =3P5 link (freDuency
interference(access $arameters1 etc..
2.2., TCH assi'$%e$t s"ccess rate
KPI "C+ assignment success rate
KPI reference
value
Suggested
value
7(K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 7(Total 46 pages


Secret▲
isk value 77K
Indicator
definition
"C+ assignment success timesL1&&;? "C+ assignment success times M"C+ assignment
failure times@
Counter
formula
V'
C118%-L1&&K;?C118%-MC118%(@
V4
V8.&
?C1&&&4&&1-MC1&&&4&&'(MC1&&&4&&48MC1&&&4&'4% M
C1&&&4&177MC1&&&4&'1&@L1&&K;?C1&&&4&&1-MC1&&&4&&'(
MC1&&&4&&48MC1&&&4&&1(MC1&&&4&&'7MC1&&&4&&4-M
C1&&&4&'4%MC1&&&4&177MC1&&&4&'1&MC1&&&4&'&&M
C1&&&4&'11MC1&&&4&14%@
V8.1
?C7&&&8&&1-MC7&&&8&&'(MC7&&&8&&48MC7&&&8&177M
C7&&&8&'1&MC7&&&8&'4%@ L1&&K;?C7&&&8&&1(MC7&&&8&&'7M
C7&&&8&&4-MC7&&&8&'&&MC7&&&8&'11MC7&&&8&14%M
C7&&&8&&1-MC7&&&8&&'(MC7&&&8&&48MC7&&&8&177M
C7&&&8&'1&MC7&&&8&'4%@
,otes "*is KPI is directly related to radio environment ( freDuency carrier
$roblems(assignment met*ods(a$$lication of data service1 etc..
2.2.- Call set"* s"ccess rate
KPI Call setu$ success rate (CSS(
KPI reference
value I
Suggested value 7'K
isk valueP 79K
Indicator
definition I
?1)S5CC+ blocking rate@L ?1)S5CC+ assignment failure rate@L?1)S5CC+ dro$
rate@L?1)"C+ blocking rate@L?1)"C+ assignment failure rate@
,ote I "*e definition of t*is CSS is relatively strict because too many factors are included
?=3C(SMS1 etc.@. "*e definition is not rational from t*e vie6 of voice call1 so t*at t*e
CSS used in MA"A e:cluded SMS factor. +andover is e:cluded.
KPI reference
value II
Suggested value 74K
isk value 7%K
Indicator
definition II
??MAC success M M"C success ( ; ?MAC attem$t M M"C attem$t@@ L?1)S5CC+ dro$
rate@L?1)"C+ blocking rate@L?1)"C+ assignment failure rate@
,ote II 3ccording to common understanding1 CSS is mostly a$$lied to ins$ect t*e establis*ment
of voice call. It is rat*er reasonable to e:clude =3C and SMS. +andover is e:cluded.
KPI reference
value III
Suggested value 7-K
isk value 7%K
Indicator
definition III
??MAC success M M"C success ( ; ?MAC attem$t M M"C attem$t@@ L?1)S5CC+ dro$
rate@L?1)"C+ blocking rate@L?1)"C+ assignment failure rate@
,ote III "*e CSS is mainly measured in t*e vie6 of congestion. It is similar to +utc*isonOs
definition of CSS. +andover e:cluded.
Counter
formula
CSS is usually obtained from t*e combination of original KPI.
#:$lanation 5ifferent manufacturers *ave different definitions for CSS. "*e formula above is
regarded too strict. Some may define it to be "C+ assignment success rate or radio access
com$letion rate. Ge need to make clear t*e formula 6it* customers. It is regarded a
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 8(Total 46 pages


Secret▲
favorable 6ay to e:clude location u$date indicators 6*en 6e define t*is KPI.
2.! .obility
2.!.1 Ha$dover s"ccess rate
KPI +andover success rate
KPI reference
value
V'
Suggested value 79K
isk value 78K
V4
Suggested value 7%K
isk value 7-K
Indicator
definition
+andover success times in busy *oursL1&&K ; *andover reDuest times in busy *ours
Counter
formula
V'
?C1181(MC11887)C118-%@L1&&K;?C1181-MC1188()
C118-%@
V4
V8.&
?C1&&&4&&7(MC1&&&4&1&'MC1&&&4&1'&MC1&&&4&&79M
C1&&&4&&78@L1&& K; ?C1&&&4&&7-MC1&&&4&'14M
C1&&&4&'19M C1&&&4&'1%MC1&&&4&&77MC1&&&4&1&&
MC1&&&4&1&1MC1&&&4&'18 MC1&&&4&117 MC1&&&4&&74
MC1&&&4&&7%@
V8.1
?C7&&&8&&7(MC7&&&8&1&'MC7&&&8&1'&MC7&&&8&&79M
C7&&&8&&78@ L1&&K;
?C7&&&8&&7-MC7&&&8&'14MC7&&&8&'19M
C7&&&8&'1%MC7&&&8&&77MC7&&&8&1&&MC7&&&8&1&1M
C7&&&8&'18MC7&&&8&117MC7&&&8&&74MC7&&&8&&7%@
,otes
"*is formula includes bot* incoming and outgoing *andovers1 6*ile some o$erators may take
into consideration only one of t*em. 3s for V4 eDui$ment1 1)'K can be a$$ro$riately increased
according to real situations. "*is KPI can differ a lot from eac* ot*er due to different ty$es of
net6ork. In many $resales bidding1 t*e o$erators reDuire a *andover success rate of around 7(K1
6*ic* involves *ig* risks to be reac*ed1 t*oug* several net6orks *ave reac*ed 7(K.
2.( Reliability
2.(.1 TCH Call Dro* Rate
KPI "C+ dro$ rate ; Call dro$ rate
KPI reference
value
V'
Suggested value 1.&K
isk value &.-K
V4
Suggested value &.-
isk value &.%
Indicator
definition
"C+ call dro$ timesL1&&K;"C+ assignment success times
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 9(Total 46 pages


Secret▲
Counter
formula
V'
C1181%L1&&K;?C11811)C1187()?C1181'MC118%8MC118%(M
C1181-)C1181()C11877)C1181&4)C118144@@
V4
V8.
&
?C1&&&4&&%9MC1&&&4&&%%@L1&&K;?C1&&&4&&'(M C1&&&4&&48M
C1&&&4&177MC1&&&4&'1&M C1&&&4&&7(MC1&&&4&1&'MC1&&&4&1'&@
V8.
1
?C7&&&8&&%9MC7&&&8&&%%@ L1&&K;?C7&&&8&&'(MC7&&&8&&48M
C7&&&8&177MC7&&&8&'1&MC7&&&8&&7(MC7&&&8&1&'M
C7&&&8&1'&@
,otes
Voice c*annel call dro$ rate falls into t6o ty$es: one is 6it* *andover includedF t*e ot*er is 6it*
*andover e:cluded. "*e formula above takes *andover in it. If *andover is not included1 t*e indicator
6ill be about &.'K *ig*er t*an t*e one 6it* *andover included. "*is discre$ancy is not universally
definite yet1 for it can be bigger in dual)band net6ork. Generally1 call dro$ rate of V4 eDui$ment is a
bit lo6er t*an t*e one of V'. "*is KPI differs a lot in varied ty$es of net6ork. "*e discre$ancy can
reac* &.4K.
2.(.2 Tra//ic Call Dro*
KPI Minute $er dro$?MP5@
KPI reference
value
V'
Suggested value 7&
isk value 1'&
V4
Suggested value 1'&
isk value 1(&
Indicator
definition
"raffic ;"C+ call dro$ timesL8&
Counter
formula
V2 ?C11818;48&&@L8&;C1181%
V
3
V8.&
??C1&&&4&1'7MC1&&&4&1'-@;48&&@L8&;
?C1&&&4&&%9MC1&&&4&&%%@
V8.1 ??C7&&&8&1'7MC7&&&8&1'-@;48&&@L8&;?C7&&&8&&%9MC7&&&8&&%%@
,otes "*is KPI of different net6orks varies to a large e:tent. Generally1 itOs difficult for to
reac* t*is KPIOs standards1 if t*e call dro$ ?6it* *andover included@ rate is *ig*er t*an
&.%K.
2.(.! Call Co%*letio$ rate
KPI Call Success ate (CS(
KPI
reference value
Suggested
value
7'K
isk value 79K
Indicator
definition
CSSL?1) Call dro$ rate@
Counter
formula
,one. efer to Indicator 5efinition II under Item '.'.(
,otes "*is formula is a customer KPI. Ge need to make it clear 6it* customers
6*en referring to t*is KPI. Cut it is close to customersO $erce$tion.
2.(.( 01 R23"al 45(
KPI <= :>ual &)9
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 10(Total 46 pages


Secret▲
KPI reference
value
Suggested
value
7%K
isk value 7-K
Indicator
definition
<= :>ual &)9 L1&& ; <= :>ual &)-
Counter
formula
V'
?C118119MC11811%MC118118MC11811-MC11811(@ L 1&& ; ?C118119
MC11811%MC118118MC11811-MC11811(M C118117
MC1181'&MC1181'1@
V4
V8.&
?C1&&&4&&88M C1&&&4&&8-M C1&&&4&&8(M C1&&&4&&87M
C1&&&4&&-&@L1&&; ?C1&&&4&&88M C1&&&4&&8-M C1&&&4&&8(M
C1&&&4&&87M C1&&&4&&-&M C1&&&4&&-1M C1&&&4&&-'M C1&&&4&&-4@
V8.1
?C7&&&8&&88M C7&&&8&&8-M C7&&&8&&8(M C7&&&8&&87M
C7&&&8&&-&@L1&&; ?C7&&&8&&88M C7&&&8&&8-M C7&&&8&&8(M
C7&&&8&&87M C7&&&8&&-&M C7&&&8&&-1M C7&&&8&&-'M C7&&&8&&-4@
,otes
,one
2.(.) D1 R23"al 45(
KPI 5= :>ual &)9
KPI reference
value
Suggested
value
7%K
isk value 7-K
Indicator
definition
5= :>ual &)9 L1&& ; 5= :>ual &)-
Counter
formula
V'
?C1181''MC1181'4MC1181'9MC1181'%MC1181'8MC1181'-@L 1&& ;
?C1181'' MC1181'4MC1181'9MC1181'%MC1181'8 MC1181'-
MC1181'(MC1181'7@
V4
V8.
&
? C1&&&4&&-9M C1&&&4&&-% M C1&&&4&&-8M C1&&&4&&-- M
C1&&&4&&-(@L1&&; ? C1&&&4&&-9M C1&&&4&&-% M C1&&&4&&-8M C1&&&4&&-- M
C1&&&4&&-(M C1&&&4&&-7M C1&&&4&&(&M C1&&&4&&(1@
V8.
1
? C7&&&8&&-9M C7&&&8&&-% M C7&&&8&&-8M C7&&&8&&-- M
C7&&&8&&-(@L7&&; ? C7&&&8&&-9M C7&&&8&&-% M C7&&&8&&-8M C7&&&8&&-- M
C7&&&8&&-(M C7&&&8&&-7M C7&&&8&&(&M C7&&&8&&(1@
,otes ,one
2.) Call Set"* ti%e
2.).1 Call set"* ti%e 67S. to PSTN8
KPI Call setu$ time ?GSM to PS",@
KPI reference
value
Suggested
value
( seconds
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 11(Total 46 pages


Secret▲
isk value % seconds
Indicator
definition
time duration from starting call to ringing out
,otes Ge can use test soft6are to estimate t*e time duration1 6*ic* is related 6it* net6ork
structure(routing and radio environment. MSC $rovides t*is KPI. It differs in different
net6ork configurations.
2.).2 Call set"* ti%e 67S. to 7S.8
KPI Call setu$ time ?GSM to GSM@
KPI reference
value
Suggested
value
- seconds
isk value % seconds
Indicator
definition
Abtain from test t*e time duration from starting call to ringing out
,otes Ge can use test soft6are to estimate t*e time duration1 6*ic* is related 6it* net6ork
structure(routing and radio environment. MSC $rovides t*is KPI. It differs in different
net6ork configurations.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 12(Total 46 pages


Secret▲
! CS Radio Service Test KPI
!.1 Call Set"* S"ccess Rate
KPI Call Setu$ Success ate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator
definition
Call connection timesL1&&K ; call attem$t times
Indicator value 5"BC>"1 test $re)defined locations and 5rive "est route
,otes ,one
!.2 Ha$dover S"ccess Rate
KPI +andover Success ate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator
definition
+andover success timesL1&&K ; *andover attem$t times
Indicator value 5"BC>"1 Pre 5efined 5rive "est oute or ,MS
,otes ,one
!.! Call Dro* Rate
KPI Call 5ro$ rate
KPI reference
value
Suggested
value
4K
isk value 'K
Indicator
definition
Call dro$ timesL1&&K ; call connection times
Indicator value 5"BC>"1 test Pre 5efined 5rive "est oute or ,MS
,otes ,one
!.( Covera'e 6Drive Test8
1r!an Su!ur!an 'ural 'oa
Illustration of
coverage
reDuirement
(%K of t*e
sam$le values
s*ould *ave a value
(%K of t*e
sam$le values
s*ould *ave a value
(%K of t*e
sam$le values
s*ould *ave a value
(%K of t*e
sam$le values
s*ould *ave a value
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 13(Total 46 pages
%


Secret▲
eDual to or *ig*er
t*an Q-% dCm.
eDual to or *ig*er
t*an Q(& dCm.
eDual to or *ig*er
t*an Q(% dCm.
eDual to or *ig*er
t*an Q7& dCm.
Influencing factors 1. landformF '. inconsistency bet6een $roEect im$lementation and $roEect $lansF
4. test eDui$mentF 9. test routes
,otes
5etailed coverage reDuirements ?as s*o6n above@ are delivered in t*e bid documents.
#stimation of net6ork dimension is also based on t*e reDuirements. ,o6adays1
reDuirements for net6ork coverage are *ig*er1 so t*e accordingly estimated number of
sites 6ill meet t*e needs. If t*e net6ork dimension *as to be reduced due to market
strategies needs1 t*is KPI 6ill cause $roblems in t*e acce$tance ins$ection. 2urt*er more1
6e need to make sure t*at our customers are a6are of regional assignment (5" routes and
test met*ods. Coverage KPI is one of t*e most im$ortant KPIs1 because it directly reflects
not only our radio net6ork $lanning ability and t*e $erformance of our eDui$ment1 but
also our core com$etitive strengt* in net6ork $lanning. 5ue to lack of s$ace1 t*ere is no
more illustration of coverage KPI *ereafter in t*is guide.
!.(.1 S3I
KPI S>I
KPI reference
value
Suggested
value
7%K sam$le RS1(
isk value 7%K sam$le RS'%
Indicator
definition
"#MS test value
,otes
"*is KPI is for ins$ecting t*e sound distortion degree resulted from inca$able link
transmission. "*e formula is #ricssonOs $atent. It takes into consideration many factors1
including C#(2#(*andover times(*andover conditions(5"T activated ?or not@(and
t*e encoder in use1 etc.1 to finally get t*e S>I. "*ere are different S>I to$ limits for
different ty$es of encoders. 2or *alf)rate encoder1 t*e S>I to$ limit is 17F for full)rate
encoder1 '1F for en*anced full)rate encoder1 4&. S>I ranges from 1( to 4&. S>I value 6ill
increase 6*en #2 is a$$lied.
!.(.2 .OS
KPI Mean A$inion Score ? MAS@
KPI reference
value
efer to t*e form attac*ed bello6.
Indicator
definition
"est value
,otes "*e commonly used MAS assessment met*od consists of subEective and obEective scoring
$arts. In t*e subEective $art1 engineers subEectively com$are t*e original voice material
and t*e deteriorated voice material according to I"<)" Suggestion book P.(&& and P.(4&1
and give t*eir MAS scores res$ectively1 t*en average t*e scores from different engineers.
G*ile in t*e obEective $art1 P#S> met*od from I"<)" Suggestion book P.(8' is
em$loyed1 t*at is s$ecial eDui$ment or soft6are ?e.g. t*e V>" test eDui$ment of 3gilent@
is used to $roceed t*e assessment. In MAS1 & means t*e 6orst Duality1 % stands for t*e
*ig*est. Standard PCM Duality s*all reac* around 9.9.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 14(Total 46 pages


Secret▲
"*e MAS values for commonly used coding formats are as follo6s:
G.-11UUMAS( 9.(
G.-'1(G.-'4(G.-'8UUMAS( 9.'
G.-'( UUMAS(9.'
G.-'7 UUMAS(9.'
G.-'4.1(%.4(UUMAS(4.%
G.-'4.1(8.4(UUMAS(4.7(
MAS can be affected greatly by t*e $erformance of test eDui$ment. "*e test results
from different manufacturers are different. Currently1 t*e test eDui$ment from 3ctena
$erforms t*e best.
Voice version combination
Average MOS(Incl!"ng #$ %&$
MOS'
T#O
2reDuency
*o$$ing
,o freDuency
*o$$ing
2reDuency
*o$$ing
,o freDuency
*o$$ing
100( #$ 3)04 3)29 ( (
100( *#$ 3)63 3)57 ( (
100( AM$ #$ 3)56 3)54 ( (
60( &$ (+*#$' ( ( ( (
30( &$ (+*#$' ( ( ( (
10( &$ (+*#$' ( ( ( (
60( AM$ &$ (+AM$ #$' ( ( ( (
30( AM$ &$ (+AM$ #$' ( ( ( (
10( AM$ &$ (+AM$ #$' ( ( ( (
!.(.! .OS 9 PSE3
SubEective scoring met*od *ad been used in assessment on voice Duality until '&&1.
<sers 6ere reDuested to assess t*e voice Duality of incoming calls by scoring 1)% ?%)
best1 1 ) 6orst@. "*is assessment met*od 6as regulated to be a standard by I"< in
3ugust1 1778. MAS assessment met*od 6as defined in its P.(&& standard in details.
Cut later it 6as found t*at t*is met*od not only took too muc* time1 but also cost a
lot. So t*ere 6as an urgent need for a kind of economic test eDui$ment1 6*ic* can be
used to simulate t*e voice Duality received by users1 and t*us can $lay its $art in
designing(testing and debugging ne6 ty$e of voice encoders.
Git* t*e aim to meet t*e need1 in 2ebruary '&&1 I"< issued t*e ne6 test standard on
voice transmission Duality)P.(8' ?P#S>)Perce$tual #valuation of S$eec* >uality@.
It ado$ts t*e ne6 algorit*m develo$ed by Psytec*nics com$any. P#S> can be used
to com$ute voice sam$leOs MAS)=>A value ?Mean A$inion Score)=istening
>uality AbEective@. "*e com$uted result and t*e subEective scoring result are
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 15(Total 46 pages
%
1&
1%


Secret▲
basically t*e same. P#S> com$ares t*e out$ut signal ?collected after t*e signal is
transmitted t*roug* eDui$ment@ and t*e reference signal1 t*en 6orks out t*e
difference. In t*e ordinary course of event1 t*e bigger t*e difference bet6een t*e
out$ut signal and t*e reference signal1 t*e smaller t*e reference value of MAS 6ill
be. P#S> is testified to be a reliable(economic and fast measuring tool for voice
encoder. Com$are P#S>Os $redicted value and t*e result from subEective scoring
met*od1 6e can see t*e correlation bet6een t*e t6o values is &.74%?refer to
(P(8'#.doc (for correlation factors@. 2or '' kinds of I"< benc*mark tests1 t*e
absolute error is 6it*in &.% MAS1 87.'K among 6*ic* is 6it*in &.'% MAS. It is
6ort* our attention t*at P#S> value ranges from &.% to 9.%1 6*ile MAS value
ranges from 1 to %.
#"g 1 MOS,P*S- .orrelat"on /"agra0
3t t*e $resent time1 t*ere are t6o ty$es of >AS test met*od)subEective and obEective
met*ods. MAS subEective test met*od is defined in I"<)" P.(&&. "*e obEective test
met*ods includes PS>M( PS>MM and P#S> etc.. I"<)" P.(8' ( P#S>( is t*e
met*od currently recommended by I"< to test end)to)end net6ork voice Duality. It
6ould be ideal if MAS and P#S> are simultaneously su$$orted in t*e >AS test.
#or0 1 /e1"n"t"on o1 MOS 2ales
=evel MAS
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 16(Total 46 pages
%
1&
1%
'&


Secret▲
#:cellent %
Good 9
2air 4
Poor '
Cad 1
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 17(Total 46 pages


Secret▲
( PS Radio Service Statistical KPI
(.1 Accessibility
(.1.1 D1 T:; establis<%e$t s"ccess rate
KPI 5= "C2 establis*ment success rate
KPI reference
value
Suggested value 7%K
isk value 78K
Indicator ty$e Statistical value
Indicator
definition
(GPS 5= signalling "C2 link setu$ timesM GPS 5= data "C2 link setu$
times M#GPS 5= signalling "C2 link setu$ times M#GPS 5= data "C2 link
setu$ times(L1&&K; 5= $acket c*annel reDuest times(V4(
Counter
formula
V'
?C-&&94MC-&&%-MC-&&-1@L1&&;C-&&91
V4
V8.&
?C1&&&1&&&-MC1&&&1&&1%MC1&&&1&&&(MC1&&&1&&18@
L1&&K;?C1&&&1&191MC1&&&1&19'MC1&&&1&194M
C1&&&1&199MC1&&&1&19%MC1&&&1&198MC1&&&1&19-
MC1&&&1&19(@
V8.1
?C7&&&9&&&-MC7&&&9&&1%MC7&&&9&&&(MC7&&&9&&18@
L1&&K;?C7&&&9&191MC7&&&9&19'MC7&&&9&194M
C7&&&9&199MC7&&&9&19%MC7&&&9&198MC7&&&9&19-
MC7&&&9&19(@
,otes
"*is KPI reflects t*e reDuest fulfilled status of PS do6nlink resources. Its "C2
includes 5= signaling "C2(GPS 5= data "C2 and #GPS 5= data "C2. 5= "C2
link setu$ success rate can reflect t*e 5= PS Duality of a cell. Its maEor influencing
factors are as follo6s:
1. Interference: internal B e:ternal interferenceF
'. Parameters setting: eg. errors in "imer and functional $arameters
4. Stability of eDui$ment and transmission: eg. instant breakdo6n?flas*@
resulted from *ig* error rate or unstable linkF
9. <sability of data service functions.
(.1.2 01 T:; establis<%e$t s"ccess rate
KPI <= "C2 establis*ment success rate
KPI
reference
value
Suggested
value
7'K
isk value 7%K
Indicator ty$e Statistical value
Indicator
definition
(GPS <= signalling "C2 link setu$ times M GPS <= data "C2 link setu$ times
M#GPS <= signalling "C2 link setu$ times M#GPS <= data "C2 link setu$
times(L1&&; <= $acket c*annel reDuest times(V4(
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 18(Total 46 pages


Secret▲
Counter
formula
V' ?C-&&9'MC-&&%%MC-&&87@L1&&K;C-&&9&
V4
V8.&
?C1&&&1&&'%MC1&&&1&&44MC1&&&1&&'8MC1&&&1&&49@
L1&&K ;?C1&&&1&1%7 MC1&&&1&18&MC1&&&1&181MC1&&&1&18(
MC1&&&1&184MC1&&&1&189M C1&&&1&18%MC1&&&1&188@
V8.1
?C7&&&9&&'%MC7&&&9&&44 MC7&&&9&&'8 MC7&&&9&&49@
L1&&K; ?C7&&&9&1%7M C7&&&9&18&
MC7&&&9&181MC7&&&9&18(MC7&&&9&184 MC7&&&9&189
MC7&&&9&18%MC7&&&9&188@
,otes
"*is KPI reflects t*e reDuest fulfilled status of PS u$link resources. Its "C2 includes
<= signaling "C2(GPS <= data "C2 and #GPS <= data "C2. <= "C2 link setu$
success rate can reflect t*e <= PS Duality of a cell. Its maEor influencing factors are as
follo6s:
1. Interference: internal B e:ternal interferenceF
'. Parameters setting: eg. errors in "imer and functional $arameters
4. Stability of eDui$ment and transmission: eg. instant breakdo6n resulted
from *ig* error rate or unstable linkF
9. <sability of data service functions.
(.1.! 7PRS R1C
KPI <= GPS =C retransmission rate
KPI
reference
value
Suggested
value
1&K
isk value %K
Indicator ty$e Statistical value
Indicator
definition
GPS <= "C2 ,3CK blocks L1&&K ; valid data statistics received by GPS <=
"C2
Counter
formula
V' C-&&88L1&&K; C-&&8%
V4
V8.&
C1&&&1&&84L1&&K;C1&&&1&&8'
V8.1
C7&&&9&&84L1&&K;C7&&&9&&8'
,otes
"*is KPI reveals <= GPS =C retransmission rate1 6*ic* is t*e most im$ortant
indicator to reflect t*e sensibility of GPS <= service and to s*o6 6*et*er
instability(congestion and interference e:ist in t*e system. Its maEor influencing factors
are as follo6s:
1. Interference: internal B e:ternal interferenceF
'. Stability of eDui$ment and transmission: eg. instant breakdo6n resulted
from *ig* error rate or unstable linkF
(.1.( 7PRS R1C
KPI 5= GPS =C retransmission rate
KPI Suggested 1&K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 19(Total 46 pages


Secret▲
reference
value
value
isk value %K
Indicatory
ty$e
Statistical value
Indicator
definition
GPS 5= "C2 ,3CK blocks L1&&K ; valid data statistics received by GPS 5=
"C2
Counter
formula
V' C-&&8(L1&&K; C-&&8-
V4
V8.&
C1&&&1&&8%L1&&K;C1&&&1&&89
V8.1
C7&&&9&&8%L1&&K;C7&&&9&&89
(( ,otes
"*is KPI reveals 5= GPS =C retransmission rate1 6*ic* is t*e most im$ortant
indicator to reflect t*e sensibility of GPS 5= service and to s*o6 6*et*er
instability(congestion and interference e:ist in t*e system. Its maEor influencing factors
are as follo6s:
1. Interference: internal B e:ternal interferenceF
'. Stability of eDui$ment and transmission: eg. instant breakdo6n resulted
from *ig* error rate or unstable linkF
(.1.) E7PRS R1C
KPI <= #GPS =C retransmission rate
KPI
reference
value
Suggested
value
1&K
isk value %K
Indicatory
ty$e
Statistical value
Indicator
definition
#GPS <= "C2 ,3CK blocks L1&&K ; valid data statistics received by #GPS <=
"C2
Counter
formula
V' C-&&(&L1&&K; C-&&-7
V4
V8.&
C1&&&1&&-1L1&&K;C1&&&1&&-&
V8.1
C7&&&9&&-1L1&&K;C7&&&9&&-&
(( ,otes efer to <= GPS =C retransmission rate
(.1.+ E7PRS R1C
KPI 5= #GPS =C retransmission rate
KPI
reference
value
Suggested
value
1&K
isk value %K
Indicatory
ty$e
Statistical value
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 20(Total 46 pages


Secret▲
Indicator
definition
#GPS 5= "C2 ,3CK blocks L1&&K ; valid data statistics received by #GPS 5= "C2
Counter
formula
V' C-&&('L1&&K; C-&&(1
V4
V8.&
C1&&&1&&-4L1&&K;C1&&&1&&-'
V8.1
C7&&&9&&-4L1&&K;C7&&&9&&-'
,otes efer to 5= GPS =C retransmission rate
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 21(Total 46 pages


Secret▲
) PS Radio Service Test KPI
).1 Accessibility
).1.1 Attac< s"ccess rate
KPI 3ttac* success rate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator
definition
3ttac* success times;3ttac* attem$t timesV1&&(
Indicatory
ty$e
test
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e C>" value. 3ttac* success means t*at t*e
mobile $*one receives t*e 3ttac* 3cce$t signaling 6it*in 1% seconds
after it sends t*e 3ttac* eDuest. It is reDuired to $erform t*e 3ttac*
test ten times at eac* test site.
).1.2 Avera'e 7PRS attac< ti%e
KPI 3verage GPS attac* time
KPI reference
value
Suggested value ' sec
isk value 1.% sec
Indicator
definition
Sum of attac* success duration; 3ttac* success times. It is t*e
duration from t*e mobile sends out t*e first 3ttac* eDuest to it
receives t*e 3ttac* 3cce$t signaling.
It is reDuired to $erform t*e test ten times at eac* test site.
Indicatory ty$e "est value
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value. 3ut*entication
included.
).1.! PDP co$te2t activatio$ s"ccess rate
KPI P5P conte:t activation success rate
KPI reference
value
Suggested
value
7%K
isk value 7(K
Indicator P5P activation success times;attem$t times V1&&(.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 22(Total 46 pages
%


Secret▲
definition P5P activation success means t*at t*e mobile $*one receives t*e
3ctivate P5P Conte:t 3cce$t signaling 1% seconds after it sends t*e
3ctivate P5P Conte:t eDuest.
Indicatory ty$e "est
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value. It is reDuired to
$erform t*e P5P activation test ten times at eac* test site. "est met*ods
for GPS and #5G# are t*e same.
).1.( PDP co$te2t activatio$ ti%e
KPI P5P conte:t activation time
KPI reference
value
Suggested value 1.% sec
isk value 1.' sec
Indicator
definition
Sum of P5P activation duration; P5P activation success
times.
P5P activation time means t*e duration from t*e mobile
$*one sends out t*e first 3ctivate P5P Conte:t eDuest
to it receives t*e 3ctivate P5P Conte:t 3cce$t.
Indicatory ty$e "est value
Counter
formula
,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value.
3ut*entication included. GPS and #5G# are not
se$arated in t*is test.
).1.) PIN7 test s"ccess rate
KPI PI,G test success rate
KPI reference
value
Suggested value 7%K
isk value 7(K
Indicator
definition
Ping success times;Ping attem$t timesL1&&K
Counter
formula
,one
,otes It is regarded as failure if t*e time e:ceeds 4& seconds.
).1.+ Avera'e PIN7 test ti%e
KPI PI,G test time
KPI reference
value
GPS
Suggested value 1.% sec
isk value 1.9 sec
#5G#
Suggested value 1 sec
isk value &.8 sec
Indicator Sum of Ping success duration; Ping success times
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 23(Total 46 pages


Secret▲
definition
Indicatory ty$e "est value
Counter
formula
,one
,otes 3ut*entication is included in t*is KPI. "*e Ping $ackage si0e
6ill *ave influence on t*e test result. Generally1 t*e smaller
t*e Ping $ackage is1 t*e better t*e test result 6ill be. It is
sometimes referred as ound "ri$ "ime.
).2 .obility
).2.1 Ro"ti$' Area 0*date S"ccess/"l rate
KPI outing 3rea <$date Success rate
KPI reference
Suggested value 7&K
isk value 7%K
Indicator
definition
outing u$date attem$t timesL1&&K ; outing u$date success times
Indicatory ty$e test
Counter
formula
,one
,otes <sually it can be statistical value. It also can be obtained from 5" too.
).! Data T<ro"'<*"t
).!.1 Avera'e ;TP dow$load rate
KPI 2"P do6nload rate
KPI
reference
value
GPS
Suggested value '&kb$s
isk value 4&kb$s
#5G#
Suggested value (&kb$s
isk value 1'&kb$s
Indicator definition 3ctual do6nload data Duantity ?byte@;actual do6nload duration
Indicatory ty$e "est value
Counter formula ,one
,otes ,ormally1 t*is KPI is t*e C>" value. Class 9 mobile. Si0e of t*e
do6nloaded document 6ill affect t*e test result. <sually1 t*e
smaller t*e document si0e is1 t*e better t*e test result 6ill be. It is
related to t*e number of PS c*annels ( terminal ty$e (encoding
met*od and test soft6are1 etc.. "*e test result can also be affected
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 24(Total 46 pages


Secret▲
by t*e ado$tion of encoding met*od for CS4 and CS9. 4static time
slots are configured.
).!.2 Avera'e ;TP "*load rate
KPI 2"P u$load rate
KPI reference
value
GPS
Suggested value (kb$s
isk value 1&kb$s
#5G#
Suggested value '%kb$s
isk value 4%kb$s
Indicator definition 3ctual u$load data Duantity ?byte@;actual u$load duration
Indicatory ty$e "est value
Counter formula ,one
,otes ,ormally1 t*is KPI is t*e same as t*e C>" value. Class 9 mobile.
Si0e of t*e u$loaded document 6ill affect t*e test result. <sually1
t*e smaller t*e document si0e is1 t*e better t*e test result 6ill be.
It is related to t*e number of PS c*annels(terminal ty$e(encoding
met*od and test soft6are1 etc.. "*e test result can also be affected
by t*e ado$tion of encoding met*od for CS4 and CS9. "*is KPI is
t*e result of single time slot.
).!.! T<ro"'<*"t
Preconditions
Mobile $*one 6it* multi)timeslot =evel (F single
subscriberF 9 5= static signaling c*annels1 1 <= static
signaling c*annel
Indicators ?#,@ Indicators ?C,@ Suggested value
GPS: Ma: data t*roug*$ut)5= GPS 5= ma:imum transmission rate 7.(kbyte;s
GPS: Ma: data t*roug*$ut)<= GPS <= ma:imum transmission rate '.9kbyte;s
GPS: 3verage data t*roug*$ut)5= GPS 5= average transmission rate %kbyte;s
GPS: 3verage data t*roug*$ut)<= GPS <= average transmission rate 1.4kbyte;s
#5G#: Ma: data t*roug*$ut)5= #5G# 5= ma:imum transmission rate '8.%kbyte;s
#5G#: Ma: data t*roug*$ut)<= #5G# <= ma:imum transmission rate -kbyte;s
#5G#: 3verage data t*roug*$ut)5= #5G# 5= average transmission rate 19kbyte;s
#5G#: 3verage data t*roug*$ut)<= #5G# <= average transmission rate 4.%kbyte;s
).( Reliability
).(.1 PDTCH Dro* Rate
KPI P5"C+ 5ro$ ate
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 25(Total 46 pages


Secret▲
KPI reference
value
Suggested value %K
isk value 'K
Indicatory ty$e 5" test value
Indicator
definition
P5"C+ dro$ times; 2"P do6nload attem$t times L1&&K
Counter
formula
,one
,otes
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 26(Total 46 pages


Secret▲
+ I$trod"ctio$ to CN Statistical KPI
+.1 Pa'i$' s"ccess rate
KPI Paging success rate
KPI reference
value
Suggested value 7&K
isk value 74K
Indicator
definition
Paging res$onse timesL1&&K ; Paging reDuest times
Counter
formula
Paging reDuest times refer to t*e sum of P3GI,G information sent out by all
MSCs in t*e area1 e:cluding t*e secondary $aging information. Paging res$onse
times refer to t*e sum of t*e P3GI,G #S received by all MSCs in t*e area1
including t*e second $aging res$onse. Statistical $oint is at MSC side.
,otes CSC can indirectly $rovide t*is KPI1 but its statistical $oint differs from t*at of
MSC. "*e difference lies in call loss at Interface 3.
+.2 1ocatio$ "*date s"ccess rate
KPI =ocation u$date success rate
KPI reference
value
Provided by t*e SMC side
Indicator
definition
=ocation u$date success times L1&&K; location u$date reDuest times
Counter
formula
Provided by t*e SMC side
,otes "*is KPI can be indirectly $rovided by CSC1 but t*e value is different and its statistical
$oint differs from t*at of MSC too.
+.! Attac< s"ccess rate
KPI 3ttac* success rate
KPI reference
value
Suggested value 7&K
isk value 7%K
Indicator
definition
GPS attac* success times L1&&K ; GPS attac* times
Indicatory
ty$e
GPS attac* success times(SGS, delivers(3""3C+ 3CC#P"(4GPP
"S '9.&&(((e:cluding redeliver
Counter
formula
Statistics at SGS, side
,otes e:cluding <nregistered subs
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 27(Total 46 pages


Secret▲
+.( 7PRS avera'e attac< ti%e
KPI GPS average attac* time
KPI reference
value
Suggested value "o be confirmed
isk value "o be confirmed
Indicator
definition
Customer attac* establis*ment duration L1&&K ; customer
number of attac* establis*ment success
Indicatory ty$e Statistics
Counter
formula
3ttac* establis*ment time refers to t*e time duration from t*e
recei$t of GPS 3""3C+ #><#S" by MS to t*e delivery of
3""3C+ 3CC#P" by SGS,. If t*e attac* time e:ceeds t*e
timer1 t*e attac* duration is only com$uted 6it*in t*e attac*
acce$ted $eriod.
,otes
+.) PDP co$te2t activatio$ s"ccess rate
KPI P5P conte:t activation success rate
KPI reference
value
Suggested value (&K
isk value (%K
Indicator
definition
success times of P5P conte:t activation started by MSL1&&K; attem$t
times of P5P conte:t activation started by MS
"*e attem$t times of P5P conte:t activation started by MS is t*e times
GGS, received Create P5P Conte:t eDuest from SGS,.
"*e success times of P5P conte:t activation started by MS is t*e statistic
of Create P5P Conte:t es$onse sent from GGS, to SGS, 6*en Cause
value is eDuest 3cce$ted.
Indicatory ty$e "est or statistics
Counter
formula
Statistics at GGS, side
,otes "*e $erformance evaluation in C*ina Mobile in '&&4 ?success times of
P5P conte:t activation started by GPS terminal; attem$t times of P5P
conte:t activation started by GPS@ results are as follo6s:
#:cellency inde:: 79K
eac*)t*e)mark inde:: 7&K
=o6est "*res*old inde:: (%K
+.+ Ro"ti$' Area 0*date S"ccess rate
KPI outing 3rea <$date Success rate
KPI reference
value
Suggested value 7'K
isk value 7%K
Indicator
definition
outing u$date attem$t timesL1&&K; routing u$date success times
Indicatory ty$e 2rom statistical value or 5".
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 28(Total 46 pages


Secret▲
Counter
formula
Statistics at SGS, side1 $rovided by GPS core net6ork
,otes
<$date success rate at routing area crossing SGS, is lo6er t*an t*at at t*e SGS,
routing area.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 29(Total 46 pages


Secret▲
, Co%%e$ts o$ KPI Cases
,.1 Pe$'s<"i 6C<o$'=i$'8 PS Test Res"lt
1( C>" scene(near cell
'( #5G# Commissioned
4( Multi)timeslot ca$ability4M1
9( ,umber of P5C+ static c*annels: 4
"est state
"est
serial
2"P ty$e
2"P
si0e(Kbyte(
5o6nload
s$eed
?Kbyte;s@
5o6nload
s$eed ?kb$s@
3verage timeslot
s$eed(kb$s(
Pre)o$timi0ation 1 5o6nload 1&'.4(1 (.77 -1.74 '4.7(
Pre)o$timi0ation ' 5o6nload 9(.1( (.1& 89.(& '1.8&
Pre)o$timi0ation 4 5o6nload '&9.( '.7- '4.-( -.74
Pre)o$timi0ation 9 5o6nload '1((.(1- -.'1 %-.-' 17.'9
Pre)o$timi0ation % 5o6nload 1&'.4(1 7.&% -'.9' '9.19
Pre)o$timi0ation 8 5o6nload 1&'.4(1 (.88 87.'7 '4.1&
Pre)o$timi0ation - 5o6nload %1'.4&9 1%.7- 1'-.-4 9'.%(
Pre)o$timi0ation ( 5o6nload %1'.4&9 14.49 1&8.87 4%.%8
Pre)o$timi0ation 7 5o6nload %1'.4&9 1%.(1 1'8.%1 9'.1-
Pre)o$timi0ation 1& 5o6nload %1'.4&9 1%.-9 1'%.(( 91.78
Pre)o$timi0ation 11 5o6nload %1'.4&9 19.44 119.8- 4(.''
Ping
interval
Ping
package
size ( byt
e(
Ping timelag(ms( Averag
e
timelag
(ms(
Ping
success
rate
1 2 3 9 % 8 - 8 1!
! 32 83 "3# "12
81
'
8&( %(7 %88 $"% %"1 $"1 "%% 1!!&
% 32 81" %! %81
$$

$%$
$3
3
$1" "2 812 "! $! 1!!&
2 1!! %$1 "%! "$
$%
"
$%3
"%
1
$11 $2 $!$ "88 "1 1!!&
2 %!! 83 %%
1!$
%
82
1
$$
$3
$
18 8# 8$% 8#! 8$3 1!!&
% %!! 8"2 $"! 8%$
$%
%
"$2
81
1
"! 811 $! 82% $$% 1!!&
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 30(Total 46 pages
%


Secret▲
2 8!! % 1! 8"
8"

8#%
82
3
$81 883 8"! 8#" 8"% 1!!&
2 1!!!
11%
$
11%
8
88!
!
$
1!2
8
1
8
1!%
#
881
1!8
2
1!3
$
1!1! 1!!&
2 12!!
1!$
8
8#! 8$
%
$
1!1
$
%

11
1
1!2
!
1!1
8
1!#
2
1!!2 1!!&
&omments on case2
1. G*en C;I is in good condition1 t*e #5G# do6nload s$eed of current eDui$ment
can reac* above 9&kb$s.
'. "*e Ping success rate and Ping timelag can vary very muc* due to different Ping
intervals( different Ping $ackage si0es and different Ping servers.
,.2 >is<o" 6H"$a$8 C<i$a .obile ED7E Test Res"lt
 +est Specification
"est eDui$ment(3," Pilot for #)GPS(
'est p(one )*+A, -'#!.one set/
'est laptop0 memory 1!2#, ( (arddisk 8!+ ( 1P2
13"!+(z ( Windo4s 5P6)P2 ( standard 288!!bps modem( rate at
11%2!!bps(modem error control and compression 7orbidden(no
so7t4are irrelevant to t(e test3
'est met(od(outdoor static 8'P do4nload test 'est location (11
sites at 9ao:ing market in 8eng(uang county 'est time(1
t(
;3!
t(
<
=une 2!!8
'est aim(to test *68PR) net4ork per7ormance under static state
'est aim(to do4nload 1!!!>9 document
'imeslot (# static timeslots
+est 'esult
Cranc "est sites "est "est 5o6nload "est location =C =C
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 31(Total 46 pages
%
1&
1%
'&


Secret▲
*
office
documen
t si0e
(KC(
electrical
level (dC
m(
times
average
rate(Kb$
s(
average
rate (Kb$
s(
/is*ou
2eng*uang County
$refectural government
office building
Cell 1
1&&& )99 ' Gate of Prefectural government office '&1.17 1(1.4
/is*ou
2eng*uang County
$refectural government
office building
Cell '
1&&& )9& ' =obby of Ming5u +otel 17'.8 17(.7(
/is*ou
2eng*uang County
$refectural government
office building
Cell 4
1&&& )%1 ' A$$osite Ming5u +otel 17-.&7 '&8.'8
/is*ou Ald district Cell 1 1&&& )97 '
Casketball field
of /iandao$ing Primary Sc*ool
17-.-9 '&1.-7
/is*ou Ald district Cell ' 1&&& )4' '
Casketball field
of /iandao$ing Primary Sc*ool
'&-.'7 174.71
/is*ou Ald district Cell 4 1&&& )%8 '
Kindergarten
ne:t to /iandao$ing Primary Sc*ool
17(.(4 178.4(
/is*ou ainbo6 Cridge Cell 1 1&&& )94 ' A$$osite Ganmingta iver 1(%.-' 171.1
/is*ou ainbo6 Cridge Cell ' 1&&& )94 ' A$$osite Ganmingta iver 171.4- 1(1.48
/is*ou "ianTia 2eng +uang Cell 1 1&&& )49 '
SDuare in front of
"ianTia2eng+uang +otel
17-.98 1(8.%%
/is*ou "ianTia 2eng +uang Cell ' 1&&& )%7 '
SDuare in front of
"ianTia2eng+uang +otel
17-.&7 '&8.'8
/is*ou Cao>ing market Cell 1 1&&& )4( ' Gate of =inlinlou 5rug Store '&-.(% 17(.&'
/is*ou Cao>ing market Cell ' 1&&& )48 ' Gate of =inlinlou 5rug Store 18'.18 1(%.49
/is*ou Cao>ing market Cell 4 1&&& )98 ' Gate of =inlinlou 5rug Store 1(&.%1 1(&.&7
/is*ou Tin*ua Cookstore Cell 1 1&&& )%& ' =obby of Tin*ua +otel 17%.(1 171.%
/is*ou Tin*ua Cookstore Cell ' 1&&& )%4 ' =obby of Tin*ua +otel 17(.&' 1((.4(
/is*ou Tin*ua Cookstore Cell 4 1&&& )9% ' Parking lot of Tin*ua +otel 1(4.&( 17&.18
/is*ou
Com$re*ensive Cuilding Cell
1
1&&& )4- ' =ane1 6est to C*inaMobile business *all 1-(.78 1%-.99
/is*ou
Com$re*ensive Cuilding Cell
'
1&&& )9% ' Gate of TingGuang +otel 1(%.98 1(-.7(
/is*ou
Com$re*ensive Cuilding Cell
'
1&&& )8& ' Gate of TingGuang +otel 1(9.&- 1(9.9%
/is*ou
Com$re*ensive Cuilding
Cell 1(&&M1
1&&& )%& ' Gate of TingGuang +otel 174.7( 1(9.%1
/is*ou
Com$re*ensive Cuilding
Cell 1(&&M'
1&&& )8' ' Gate of TingGuang +otel 1-8.'' 1(%.'1
/is*ou "elecom Cureau Cell 1 1&&& )%1 ' Cusiness +all of "elecom Cureau 1(&.-% 17-.((
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 32(Total 46 pages


Secret▲
/is*ou "elecom Cureau Cell ' 1&&& )89 ' Cusiness +all of "elecom Cureau 1-1.(% 177.17
/is*ou "elecom Cureau Cell 4 1&&& )%- '
Cackdoor of Su$ermarket ?ne:t to "elecom
Cureau@
1('.- 1-7.97
/is*ou "elecom Cureau Cell 1(&&M1 1&&& )%7 ' Gate of furniture store ?ne:t to "elecom Cureau@ 1&%.99 1&8.9(
/is*ou "elecom Cureau Cell 1(&&M' 1&&& )-4 ' Cusiness +all of "elecom Cureau 1(1.(% 1(%.(%
/is*ou "elecom Cureau Cell 1(&&M4 1&&& )(9 ' Cusiness +all of "elecom Cureau 1%7.'& 188.7'
&omments on case2
1. G*en C;I is in good condition1 t*e average #5G# do6nload s$eed can reac*
above 1(&kb$s 6it* a $eak value of above '&&kb$sF
'. "*is test is t*e C>". Cell reselection and 3C rene6al can be neglected1 t*at is
t*ey are not necessary to t*e test conditions.
,.! Acce*ta$ce re="ire%e$ts /or ED7E KPI o/ Data Service o/ a
$etwor&
Serial Indicators #:$lanation 2ormula "arget
1 +PR)?*+PR)
attac(
success rate
+PR)?*+PR) 3ttac* success
means t*at t*e mobile $*one
receives t*e 3ttac* 3cce$t
signaling 1% seconds after it sends
t*e 3ttac* eDuest.
+PR)?*+PR) attac(
success rate ( +PR) Attac(
success times?attac(
attempt times@1!!(
R7%K
' Average
attac( time
Attac( time means t(e
duration 7rom t(e mobile
sends out Attac( Re:uest
until it receives +PR) attac(
accept signaling3
Average attac( time(sum o7
attac( success duration
?attac( success times
N4s
4 PDP
activation
success rate
P5P activation success means t*at
t*e mobile $*one receives t*e
3ctivate P5P conte:t 3cce$t
signaling 1% seconds after it sends
t*e 3ctivate P5P Conte:t eDuest.
PDP activation success
rate(PDP activation success
times?attempt times@1!!(
R7%K
9 PDP average
activation
time
PDP average activation time
means t(e duration 7rom
t(e delivery o7 Activate PDP
1onteAt Re:uest to t(e
receipt o7 Activate PDP
1onteAt Accept by t(e
mobile p(one3
PDP average activation time
( sum o7 PDP activation
success duration?PDP
activation success times
N4s
% WAP 4ebsite
log6in
success rate
WAP 4ebsite log6in success
means t(at t(e (omepage
7ully and correctly displays
4it(in "!seconds a7ter t(e
WAP 4ebsite log6in
success rate ( WAP 4ebsite
log6in success times?
4ebsite log6in attempt
R7%K
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 33(Total 46 pages
%


Secret▲
mobile p(one started t(e
WAP 4ebsite log6in re:uest3
times@1!!%。
8 average WAP
(omepage
displaying
time
WAP (omepage displaying
time re7ers to t(e duration
7rom t(e WAP 4ebsite log6in
re:uest is sent out until t(e
(omepage 7ully and
correctly displays3
average WAP (omepage
displaying time ( sum o7
success7ul (omepage
displaying duration ? WAP
(omepage displaying
success times
N1!s
- WAP
4ebpage
re7res(
success rate
WAP 4ebpage re7res(
success means t(at t(e
selected 4ebpage can be
re7res(ed 4it(in "!seconds3
WAP 4ebpage re7res(
success rate(WAP 4ebpage
re7res( success times ?
4ebpage re7res( attempt
times@1!!%。
R7%K
( Ping success
rate
Ping success rate ( ping
success times?ping attempt
times@1!!
R7%K
7 Ping average
timelag
Ping average timelag ( sum
o7 eac( Ping success
duration?ping success times
N2s
1& 8'P
do4nload
speed
8'P do4nload speed(actual
do4nload data
:uantity ( 9yte ( ?actual
do4nload time.sec/@
R8!kbp
s
11 8'P upload
speed
8'P upload speed ( actual
upload data
:uantity ( 9yte ( ?actual
upload time.sec/ @
R2!kbp
s
&omments on case2
1. eDuirements of o$eration and maintenance KPI are not as strict as t*ose of
acce$tance c*eck KPI.
'. <sually t*ese KPI reDuirements can be satisfied.
,.( O*eratio$ 9 .ai$te$a$ce KPI o/ a Networ&
S, Indicator <nit "arget =evel Permissible
=evel
emark
1 S5CC+ 5ro$
atio
K 1 1.' Case on system $erformance re$ort of
AMC1 Indication 5efinition: S5CC+
5ro$ atioSS5CC+ call dro$s; 3ccess
attem$t ,umber
' "C+ 5ro$
atio
K ' '.' Case on system $erformance re$ort of
AMC1 Indication 5efinition: "C+ 5ro$
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 34(Total 46 pages
%


Secret▲
atio S "C+ call dro$s; Sei0ed "C+s
?include *andover @
4 Call Success
atio
K 7( 7- Case on system $erformance re$ort of
AMC1 Indication 5efinition: Call Success
ate S 1("C+ assignment failure rate
9 S5CC+
Clocking atio
K &.% &.-% Case on system $erformance re$ort of
AMC1 Indication 5efinition: S5CC+
Clocking atioSS5CC+ overflo6s;
S5CC+ call attem$ts
% "C+
Clocking atio
K ' '.% Case on system $erformance re$ort of
AMC1 Indication 5efinition: "C+
Clocking atioS"C+ overflo6s ?include
*andover@; "C+ call attem$ts ?include
*andover@
8 "C+
3ssignment
Success atio
K 7( 7- Case on system $erformance re$ort of
AMC1 Indication 5efinition: "C+
assignment Success atioS,umber of "C+
assignment successful ; ,umber of "C+
call attem$ts ?include *andover@
- GPS average
5= t*roug*out
$er "C2
Kb$
s
'( '% '9)+our measurement
( #5G# average
5= t*roug*out
$er "C2
Kb$
s
9% 9& '9)+our measurement
7 3ttac*
Success ate
?GPS; #5G#@
K 77 7- '9)+our measurement
1& +andover
Success atio
K 79 74
11 Call Clocking
atio
K N ' for
7(K of all
GSM cells
N ' for
7&K of all
GSM cells
Cased on AMC) statistics
1' Call Setu$
Success ate
?5rive "est@
K 7- 7& 5e$end on t*e 5" route and met*od
14 Call 5ro$
ate ?5rive
"est@
K ' 4 5e$end on t*e 5" route and met*od
19 S$eec*
>uality ?5rive
"est@
MAS RS 4 for
7%K of
measurement
sam$les
RS 4 for
7&K of
measurement
sam$les
5e$end on t*e 5" route and met*od
1% Coverage
?5rive "est@
dCm RS )(% for
7%K of
RS )(% for
7&K of
5e$end on t*e 5" route and met*od
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 35(Total 46 pages


Secret▲
measurement
sam$les
measurement
sam$les
18 <=
"*roug*$ut
Kb$s R1& R1& Cased on 5"
1- 5=
"*roug*$ut
Kb$s R4& R4& Cased on 5"
1( CSC;,C
do6n time
?unsc*eduled@
K R77.777
?N 8 sec@
R77.777
?N 8 sec@
$er CSC;,C ; 6eek
17 "T;c*annel
element failure
?unsc*eduled@
K N 1 of all
active "T
N ' of all
active "T
$er CSC;,C ; 6eek
'& S5CC+
Mean +olding
"ime
s N ' N 4 $er CSC;,C ; C+ of a 6eek
'1 adio 3ccess
Success atio
K R77.% R77 $er CSC;,C ; C+ of a 6eek
'' Gorst Cells
GAS
=ess t*an
1.%K cells of
,et6ork 6it*
GAS %K or
above
=ess t*an
1.%K cells of
,et6ork 6it*
GAS %K or
above
$er CSC;,C ; C+ of a 6eek
'4 T><3= & to 4 K R7- R7% $er CSC;,C ; C+ of a 6eek
'9 3M voice
2#
K N 1 N1 $er CSC;,C ; C+ of a 6eek
&omments on case2
1. "*is KPI com$rises statistical KPI (testing KPI and eDui$ment $erformance KPI1 6*ic*
features detailed classification and all)round evaluationF
'. eDuirements for KPIs like GPS average 5= t*roug*out $er "C2 and #5G# average
5= t*roug*out $er "C2 are *ig*er.
4. eDuirements for evaluation of CS voice Duality are *ig*er.
,.) O*eratio$ 9 .ai$te$a$ce KPI o/ a $etwor& i$ So"t<east Asia
3o) 4PI
Measre0en
t
5evel 0 5evel 1 5evel 2
Scope an!
"nterval
1
( o1
ot!oor
area 6"t7
28 s"gnal
level 9
:104 !;0
pre:!e1"ne!
/r"ve test
rote
990( 997( 999(
per c"t< ,
0ont7l<
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 36(Total 46 pages
%


Secret▲
2
.all Setp
Sccess
$ate
(e=cl!e
>loc?"ng'
pre:!e1"ne!
locat"ons an!
/r"ve test
rote,3MS
95( 998( 999(
per c"t< , ;& o1
a 6ee? (!r"ve
test 0ont7l<'
3
Paging
Success
ate
,MS R7&K R7%K R7-K
$er city ; C+ of
6eek.
Git* condition
t*at Core
,et6ork is
ac*ived t*e same
value of =evel 1
and =evel '
4
.all
>loc?"ng
rate
pre:!e1"ne!
locat"ons an!
/r"ve test
rote,3MS
@0)5( @0)5( @1(
per c"t< , ;& o1
a 6ee? (!r"ve
test 0ont7l<'
5
/rop .all
$ate
(e=cl!"ng
"nter $AT'
Pre /e1"ne!
/r"ve Test
$ote,3MS
8SMA @3(
8SMA
@2(
8SMA @1(
per c"t< , ;& o1
a 6ee? (!r"ve
test 0ont7l<'
6
+andover
Success
ate
Pre 5efined
5rive "est
oute or ,MS
R7&K R7-K R7-K
$er city ; C+ of a
6eek ?drive test
mont*ly@1$er city
; C+ of 6eek.
Git* condition
t*at Core
,et6ork is
ac*ived t*e same
value of =evel 1
and =evel '
9
S>I
?"#MS@
Pre 5efined
5rive "est
oute
R'&?7%K@ R '%?7%K@ R '%?7%K@
3verage value
$er city ; C+ of a
6eek
10
.all setp
!ela<
(PST3 to
MSB t"0e
1ro0
n0>er
!"ale! to
r"ng'
Pre /e1"ne!
/r"ve Test
$ote
@6s @ 6s @6s
per Me!"a
8ate6a<,
0ont7l<
11
.all setp
!ela< (MS
to PST3B
t"0e 1ro0
sen!
presse! to
r"ng'
Pre /e1"ne!
/r"ve Test
$ote
@5s @ 5s @5s
per Me!"a
8ate6a<,
0ont7l<
12
Call Setu$
Successful
ate
,MS R7%K R7(K R77K
$er CSC;,C ;
C+ of a 6eek
13
S/..&
Access
Sccess
3MS 999( 999( 999)5(
per ;S.,$3. ,
;& o1 a 6ee?
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 37(Total 46 pages


Secret▲
15
S/..&
;loc?"ng
$ate
Pre /e1"ne!
/r"ve Test
$ote,3MS
@0)5( @0)5( @1(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
16
T.&
;loc?"ng
$ate
Pre /e1"ne!
/r"ve Test
$ote,3MS
@0)5( @0)5( @1(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
18
/rop .all
$ate
Pre /e1"ne!
/r"ve Test
$ote,3MS
@5( @2( @1)5(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
19
+andover
Success
ate
Pre 5efined
5rive "est
oute;,MS
Inter CSS: R7'K :
Inter Cell: R7'K
Inter CSS:
R7-K :
Inter Cell:
R7-K
Inter CSS: R7-K :
Inter Cell: R7-K
$er CSC;,C ;
C+ of a 6eek
?drive test
mont*ly@
Git* condition
t*at Core
,et6ork is
ac*ived t*e same
value of =evel 1
and =evel '
20
$C-DA5 0
to 3
Pre /e1"ne!
/r"ve Test
$ote,3MS
980( 985( 990(
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
21
AM$ vo"ce
#*$
Pre /e1"ne!
/r"ve Test
$ote,3MS
@1( @1( @ 1(E
per ;S.,$3. ,
;& o1 a 6ee?
(!r"ve test
0ont7l<'
23
Sccess1l
PS
Attac70en
t
3MS 998( 998( 998(
per c"t< , ;& o1
a 6ee?
24
Sccess1l
P/P
conte=t
act"vat"on
3MS 998( 998( 998(
per c"t< , ;& o1
a 6ee?
25
/ata
sess"on
Setp
Sccess
$ate (P/P
conte=t
alrea!<
e="st'
Pre /e1"ne!
/r"ve Test
$ote,3MS
995( 998( 998(
per c"t< , ;& o1
a 6ee?
26
Mov"ng
MS #TP
!o6nloa!
1M; 1"le
Pre /e1"ne!
/r"ve test
rote
8P$S930?>ps
8P$S
(.lass 4
MS'A
9304>
8P$S (.lass 4
MS'A9 304>ps
per c"t< , ;& o1
a 0ont7
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 38(Total 46 pages


Secret▲
27
Mov"ng
MS #TP
ploa!
1M; 1"le
Pre /e1"ne!
/r"ve test
rote
8P$S98?>ps
8P$S
(.lass 4
MS'A 9
94>psE
8P$S (.lass 4
MS'A 9 94>psE
per c"t< , ;& o1
a 0ont7
28
Stationary
MS near
site1 2"P
do6nload
1MC file
Pre)defined
locations
GPS ?Class 9
MS@: R 9& Kb$s
GPS
?Class 9
MS@: R 9&
Kb$s
GPS ?Class 9 MS@:
R 9& Kb$s
$er city ; C+ of a
mont*
29
Stat"onar<
8P$S MS
"n cell
>or!erB
#TP
!o6nloa!
1M; 1"le
Pre:!e1"ne!
locat"ons
GPS ?Class 9
MS@: R '& Kb$s
8P$S
(.lass 4
MS'A 9 20
4>psE
8P$S (.lass 4
MS'A 9 20 4>psE
per c"t< , ;& o1
a 0ont7
30
Stat"onar<
DMTS MS
"n cell
>or!er
(S&O'B
#TP
!o6nloa!
1M; 1"le
Pre:!e1"ne!
locat"ons
3,A
9 150
4>ps
9 150 4>ps
per c"t< , ;& o1
a 0ont7
31
P/T.&
>loc?"ng
rate
3MS @0)5( @0)5( @1(E
per ;S. , ;&
o1 a 6ee?
32
60 secon!
!ata
trans1er
!rop $ate
(MS
0ov"ng'
Pre /e1"ne!
/r"ve Test
$ote
@3( @2( @1)5(
per c"t< , ;& o1
a 6ee?
33
$ot"ng
Area
Dp!ate
Sccess1l
rate
3MS 9 95( 9 95( 997(
per c"t< , ;& o1
6ee?
34
MS
"n"t"ate!
serv"ce
setp t"0e
Pre /e1"ne!
/r"ve Test
$ote
@5s @5s @5s
per c"t< , ;& o1
a 6ee?
35
MS
ron!tr"p
P"ng t"0e
(20 p"ng
average!'
Pre /e1"ne!
/r"ve Test
$ote
@1 @1 @0)8s
per c"t< , ;& o1
a 6ee?
36
P/P
p!ate
sccess
rate
3MS 998( 998( 999(
per c"t< , ;& o1
a 6ee?
&omments on case2
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 39(Total 46 pages


Secret▲
1. "*is AM KPI Eust got some of t*e indicators1 e:cluding t*e 6eig*ing of all KPIs
and ';4G intero$erate KPI1 etc.. 5ue to market factors1 t*e AM KPI of t*is
net6ork is set unreasonable1 and t*ere is risk in some of t*e KPIs.
'. "*e evaluation of t*is KPI falls into t*ree grades. "*e reDuirements for
*andover success rate and $aging success rate are very *ig*1 6*ic* are difficult
to reac*. Cut t*e attac*ed $rereDuisites can lo6er t*e risk to some e:tent.
Cesides1 t*e definition of *andover success rate varies 6it* different
manufacturers1 6*ic* 6e need to make clear 6it* customers in tec*nical
clarification.
4. "*e reDuirements for data service and voice KPI are *ig*er.
,.+ KPI re="ire%e$ts /or I$do$esia Tel&o%sel $etwor&

>PB re:ui rements
7 or B ndi nesi a 'el komsel 3 Al s
&omments on case
1. "*e evaluation scale of KPI is relatively large1 mainly dealing 6it* statistical
KPI and testing KPIF
'. It ranges from 'G to 4G net6ork. Its service includes voice(GPS and 4G data
service1 etc..
4. "*e division of KPI evaluation scenes and most KPI values are relatively
reasonable.
"*is document contains $ro$rietary information of !"# Cor$oration and is not to be disclosed or used
e:ce$t in accordance 6it* a$$licable agreements. Page 40(Total 46 pages
%
1&
1%