GSM Key Performance Indicator (KPI)Guidebook

Version: V1.1 Security Category: Secret Serviceable range: Radio Planning Section

GSM Network Planning & Optimization Dept. of Engineering Service Division

ZTE Corporation

Secret▲ Secret▲

Work Guidebook for GSM P&O Dept.

Version Introduction
Version V1.0 Date 2008-01-21 Writer Chen Chun Assessor Zheng Hao None 1、V3 KPI and EDGE KPI were added. 2、Amendment: mainly directed at V2.97 Zheng Hao, V1.1 2008-12-07 Yang Jiazhi Chen Chun, Fei Aiping and V6.0. 3、Some classic KPI cases and comments were added. 4、Principles for KPI risk analysis were added. Amendment Records

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

Secret▲ Secret▲

CONTENTS
1 2 2.1 2.1.1 2.1.2 2.1.3 2.2 2.2.1 2.2.2 2.2.3 2.2.4 2.2.5 2.2.6 2.2.7 2.2.8 2.3 2.3.1 2.4 2.4.1 2.4.2 2.4.3 2.4.4 2.4.5 2.5 2.5.1 2.5.2 3 3.1 3.2 3.3 Overview...........................................................................................................................1 CS Radio Service Statistical KPI....................................................................................4 Availability ........................................................................................................................4 SDCCH availability/SDCCH ....................................................................................4 TCH availability/TCH ...............................................................................................4 Cell utilization ...........................................................................................................4 Accessibility ......................................................................................................................5 Random Access Success rate.....................................................................................5 SDCCH blocking rate................................................................................................5 TCH blocking rate .....................................................................................................6 Radio connection ratio...............................................................................................6 SDCCH drop rate ......................................................................................................7 SDCCH assignment success rate...............................................................................7 TCH assignment success rate ....................................................................................7 Call setup success rate ...............................................................................................8 Mobility .............................................................................................................................9 Handover success rate ...............................................................................................9 Reliability ..........................................................................................................................9 TCH Call Drop Rate..................................................................................................9 Traffic Call Drop .....................................................................................................10 Call Completion rate................................................................................................10 UL RxQual 0-4 ........................................................................................................11 DL RxQual 0-4 ........................................................................................................11 Call Setup time ................................................................................................................12 Call setup time (GSM to PSTN)..............................................................................12 Call setup time (GSM to GSM)...............................................................................12 CS Radio Service Test KPI ...........................................................................................13 Call Setup Success Rate ..................................................................................................13 Handover Success Rate ...................................................................................................13 Call Drop Rate.................................................................................................................13

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

Secret▲ Secret▲
3.4 3.4.1 3.4.2 3.4.3 4 4.1 4.1.1 4.1.2 4.1.3 4.1.4 4.1.5 4.1.6 5 5.1 5.1.1 5.1.2 5.1.3 5.1.4 5.1.5 5.1.6 5.2 5.2.1 5.3 5.3.1 5.3.2 5.3.3 5.4 5.4.1 6 6.1 6.2 6.3 6.4 6.5 Coverage (Drive Test)......................................................................................................13 SQI...........................................................................................................................14 MOS ........................................................................................................................14 MOS & PSEQ .........................................................................................................15 PS Radio Service Statistical KPI ..................................................................................18 Accessibility ....................................................................................................................18 DL TBF establishment success rate .........................................................................18 UL TBF establishment success rate .........................................................................18 GPRS RLC ..............................................................................................................19 GPRS RLC ..............................................................................................................20 EGPRS RLC............................................................................................................20 EGPRS RLC............................................................................................................20 PS Radio Service Test KPI............................................................................................22 Accessibility ....................................................................................................................22 Attach success rate...................................................................................................22 Average GPRS attach time ......................................................................................22 PDP context activation success rate ........................................................................22 PDP context activation time ....................................................................................23 PING test success rate .............................................................................................23 Average PING test time ...........................................................................................23 Mobility ...........................................................................................................................24 Routing Area Update Successful rate ......................................................................24 Data Throughput..............................................................................................................24 Average FTP download rate ....................................................................................24 Average FTP upload rate .........................................................................................25 Throughput ..............................................................................................................25 Reliability ........................................................................................................................25 PDTCH Drop Rate ..................................................................................................25 Introduction to CN Statistical KPI...............................................................................27 Paging success rate ..........................................................................................................27 Location update success rate ...........................................................................................27 Attach success rate ..........................................................................................................27 GPRS average attach time ...............................................................................................28 PDP context activation success rate ................................................................................28

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

. .........................................................................6 7 7.................................................2 7.30 Pengshui (Chongqing) PS Test Result.........................................................6 Routing Area Update Success rate ....5 7..........3 7....................36 KPI requirements for Indonesia Telkomsel network .................................................................40 This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements....Secret▲ Secret▲ 6.....31 Acceptance requirements for EDGE KPI of Data Service of a network ................................................................4 7....................................................1 7..........34 Operation & Maintenance KPI of a network in Southeast Asia .......................................................30 Jishou (Hunan) China Mobile EDGE Test Result ...................33 Operation & Maintenance KPI of a Network .....28 Comments on KPI Cases............

For lack of space. but accumulation of 15 work experience as well. The suggested values and risk values of KPI mentioned in this guide are reference suggestions concluded from the current conditions of GSM network. If the KPIs listed in the bidding documents go beyond the reference values and risk values (suppose risk value of 10 the KPI is provided. which are now commonly adopted in presales bidding projects. To make sure that our KPI can meet requirements in bidding documents.Secret▲ Secret▲ 1 Overview This guidebook collected the Key Performance Indicators (KPI) for CS and PS services. The KPIs can be quite different due to the differences in network structure and dimension. meanwhile. the six This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. The key requirement for engineers engaged in presales network planning is to 20 thoroughly understand and master the related KPIs. otherwise.). the writer provides the reference values and risk values of different KPIs in this guide. with the aim to unify response on KPIs and avoid the possible market risks. Why network operators set up KPIs and what are they aimed at? How to define KPI and what can be resulted from deviation of KPI? How much influence can the value of KPI impose on presales bidding? 25 How to clarify KPI and how to achieve favorable negotiation results during KPI clarification? How to avoid and pre-warn KPI risks? What is the development direction of KPI assessment? Each presales radio network planning engineer shall possess related techniques of 30 and up-to-date answers to the six questions above. which is also the basic but highest demand for radio network planning engineers. after analyzing the performance indicators of current networks of both domestic and overseas key projects. we need not only support from theories. Page 1,Total 45 pages . Meanwhile. As GSM techniques and skills are developing and equipment performance is improving constantly. we need to conduct risk analysis and evaluation. try to avoid the risk and send out pre-warning. and the definitions of different KPIs and counter formulas for V2/V3 are explained here as 5 well. the reference standards for KPI will change accordingly. suggested values shall be applied.

Page 2,Total 45 pages . reasonable and timely KPI.Secret▲ Secret▲ questions will not be further discussed in this guidebook. Functional principles for this guidebook (mainly directed at KPI): 1. network operators are attaching more and more importance to KPI during negotiations. Only statistical KPI and 5 testing KPI are elaborated here. KPI is 10 affected by various factors. It can not replace the presales KPI project evaluation. It can not be procured unless logging into document security software. there is difference in KPI for V2 and V3. 20 4. That is why operators are now regarding KPI as a very important leverage to shift risk and decrease network investment and maintenance cost. As for equipment performance KPI and customer perception KPI. The engineers will be able to experience and get to know them in presales planning work in future. KPI can be classified into four types: statistical KPI. 2. customer perception KPI. KPI is also closely related to the basic network environment. countryside. It is suggested to release the guidebook in encrypted document. so as to bring down contract risk and ensure profits. Therefore. they are focused on in another guidebook. equipment performance KPI. network dimension. 3. Equipment manufacturers must commit themselves to suitable. 3. No one is entitled to spread it outside or extensively spread 25 it inside the company. a lot more aspects are involved in KPI. Nowadays. village) 5. 30 The guide is a reference to radio network planning staff engaged in presales bidding. 15 The following are the factors that shall be taken into consideration when we work on KPI: 1. This guide is only available to the radio network planning engineers engaged in presales bidding. Besides the four types mentioned above. geographical distribution of network(urban. degree of subscriber(number) growth. 2. share risks” is an important principle in presales planning work. The right to interpret the serviceable range of this guide remains with GSM Technical Research Section & Resources Section. Generally. This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. “Rationalize commitment. network type. equipment types. testing KPI.

Page 3,Total 45 pages .Secret▲ Secret▲ 4. sic passim This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. After half a year. 5. 5 Notes: V6. The guide is mostly applicable to V2.0 (ISMG) and V6.0 (ISMG). it needs to be updated and reassessed.1 (Minos).1 (Minos) of V3. The KPI values enclosed in this guide are valid within only half a year since the release of it.97 of V2 and V6. V6.

1. It is directly related to the stability of equipment、transmission and power supply. etc. etc..0 V6.3 Cell utilization KPI KPI reference Cell utilization 80% This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 4,Total 45 pages . especially to inspect the utilization of SDCCH in Notes the cells.1 Availability 2.1 V6.. TCH usable total*100%/(TCH usable total+ TCCH unusable total) TCH availability (TCH in service rate) 98% 5 2.1.1. It is directly related to the stability of equipment、transmission and power supply. 2. It reflects the utilization ratio of network equipment and the stability of initial network operation.0 C11607*100%/(C11607+C11608) (C100030125+C100030134+C100030155)*100% / (C100030125 + C100030134 + C100030155 + 100030126+ C100030217+ C100030218) (C900060125+C900060134+C900060155) *100%/(C900060125+C900060134+ C900060155+C900060126+C900060217+C900060218) The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used to Notes examine equipment performance.2 TCH availability/TCH KPI KPI reference value Indicator definition V2 Counter formula V3 V6.Secret▲ Secret▲ 2 CS Radio Service Statistical KPI 2.1 SDCCH availability/SDCCH KPI KPI value Indicator definition V2 Counter formula V3 V6. especially to inspect the utilization of SDCCH in the cells.1 C11601*100%/(C11601+C11602) C100030122*100%/( C100030122+ C100030123) C900060122*100%/(C900060122+C900060123) SDCCH usable total*100%/(SDCCH usable total +SDCCH unusable total) reference SDCCH availability (SDCCH in service rate) 99% The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used to examine equipment performance.

The prerequisite is that precise traffic model 、 traffic dispersion 、 network capacity and redundancy rate shall be provided in preplanning period. the fitness between network desired capacity and actual capacity.1 Random Access Success rate KPI KPI reference value Indicator definition V2 Counter formula V3 V6.1 Notes V6. 5. 7.1 V6. 6. lack of SDCCH capacity. FR and HR This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. 2. in which ratio of actual traffic / desired traffic<1 2. internal & external interference.Secret▲ Secret▲ value Indicator definition Counter formula This is mainly to compare performance of preplanning network with that of actual Notes network. Page 5,Total 45 pages . burst traffic. It will be affected by the following factors: Notes 1. operators’ special requests. This KPI is also related with network configuration and traffic distribution. 4.2 SDCCH blocking rate KPI KPI value Indicator definition V2 Counter formula V3 V6.2. preplanned redundancy rate.5% Random access success times *100% / Random access call attempt times SDCCH congestion rate shall be taken into consideration.0 (C11626+C11696-C11697)*100%/(C11625+C11696) (C100030004+C100030010+C100030038-(C100030011 *100%/(C100030003+C100030010+C100030038) (C900060004+C900060010+C900060038-(C900060011 *100%/(C900060003+C900060010+C900060038) +C900060039)) +C100030039)) Random Access Success rate Suggested value Risk value 99% 99. fitness between preset traffic model and the actual one. 3. None Cells. 2.0 (C11625-C11626+C11697)*100%/(C11625+C11696) (C100030005+C100030011+C100030039) C100030010+C100030038) (C900060005+C900060011+C900060039)*100%/(C900060003+ C900060010+C900060038) *100%/ (C100030003+ Signaling channel congestion times*100% / signaling channel call attempt times reference SDCCH blocking rate 1% This is mainly to evaluate the fitness between preplanned network and actual network.2 Accessibility 2. because of its direct influence on this KPI.2.

handovers. and the precondition is that precise traffic model 、 traffic dispersion 、 network capacity and redundancy rate shall be provided in Notes preplanning period. fitness between preset traffic model and the actual one.2.2. 6. 2% TCH blocking rate V2 2. burst traffic. lack of TCH capacity.4 Radio connection ratio KPI KPI reference value Indicator definition (1-signalling channel congestion rate)*(1-voice channel congestion rate)*100% V2 Counter formula V 3 V6. 5.3 TCH blocking rate KPI KPI reference value Indicator definition TCH congestion times*100%/ TCH call attempts (C11612-C11699)*100%/(C11611-C11698) (C100030020+C100030031+C100030043+C100030047+C100030022 + Counter formula V 3 V6. 2.1 (C900060005+C900060011+C900060039)*100%/(C900060003+C900060010+C900060038))*(1(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+ C900060045+C900060049)/(C900060019+C900060030+C900060042+C900060046+ 97% Radio connection ratio This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.1 V6. preplanned redundancy rate.0 (1-(C11625-C11626+C11697)*100%/(C11625+C11696))*(1-(C11612-C11699)/(C11611-C11698)) (1-(C100030005+C100030007)*100% / (C100030003+C100030006)) * (1-(C100030011 +C100030020+ C100030031+C100030039 +C100030043 + C100030047 +C100030013+ C100030022 +C100030033+C100030041 +C100030045+C100030049) / (C100030010+ C100030019+ C100030030 + C100030038+ C100030042+C100030046+ C100030012+ C100030021 +C100030032+C100030040 +C100030044+C100030048)) (1V6. internal & external interference. 2. 4. the fitness between network desired capacity and actual capacity. 3. Page 6,Total 45 pages .Secret▲ Secret▲ used as signaling channel.0 C100030033+C100030045+C100030049)*100%/(C100030019+C100030030+ C100030042+C100030046+C100030021+C100030032 +C100030044+C100030048) (C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+ C900060045+C900060049)*100%/(C900060019+C900060030+C900060042+C900060046+ C900060021+C900060032+C900060044+C900060048) This is mainly to evaluate the fitness between preplanned network and actual network. It is related to the following factors: 1.

1% 0..7 TCH assignment success rate KPI KPI reference value TCH assignment success rate Suggested value 98% This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. and other causes.2. If Notes we compute according to the formula above. including radio link failure、 LAPD link breaks、handover failure. 2. but except the following four reasons: lost connection with SMM. Page 7,Total 45 pages .2.Secret▲ Secret▲ C900060021+C900060032+C900060044+C900060048)) This is mainly to compare performance of preplanned network with that of actual network.2. This KPI is in direct tie-in constraint with SDCCH blocking rate and TCH blocking rate.4%. This KPI value is relatively lower. etc. the suggested KPI value is 0.6%.0 V6. 1 Notes SDCCH assignment success rate is involved with many factors. The prerequisite is that Notes precise traffic model、traffic dispersion、network capacity and redundancy rate shall be provided in preplanning period. SDCCH call drop rate will be rather low. etc. 0 V6. forced disconnection by other calls. C100030053/C900060053 is used to find out the frequency of call drops resulted from radio link failure、LAPD link breaks、handover failure. and suggested risk value 0.5 SDCCH drop rate KPI KPI reference value Indicator definition Counter formula SDCCH drop rate Suggested value Risk value 0.05% SDCCH call drop total*100%/(random access call attempts + voice channel call attempts total (handover excluded)(signalling)) V2 V3 V6.6 SDCCH assignment success rate KPI KPI reference value Indicator definition SDCCH assignment success rate Suggested value Risk value failure times) V2 Counter formula V3 V6. C901250014*100%/(C901250014+C901250015) C11644*100%/( C11644+ C11645) C100420014*100%/(C100420014+C100420015) 96% 98% SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment 2.. such as LAPD link、frequency interference、access parameters. forced OMC-R disconnection. 2. If counter 116135 is included (BSS call drop times on SDCCH).1 C11605*100%/(C11625+C11696) C100030053*100%/(C100030003+C100030010+C100030038) C900060053*100%/(C900060003+C900060010+C900060038) C11605 accumulates SDCCH call drops resulted from all reasons.

etc. Handover is excluded. The definition is not rational from the view of voice call. etc. Suggested value Risk value 97% 95% value III Indicator definition III Note III Counter formula ((MOC success + MTC success)/ (MOC attempt + MTC attempt)) *(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate) The CSSR is mainly measured in the view of congestion.Secret▲ Secret▲ Risk value Indicator definition failure times) V2 C11657*100%/(C11657+C11658) (C100030017+C100030028+C100030036+C100030235 + C100030199+C100030210)*100%/(C100030017+C100030028 V6. It is rather reasonable to exclude LAC and SMS. so that the CSSR used in MOTO excluded SMS factor.). We need to make clear the formula with customers. CSSR is usually obtained from the combination of original KPI.1 C900060037+C900060200+C900060211+C900060135+ C900060017+C900060028+C900060036+C900060199+ C900060210+C900060235) Notes This KPI is directly related to radio environment 、 frequency carrier problems 、 assignment methods、application of data service. Handover excluded.8 Call setup success rate KPI KPI reference value I Indicator definition I Note I Call setup success rate (CSSR) Suggested value Risk value` 92% 94% (1-SDCCH blocking rate)* (1-SDCCH assignment failure rate)*(1-SDCCH drop rate)*(1TCH blocking rate)*(1-TCH assignment failure rate) The definition of this CSSR is relatively strict because too many factors are included (LAC、SMS.2. Some may define it to be TCH assignment success rate or radio access completion rate. It is regarded a This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. KPI reference value II Indicator definition II Note II KPI reference Suggested value Risk value 93% 95% ((MOC success + MTC success)/ (MOC attempt + MTC attempt)) *(1-SDCCH drop rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate) According to common understanding. CSSR is mostly applied to inspect the establishment of voice call.. Page 8,Total 45 pages . Different manufacturers have different definitions for CSSR.0 Counter formula V3 +C100030036+C100030018+C100030029+C100030037+ C100030235+C100030199+C100030210+C100030200+ C100030211+C100030135) (C900060017+C900060028+C900060036+C900060199+ C900060210+C900060235) *100%/(C900060018+C900060029+ V6. 99% TCH assignment success times*100/( TCH assignment success times +TCH assignment 2. Handover is excluded. It is similar to Hutchison’s definition of CSSR. The formula above is Explanation regarded too strict.

Secret▲ Secret▲ favorable way to exclude location update indicators when we define this KPI. 2.7% 0. 1-2% can be appropriately increased %/ (C100030097+C100030213+ C100030215+C100030099+C100030100 Counter formula +C100030101+C100030216 +C100030119 +C100030093 Notes according to real situations.1 *100%/(C900060097+C900060213+C900060214+ C900060215+C900060099+C900060100+C900060101+ C900060216+C900060119+C900060093+C900060095) This formula includes both incoming and outgoing handovers. while some operators may take into consideration only one of them.4.5 KPI reference value V3 Indicator definition TCH call drop times*100%/TCH assignment success times This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. the operators require a handover success rate of around 98%.0 C100030214+ +C100030095) V3 (C900060098+C900060102+C900060120+C900060094+ C900060096) V6. As for V3 equipment.0% 0. 2. though several networks have reached 98%. which involves high risks to be reached.1 Handover success rate KPI Handover success rate V2 Suggested value Risk value Suggested value Risk value 94% 96% 95% 97% KPI value reference V3 Indicator definition Handover success times in busy hours*100% / handover request times in busy hours (C11618+C11669-C11675)*100%/(C11617+C11668V2 C11675) (C100030098+C100030102+C100030120+C100030094+ C100030096)*100 V6. This KPI can differ a lot from each other due to different types of network.7 0.3.3 Mobility 2.1 TCH Call Drop Rate KPI TCH drop rate / Call drop rate V2 Suggested value Risk value Suggested value Risk value 1. Page 9,Total 45 pages .4 Reliability 2. In many presales bidding.

We need to make it clear with customers when referring to this KPI.2. 0 V3 V6. Generally. 2. 2.2 Traffic Call Drop KPI Minute per drop(MPD) V2 Suggested value Risk value Suggested value Risk value 90 120 120 180 KPI value reference V3 Indicator definition Traffic /TCH call drop times*60 V2 (C11616/3600)*60/C11615 V6. None. the other is with handover excluded. But it is close to customers’ perception.4.Call drop rate) This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.5%. Page 10,Total 45 pages . Refer to Indicator Definition II under Item 2.8 94% 92% CSSR*(1. The formula above takes handover in it. it’s difficult for to reach this KPI’s standards. Generally.4.2% higher than the one with handover included. The discrepancy can reach 0. the indicator Notes will be about 0.3%. if the call drop (with handover included) rate is higher than 0.1 ((C100030129+C100030127)/3600)*60/ (C100030054+C100030055) ((C900060129+C900060127)/3600)*60/(C900060054+C900060055) Counter formula V3 Notes This KPI of different networks varies to a large extent. call drop rate of V3 equipment is a bit lower than the one of V2. 1 (C100030054+C100030055)*100%/(C100030028+ C100030199+C100030210+ C100030098+C100030102+C100030120) (C900060054+C900060055) *100%/(C900060028+C900060036+ C900060199+C900060210+C900060098+C900060102+ C900060120) C100030036+ V2 Counter formula Voice channel call drop rate falls into two types: one is with handover included. If handover is not included.0 V6. for it can be bigger in dual-band network.3 Call Completion rate KPI KPI reference value Call Success Rate (CSR) Suggested value Risk value Indicator definition Counter formula Notes This formula is a customer KPI. This KPI differs a lot in varied types of network. This discrepancy is not universally definite yet.Secret▲ Secret▲ C11615*100%/(C11611-C11698-(C11612+C11656+C11658+ C11617-C11618-C11699-C116103-C116133)) V6.

Page 11,Total 45 pages .5 DL RxQual 0-4 KPI KPI value Indicator definition (C116122+C116123+C116124+C116125+C116126+C116127)* V2 (C116122 ( +C116123+C116124+C116125+C116126 C100030075 + C100030076+ +C116128+C116129) Counter formula V3 V6.0 C100030070)*100/ (C900060066+ C900060070)*100/ C100030067+ (C100030066+ C900060067+ (C900060066+ C100030068+ C100030067+ C900060068+ C900060067+ C100030069+ C100030068+ C900060069+ C900060068+ C116119 UL RxQual 0-4 Suggested value Risk value 97% 95% UL RxQual 0-4 *100 / UL RxQual 0-7 C100030069+ C100030070+ C100030071+ C100030072+ C100030073) C900060069+ C900060070+ C900060071+ C900060072+ C900060073) 2.4.4.1 Notes None (C100030066+ V6.Secret▲ Secret▲ 2. 1 V6.4 UL RxQual 0-4 KPI KPI reference value Indicator definition (C116114+C116115+C116116+C116117+C116118) * 100 / (C116114 V2 +C116115+C116116+C116117+C116118+ +C116120+C116121) Counter formula V3 V6. 0 C100030074+ C100030077 + C100030078)*100/ ( C100030074+ C100030075 + C100030076+ C100030077 + C100030078+ C100030079+ C100030080+ C100030081) ( C900060074+ C900060075 + C900060076+ C900060077 + C900060078)*900/ ( C900060074+ C900060075 + C900060076+ C900060077 + C900060078+ C900060079+ C900060080+ C900060081) 100 / +C116127 reference DL RxQual 0-4 Suggested value Risk value 97% 95% DL RxQual 0-4 *100 / DL RxQual 0-7 Notes None This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

It differs in different network configurations. which is related with network structure、routing and radio environment. reference Call setup time (GSM to PSTN) Suggested value Risk value 5 seconds 8 seconds time duration from starting call to ringing out 2. MSC provides this KPI.1 Call setup time (GSM to PSTN) KPI KPI value Indicator definition Notes We can use test software to estimate the time duration.5. MSC provides this KPI.2 Call setup time (GSM to GSM) KPI KPI value Indicator definition Notes We can use test software to estimate the time duration.Secret▲ Secret▲ 2. It differs in different network configurations. Page 12,Total 45 pages .5 Call Setup time 2. reference Call setup time (GSM to GSM) Suggested value Risk value 5 seconds 7 seconds Obtain from test the time duration from starting call to ringing out This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.5. which is related with network structure、routing and radio environment.

Secret▲ Secret▲ 3 CS Radio Service Test KPI 3.4 Coverage (Drive Test) Urban Suburban Rural Road Illustration of coverage 85% sample of the values 85% sample of the values 85% sample of the values 85% sample of the values This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. test pre-defined locations and Drive Test route None reference Call Setup Success Rate Suggested value Risk value 98% 95% Call connection times*100% / call attempt times 3.3 Call Drop Rate KPI KPI value Indicator definition Indicator value Notes DT&CQT. Pre Defined Drive Test Route or NMS None reference Handover Success Rate Suggested value Risk value 98% 95% Handover success times*100% / handover attempt times 3.1 Call Setup Success Rate KPI KPI value Indicator definition Indicator value Notes DT&CQT. Page 13,Total 45 pages . test Pre Defined Drive Test Route or NMS None reference Call Drop rate Suggested value Risk value 2% 3% Call drop times*100% / call connection times 5 3.2 Handover Success Rate KPI KPI value Indicator definition Indicator value Notes DT&CQT.

SQI value will increase when EFR is applied. that is special equipment or software (e. 2. should have a value equal to or higher than –85 dBm. inconsistency between project implementation and project plans. This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. While in the objective part. PESQ method from ITU-T Suggestion book P. but also our core competitive strength in network planning. engineers subjectively compare the original voice material and the deteriorated voice material according to ITU-T Suggestion book P. Nowadays. Influencing factors should have a value equal to or higher than –80 dBm. landform. should have a value equal to or higher than –90 dBm. For half-rate encoder.4. Coverage KPI is one of the most important KPIs. 1. for enhanced full-rate encoder. because it directly reflects not only our radio network planning ability and the performance of our equipment.800 and P. this KPI will cause problems in the acceptance inspection. There are different SQI top limits for different types of encoders. requirements for network coverage are higher.4.1 SQI KPI KPI value Indicator definition This KPI is for inspecting the sound distortion degree resulted from incapable link transmission. 21. 3.2 MOS KPI KPI value Indicator definition Notes The commonly used MOS assessment method consists of subjective and objective scoring parts. etc. there is no more illustration of coverage KPI hereafter in this guide. Further more. reference SQI Suggested value Risk value TEMS test value 95% sample >=25 95% sample >=18 3. It takes into consideration many factors. 30. then average the scores from different engineers.862 is employed. 4. test equipment. the VQT test equipment of Agilent) is used to proceed Test value reference Mean Opinion Score ( MOS) Refer to the form attached bellow.830. for full-rate encoder. the SQI top limit is 19. SQI ranges from 18 to 30.Secret▲ Secret▲ requirement should have a value equal to or higher than –75 dBm. test routes Detailed coverage requirements (as shown above) are delivered in the bid documents. we need to make sure that our customers are aware of regional assignment、DT routes and test methods. In the subjective part.g. to finally get the SQI.. The formula is Ericsson’s patent. Notes 3. Due to lack of space. Estimation of network dimension is also based on the requirements. and give their MOS scores respectively. including BER、FER、handover times、handover conditions、DTX activated (or not)、 Notes and the encoder in use. Page 14,Total 45 pages . so the accordingly estimated number of sites will meet the needs. If the network dimension has to be reduced due to market strategies needs.

98 MOS can be affected greatly by the performance of test equipment. It adopts the new algorithm developed by Psytechnics company.Secret▲ Secret▲ the assessment.1(5. PESQ This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.4. and thus can 10 play its part in designing、testing and debugging new type of voice encoders. the test equipment from Actena performs the best. In MOS. Standard PCM quality shall reach around 4.726——MOS= 4. 1996.29 3.723、G.worst).3 MOS & PSEQ Subjective scoring method had been used in assessment on voice quality until 2001. The MOS values for commonly used coding formats are as follows: G.best. 5 stands for the highest. This assessment method was regulated to be a standard by ITU in August.2 G. The test results from different manufacturers are different.723.711——MOS= 4.728 ——MOS=4.1(6.5 G.2 G.3)——MOS=3. So there was an urgent need for a kind of economic test equipment.800 standard in details. With the aim to meet the need.723. Page 15,Total 45 pages . Currently. which can be used to simulate the voice quality received by users.729 ——MOS=4. MOS assessment method was defined in its P. 1 .3)——MOS=3. but also cost a lot. in February 2001 ITU issued the new test standard on voice transmission quality-P.721、G. Users were requested to assess the voice quality of incoming calls by scoring 1-5 5 (5.862 (PESQ-Perceptual Evaluation of Speech Quality).63 3.57 3. 0 means the worst quality. Average MOS(Including FR &HR Voice version combination MOS) Frequency hopping 100% FR 100% EFR 100% AMR FR 60% HR (+EFR) 30% HR (+EFR) 10% HR (+EFR) 60% AMR HR (+AMR FR) 30% AMR HR (+AMR FR) 10% AMR HR (+AMR FR) 3.4.8 G.2 G.56 No hopping 3.04 3.54 TFO No frequency hopping frequency Frequency hopping 3. But later it was found that this method not only took too much time.

we can see the correlation between the two values is 0..doc》for correlation factors). In the ordinary course of event. PESQ is testified to be a reliable、economic and fast measuring tool for voice encoder.5 MOS. MOS subjective test method is defined in ITU-T P. The computed result and the subjective scoring result are basically the same. The objective test methods includes PSQM、PSQM+ and PESQ etc. For 22 kinds of ITU benchmark tests. while MOS value ranges from 1 to 5.2% among which is within 0. the smaller the reference value of MOS will be. 15 Fig 1 MOS/PESQ Correlation Diagram At the present time.935(refer to 10 《P862E.5. PESQ compares the output signal (collected after the signal is transmitted through equipment) and the reference signal.25 MOS. 69. ITU-T P. the absolute error is within 0.5 to 4. It is worth our attention that PESQ value ranges from 0. the bigger the difference between the output signal and the reference signal. Compare PESQ’s predicted value and the result from subjective scoring method.800.862 20 ( PESQ ) is the method currently recommended by ITU to test end-to-end This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 16,Total 45 pages . there are two types of QOS test method-subjective and objective methods.Secret▲ Secret▲ can be used to compute voice sample’s MOS-LQO value (Mean Opinion ScoreListening Quality Objective). then works out the 5 difference.

Page 17,Total 45 pages .Secret▲ Secret▲ network voice quality. It would be ideal if MOS and PESQ are simultaneously supported in the QOS test. Form 1 Definition of MOS Values Level Excellent Good Fair Poor Bad MOS 5 4 3 2 1 This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

3. 2.1 DL TBF establishment success rate KPI KPI value Indicator type Indicator definition reference DL TBF establishment success rate Suggested value Risk value Statistical value (GPRS DL signalling TBF link setup times+ GPRS DL data TBF link setup times +EGPRS DL signalling TBF link setup times +EGPRS DL data TBF link setup times)*100%/ DL packet channel request times(V3) V2 (C70043+C70057+C70071)*100/C70041 (C100010007+C100010015+C100010008+C100010016) V6. errors in Timer and functional parameters Stability of equipment and transmission: eg. 95% 96% 4.2 UL TBF establishment success rate KPI KPI reference value Indicator type Indicator definition UL TBF establishment success rate Suggested value Risk value 95% 92% Statistical value (GPRS UL signalling TBF link setup times + GPRS UL data TBF link setup times +EGPRS UL signalling TBF link setup times +EGPRS UL data TBF link setup times) This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Interference: internal & external interference. 4.1 Accessibility 4.1.0 Counter formula V3 V6. instant breakdown(flash) resulted from high error rate or unstable link.1 *100%/(C100010141+C100010142+C100010143+ C100010144+C100010145+C100010146+C100010147 +C100010148) (C900040007+C900040015+C900040008+C900040016) *100%/(C900040141+C900040142+C900040143+ C900040144+C900040145+C900040146+C900040147 +C900040148) This KPI reflects the request fulfilled status of PS downlink resources. Its major influencing factors are as follows: Notes 1. Page 18,Total 45 pages .Secret▲ Secret▲ 4 PS Radio Service Statistical KPI 4.1. Its TBF includes DL signaling TBF、GPRS DL data TBF and EGPRS DL data TBF. Usability of data service functions. Parameters setting: eg. DL TBF link setup success rate can reflect the DL PS quality of a cell.

0 C70066*100%/ C70065 C100010063*100%/C100010062 C900040063*100%/C900040062 UL GPRS RLC retransmission rate Suggested value Risk value 5% 10% Statistical value GPRS UL TBF NACK blocks *100% / valid data statistics received by GPRS UL TBF This KPI reveals UL GPRS RLC retransmission rate. Its TBF includes UL signaling TBF、GPRS UL data TBF and EGPRS UL data TBF. 3. 4. This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. 2. Stability of equipment and transmission: eg. instant breakdown resulted from high error rate or unstable link.1 V6. Interference: internal & external interference. Its major influencing factors are as Notes follows: 1.1. Interference: internal & external interference.Secret▲ Secret▲ *100/ UL packet channel request times(V3) V2 (C70042+C70055+C70069)*100%/C70040 (C100010025+C100010033+C100010026+C100010034) Counter formula V3 V6.3 GPRS RLC KPI KPI reference value Indicator type Indicator definition V2 Counter formula V3 V6. Its major influencing factors are as follows: Notes 1.1 V6. Parameters setting: eg. 2. instant breakdown resulted from high error rate or unstable link. UL TBF link setup success rate can reflect the UL PS quality of a cell. errors in Timer and functional parameters Stability of equipment and transmission: eg. which is the most important indicator to reflect the sensibility of GPRS UL service and to show whether instability、 congestion and interference exist in the system.0 *100% /(C100010159 +C100010160+C100010161+C100010168 +C100010163+C100010164+ C100010165+C100010166) (C900040025+C900040033 +C900040026 +C900040034) *100%/ (C900040159+ C900040160 +C900040164 +C900040161+C900040168+C900040163 +C900040165+C900040166) This KPI reflects the request fulfilled status of PS uplink resources. 4. Usability of data service functions. Page 19,Total 45 pages .

1. Its major influencing factors are as 解读 Notes follows: 1. Page 20,Total 45 pages .0 C70080*100%/ C70079 C100010071*100%/C100010070 C900040071*100%/C900040070 EGPRS UL TBF NACK blocks *100% / valid data statistics received by EGPRS UL TBF UL EGPRS RLC retransmission rate Suggested value Risk value Statistical value 5% 10% Refer to UL GPRS RLC retransmission rate 4.1 V6.Secret▲ Secret▲ 4.1.5 EGPRS RLC KPI KPI reference value Indicatory type Indicator definition V2 Counter formula V3 V6.1 解读 Notes V6. 2.6 EGPRS RLC KPI DL EGPRS RLC retransmission rate This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.0 C70068*100%/ C70067 C100010065*100%/C100010064 C900040065*100%/C900040064 GPRS DL TBF NACK blocks *100% / valid data statistics received by GPRS DL TBF Statistical value 5% 10% This KPI reveals DL GPRS RLC retransmission rate. Interference: internal & external interference.1.4 GPRS RLC KPI KPI reference value DL GPRS RLC retransmission rate Suggested value Risk value Indicatory type Indicator definition V2 Counter formula V3 V6. instant breakdown resulted from high error rate or unstable link. 4. which is the most important indicator to reflect the sensibility of GPRS DL service and to show whether instability、 congestion and interference exist in the system. Stability of equipment and transmission: eg.

1 Notes V6.0 C70082*100%/ C70081 C100010073*100%/C100010072 C900040073*100%/C900040072 EGPRS DL TBF NACK blocks *100% / valid data statistics received by EGPRS DL TBF Suggested value Risk value Statistical value 5% 10% Refer to DL GPRS RLC retransmission rate This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 21,Total 45 pages .Secret▲ Secret▲ KPI reference value Indicatory type Indicator definition V2 Counter formula V3 V6.

this KPI is the CQT value. Page 22,Total 45 pages .1 Attach success rate KPI KPI reference value Indicator definition Indicatory type Counter formula Notes Normally. Attach success means that the mobile phone receives the Attach Accept signaling within 15 seconds after it sends the Attach Request. Authentication included.1 Accessibility 5. It is required to perform the test ten times at each test site. duration from the mobile sends out the first Attach Request to it receives the Attach Accept signaling.1.5 sec Sum of attach success duration/ Attach success times.3 PDP context activation success rate KPI KPI value reference PDP context activation success rate Suggested value 95% This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.1.Secret▲ Secret▲ 5 PS Radio Service Test KPI 5.1.2 Average GPRS attach time KPI KPI value reference Average GPRS attach time Suggested value Risk value 2 sec 1. None test Attach success rate Suggested value Risk value 98% Attach success times/Attach attempt times×100% 95% 5. Test value None 5 5. It is the Indicator definition Indicatory type Counter formula Notes Normally. It is required to perform the Attach test ten times at each test site. this KPI is the same as the CQT value.

Secret▲ Secret▲ Risk value Indicator definition 98% PDP activation success times/attempt times ×100%. None reference PING test success rate Suggested value Risk value 95% 98% Ping success times/Ping attempt times*100% 5. PDP activation success means that the mobile phone receives the Activate PDP Context Accept signaling 15 seconds after it sends the Activate PDP Context Request. It is required to perform the PDP activation test ten times at each test site. Authentication included.4 PDP context activation time KPI KPI value Indicator definition reference PDP context activation time Suggested value Risk value times.6 Average PING test time KPI KPI value reference PING test time GPRS Suggested value Risk value 1.5 PING test success rate KPI KPI value Indicator definition Counter formula Notes It is regarded as failure if the time exceeds 30 seconds.5 sec 1. Page 23,Total 45 pages . PDP activation time means the duration from the mobile phone sends out the first Activate PDP Context Request to it receives the Activate PDP Context Accept. Indicatory type Counter formula Notes Normally. this KPI is the same as the CQT value. GPRS and EDGE are not separated in this test.4 sec This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Test value None 1.2 sec Sum of PDP activation duration/ PDP activation success 5.1. 5.1. this KPI is the same as the CQT value.5 sec 1. Indicatory type Counter formula Notes Test None Normally.1. Test methods for GPRS and EDGE are the same.

It also can be obtained from DT too.3. the better the test result will be.3 Data Throughput 5. the better the test result will be. The Ping package size will have influence on the test result.. the smaller the Ping package is. the smaller the document size is. etc. The test result can also be affected This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Generally.1 Routing Area Update Successful rate KPI KPI reference Indicator definition Indicatory type Counter formula Notes test None Usually it can be statistical value. Page 24,Total 45 pages .Secret▲ Secret▲ Suggested value Risk value 1 sec 0. It is related to the number of PS channels、terminal type、encoding method and test software.2. It is sometimes referred as Round Trip Time. Class 4 mobile. Size of the downloaded document will affect the test result. Routing Area Update Success rate Suggested value Risk value 90% 95% Routing update attempt times*100% / Routing update success times 5. 5.2 Mobility 5.1 Average FTP download rate KPI KPI reference value EDGE GPRS FTP download rate Suggested value Risk value Suggested value Risk value 20kbps 30kbps 80kbps 120kbps Indicator definition Indicatory type Counter formula Notes Actual download data quantity (byte)/actual download duration Test value None Normally. this KPI is the CQT value.6 sec EDGE Indicator definition Indicatory type Counter formula Notes Test value None Sum of Ping success duration/ Ping success times Authentication is included in this KPI. Usually.

the better the test result will be.Secret▲ Secret▲ by the adoption of encoding method for CS3 and CS4. single Preconditions subscriber.4kbyte/s 5kbyte/s 1.1 PDTCH Drop Rate KPI KPI value Indicatory type reference PDTCH Drop Rate Suggested value Risk value DT test value 5% 2% This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. 4 DL static signaling channels.4. Class 4 mobile.3. This KPI is the result of single time slot.8kbyte/s 2. 5. It is related to the number of PS channels、terminal type、encoding method and test software.4 Reliability 5.. The test result can also be affected by the adoption of encoding method for CS3 and CS4.3. this KPI is the same as the CQT value. the smaller the document size is. etc.5kbyte/s 5.5kbyte/s 7kbyte/s 14kbyte/s 3. Usually. 3static time slots are configured.3 Throughput Mobile phone with multi-timeslot Level 8.3kbyte/s 26. Size of the uploaded document will affect the test result. Page 25,Total 45 pages . 1 UL static signaling channel Indicators (EN) GPRS: Max data throughput-DL GPRS: Max data throughput-UL GPRS: Average data throughput-DL GPRS: Average data throughput-UL EDGE: Max data throughput-DL EDGE: Max data throughput-UL EDGE: Average data throughput-DL EDGE: Average data throughput-UL Indicators (CN) GPRS DL maximum transmission rate GPRS UL maximum transmission rate GPRS DL average transmission rate GPRS UL average transmission rate EDGE DL maximum transmission rate EDGE UL maximum transmission rate EDGE DL average transmission rate EDGE UL average transmission rate Suggested value 9.2 Average FTP upload rate KPI GPRS FTP upload rate Suggested value Risk value Suggested value Risk value 8kbps 10kbps 25kbps 35kbps KPI reference value EDGE Indicator definition Indicatory type Counter formula Notes Actual upload data quantity (byte)/actual upload duration Test value None Normally. 5.

Page 26,Total 45 pages .Secret▲ Secret▲ Indicator definition Counter formula Notes None PDTCH drop times/ FTP download attempt times *100% This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.

Secret▲ Secret▲ 6 Introduction to CN Statistical KPI 6. excluding the secondary paging information. including the second paging response.008) ,excluding redeliver Statistics at SGSN side Attach success rate Suggested value Risk value 90% 95% GPRS attach success times *100% / GPRS attach times This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. reference Paging success rate Suggested value Risk value 90% 93% Paging response times*100% / Paging request times 6.3 Attach success rate KPI KPI reference value Indicator definition Indicatory type Counter formula Notes excluding Unregistered subs GPRS attach success times : SGSN delivers (ATTACH ACCEPT, 3GPP TS 24. Notes BSC can indirectly provide this KPI. but its statistical point differs from that of MSC. Page 27,Total 45 pages . but the value is different and its statistical point differs from that of MSC too. The difference lies in call loss at Interface A.2 Location update success rate KPI KPI value Indicator definition Counter formula Notes This KPI can be indirectly provided by BSC. Statistical point is at MSC side.1 Paging success rate KPI KPI value Indicator definition Counter formula Paging request times refer to the sum of PAGING information sent out by all MSCs in the area. Paging response times refer to the sum of the PAGING RES received by all MSCs in the area. Provided by the SMC side Location update success times *100%/ location update request times reference Location update success rate Provided by the SMC side 6.

6 Routing Area Update Success rate KPI KPI value Indicator definition reference Routing Area Update Success rate Suggested value Risk value 92% 95% Routing update attempt times*100%/ routing update success times This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.Secret▲ Secret▲ 6. the attach duration is only computed within the attach accepted period. If the attach time exceeds the timer. Indicatory type Counter formula Notes The performance evaluation in China Mobile in 2003 (success times of PDP context activation started by GPRS terminal/ attempt times of PDP context activation started by GPRS) results are as follows: Excellency index: 94% Reach-the-mark index: 90% Lowest Threshold index: 85% Test or statistics Statistics at GGSN side 6.5 PDP context activation success rate KPI KPI value reference PDP context activation success rate Suggested value Risk value 80% 85% success times of PDP context activation started by MS*100%/ attempt times of PDP context activation started by MS Indicator definition The attempt times of PDP context activation started by MS is the times GGSN received Create PDP Context Request from SGSN. Page 28,Total 45 pages . Notes 6.4 GPRS average attach time KPI KPI value Indicator definition Indicatory type Counter formula reference GPRS average attach time Suggested value Risk value To be confirmed To be confirmed Customer attach establishment duration *100% / customer number of attach establishment success Statistics Attach establishment time refers to the time duration from the receipt of GPRS ATTACH REQUEST by MS to the delivery of ATTACH ACCEPT by SGSN. The success times of PDP context activation started by MS is the statistic of Create PDP Context Response sent from GGSN to SGSN when Cause value is Request Accepted.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.Secret▲ Secret▲ Indicatory type Counter formula Notes From statistical value or DT. provided by GPRS core network Update success rate at routing area crossing SGSN is lower than that at the SGSN routing area. Statistics at SGSN side. Page 29,Total 45 pages .

98 21.10 42.99 8.05 8.8 2188.10 2.304 512.24 24.73 106. Page 30,Total 45 pages .78 57.97 7.14 23.72 72.381 48.80 23.381 512.Secret▲ Secret▲ 7 Comments on KPI Cases 7.97 13.96 38.66 15.69 126.67 Average timeslot speed (kbps) Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Pre-optimization Ping Ping interval package size (byte) 0 5 2 2 5 32 32 100 500 500 839 816 571 839 862 1 Download Download Download Download Download Download Download Download Download Download Download 102.1 Pengshui (Chongqing) PS Test Result 1、 CQT scene,near cell 2、 EDGE Commissioned 5 3、 Multi-timeslot capability3+1 4、 Number of PDCH static channels: 3 Test state Test serial 1 2 3 4 5 6 7 8 9 10 11 FTP type FTP (Kbyte) size Download speed (Kbyte/s) 8.34 15.42 69.817 102.74 14.381 102.93 64.21 9.56 42.304 512.18 204.93 19.304 23.58 35.81 15.29 127.304 512.60 7.33 Download speed (kbps) 71.51 125.88 114.304 512.22 Ping timelag(ms) 2 3 8 9 10 Average timelag (ms) 655 709 691 873 775 Ping success rate 100% 100% 100% 100% 100% 4 61 2 77 9 75 6 82 1 75 5 6 7 634 590 650 955 760 612 581 697 107 5 857 608 757 753 779 672 589 733 651 737 811 566 716 711 918 690 765 692 729 894 811 561 812 707 875 709 761 609 688 840 825 This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.17 41.

the EDGE download speed of current 7. equipment can reach above 40kbps. June 2008 Test aim : to test E-FPRS network performance under Test aim:to download 1000KB document 20 Timeslot :4 static timeslots static state th th Test Result This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. The Ping success rate and Ping timelag can vary very much due to different Ping intervals、 different Ping package sizes and different Ping servers. When C/I is in good condition.Secret▲ Secret▲ 5 2 2 2 800 1000 1200 959 115 7 107 8 8 840 910 115 869 880 897 86 9 90 7 95 7 7 8 101 845 102 823 918 959 781 105 4 119 1 0 883 881 102 8 860 108 2 101 2 7 104 846 103 865 1010 1002 100% 100% 100% Comments on case: 1. 5 2. 15 Test method : outdoor static FTP download test Test location : 11 sites at Baoqing market in Fenghuang county Test time : 19 —30 .60Ghz、Windows XPSP2 、 standard 28800bps modem 、 rate at 115200bps 、 modem error control and compression forbidden 、 no software irrelevant to the test. Page 31,Total 45 pages .2 Jishou (Hunan) China Mobile EDGE Test Result Test Specification Test equipment:ANT Pilot for E-GPRS; 10 Test phone SEGAM OT490(one set) Test laptop: memory 1024M、harddisk 80G、CPU 1.

09 207.72 191.38 191.74 1000 -51 2 Opposite MingDu Hotel 197.5 188.34 180.02 183.09 191.16 180.45 Jishou Jishou 1000 1000 -50 -62 2 2 Gate of XingGuang Hotel Gate of XingGuang Hotel 193.09 1000 -40 2 Lobby of MingDu Hotel 192.46 187.46 196.44 Jishou 1000 -45 2 Gate of XingGuang Hotel 185.55 Jishou Jishou Jishou Jishou Jishou Jishou Jishou Jishou TianXia Feng Huang Cell 2 BaoQing market Cell 1 BaoQing market Cell 2 BaoQing market Cell 3 Xinhua Bookstore Cell 1 Xinhua Bookstore Cell 2 Xinhua Bookstore Cell 3 Comprehensive Building Cell 1 Comprehensive Building Cell 2 Comprehensive Building Cell 2 Comprehensive Building Cell 1800M1 Comprehensive Building 1000 1000 1000 1000 1000 1000 1000 1000 -59 -38 -36 -46 -50 -53 -45 -37 2 2 2 2 2 2 2 2 197.36 186. west to ChinaMobile business hall 197.1 181.26 201.37 197.21 This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.07 184.85 162.16 157.81 198.98 176.6 1000 -44 2 Gate of Prefectural government office 201.Secret▲ Secret▲ Test Branch office Test sites document size (KB) Fenghuang County Jishou prefectural government office building Cell 1 Fenghuang County Jishou prefectural government office building Cell 2 Fenghuang County Jishou prefectural government office building Cell 3 Jishou Old district Cell 1 1000 -49 2 Basketball field of Jiandaoping Primary School Basketball field of Jiandaoping Primary School Kindergarten next to Jiandaoping Primary School Opposite Wanmingta River Opposite Wanmingta River Square in front of TianXiaFengHuang Hotel Square in front of TianXiaFengHuang Hotel Gate of Linlinlou Drug Store Gate of Linlinlou Drug Store Gate of Linlinlou Drug Store Lobby of Xinhua Hotel Lobby of Xinhua Hotel Parking lot of Xinhua Hotel Lane.38 190.91 Jishou Jishou Jishou Jishou Old district Cell 3 Rainbow Bridge Cell 1 Rainbow Bridge Cell 2 TianXia Feng Huang Cell 1 1000 1000 1000 1000 -56 -43 -43 -34 2 2 2 2 198. Page 32,Total 45 pages .22 184.29 193.3 Test electrical level (dBm) Download times Test location RLC average rate (Kbps) RLC average rate (Kbps) 198.98 Jishou 1000 -60 2 Gate of XingGuang Hotel 184.19 181.83 185.51 185.98 206.51 195.26 198.08 178.79 Jishou Old district Cell 2 1000 -32 2 207.96 206.02 185.

88 199. 2 Average attach time Attach duration sends until time from it out means the the mobile <3s Attach receives Request GPRS attach accept signaling.3 Acceptance requirements for EDGE KPI of Data Service of a network Serial 1 Indicators GPRS/EGPRS attach success rate Explanation GPRS/EGPRS means that the Attach mobile success phone Formula GPRS/EGPRS attach success rate = GPRS Attach success times/attach attempt times × 100% Average attach time = sum of attach success duration /attach success times Target >95% receives the Attach Accept signaling 15 seconds after it sends the Attach Request. 7.49 106. When C/I is in good condition. This test is the CQT.Secret▲ Secret▲ Cell 1800M2 Jishou Jishou Jishou Jishou Jishou Jishou Telecom Bureau Cell 1 Telecom Bureau Cell 2 Telecom Bureau Cell 3 Telecom Bureau Cell 1800M1 Telecom Bureau Cell 1800M2 Telecom Bureau Cell 1800M3 1000 1000 1000 1000 1000 1000 -51 -64 -57 -59 -73 -84 2 2 2 2 2 2 Business Hall of Telecom Bureau Business Hall of Telecom Bureau Backdoor of Supermarket (next to Telecom Bureau) Gate of furniture store (next to Telecom Bureau) Business Hall of Telecom Bureau Business Hall of Telecom Bureau 180. 2. Page 33,Total 45 pages .92 Comments on case: 1.85 166.19 179.85 159.48 185.44 181. the average EDGE download speed can reach above 180kbps with a peak value of above 200kbps. 5 WAP website WAP website log-in success WAP website log-in success >95% of of Activate to Activate PDP the PDP Request PDP average activation time = sum success of PDP activation duration/PDP <3s activation PDP activation success >95% rate=PDP activation success times/attempt times×100% activation success times Context Accept by the mobile This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.7 105. 4 PDP time average PDP average activation time means the duration from the delivery Context receipt phone. that 5 is they are not necessary to the test conditions.20 197.85 182.75 171. 3 PDP activation success rate PDP activation success means that the mobile phone receives the Activate PDP context Accept signaling 15 seconds after it sends the Activate PDP Context Request. Cell reselection and RAC renewal can be neglected.

Secret▲ Secret▲ log-in success rate means that the homepage rate = WAP website log-in fully and correctly displays within 60seconds after the mobile phone started the WAP website log-in request. Requirements of operation and maintenance KPI are not as strict as those of acceptance check KPI.4 Operation & Maintenance KPI of a Network SN Indicator Unit Target Level Permissible Level 1 SDCCH Ratio Drop % 1 1. Indication Definition: SDCCH Drop Ratio=SDCCH call drops/ Access Remark This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.2 Base on system performance report of OMCR. Ping rate Ping average success times×100%。 8 Ping success rate = ping success times/ping attempt times×100 9 Ping average timelag=sum of each Ping success duration/ping success times 10 FTP speed download FTP download speed = actual download time(sec)×9 11 FTP speed upload FTP upload speed = actual >20kbps upload data quantity(Byte) /actual upload time(sec) ×9 data quantity download ( Byte ) /actual >80kbps <2s timelag >95% Comments on case: 1. 5 7. average displaying successful displaying times WAP refresh webpage WAP homepage of WAP homepage <10s time = sum duration / homepage displaying success webpage success refresh refresh times / 7 WAP webpage WAP webpage refresh success means webpage that can the be selected refreshed >95% refresh success rate success rate = WAP webpage attempt within 60seconds. 2. Page 34,Total 45 pages . Usually these KPI requirements can be satisfied. success times/ website login attempt times×100%。 6 average homepage displaying time WAP WAP homepage displaying time refers to the duration from the the WAP website fully log-in and request is sent out until homepage correctly displays.

Indication Definition: TCH Blocking Ratio=TCH overflows (include handover)/ TCH call attempts (include handover) 6 TCH Assignment Success Ratio % 98 97 Base on system performance report of OMCR. Indication Definition: TCH assignment Success Ratio=Number of TCH assignment successful / Number of TCH call attempts (include handover) 7 GPRS per TBF 8 EDGE per TBF 9 Attach Success Rate (GPRS/ EDGE) 10 Handover Success Ratio 11 Call Blocking Ratio % < 2 for 98% of all GSM cells 12 Call Success (Drive Test) 13 Call Rate Test) 14 Speech MOS >= 3 for >= 3 for Depend on the DT route and method Drop (Drive % 2 3 Depend on the DT route and method Setup Rate % 97 < 2 for 90% of all GSM cells 90 Depend on the DT route and method Based on OMC-R statistics % 94 93 % 99 97 24-Hour measurement average Kbps 45 40 24-Hour measurement average Kbps 28 25 24-Hour measurement Indication Definition: Call Success Rate = 1 - TCH assignment DL throughout DL throughout This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.5 Base on system performance report of OMCR. Indication Definition: SDCCH Blocking Ratio=SDCCH overflows/ SDCCH call attempts 5 TCH Blocking Ratio % 2 2.2 Base on system performance report of OMCR. Indication Definition: TCH Drop Ratio = TCH call drops/ Seized TCHs (include handover ) 3 Call Ratio Success % 98 97 Base on system performance report of OMCR.5 0.75 Base on system performance report of OMCR. failure rate 4 SDCCH Blocking Ratio % 0. Page 35,Total 45 pages .Secret▲ Secret▲ attempt Number 2 TCH Drop Ratio % 2 2.

which features detailed classification and all-round evaluation. KPI Measurement Level 0 Level 1 Level 2 Scope and This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 36,Total 45 pages .5% cells of Network with GOS 5% or above 1.5 Operation & Maintenance KPI of a network in Southeast Asia No.Secret▲ Secret▲ Quality Test) (Drive 95% samples 15 Coverage (Drive Test) dBm >= -85 for 95% samples 16 UL Throughput 17 DL Throughput 18 BSC/RNC down time (unscheduled) 19 TRX/channel element failure (unscheduled) 20 SDCCH Mean Time 21 Radio Access Success Ratio 22 Worst GOS Cells Less than Less than per BSC/RNC / BH of a week % >99.999 (< 6 sec) per BSC/RNC / week Kbps >30 >30 Based on DT Kbps >10 of measurement of 90% samples >= -85 for 90% samples >10 Based on DT of measurement Depend on the DT route and method of measurement measurement 1.5 >99 per BSC/RNC / BH of a week Holding s <2 <3 per BSC/RNC / BH of a week % < 1 of all active TRX < 2 of all active TRX per BSC/RNC / week % >99. 7. 2.5% cells of Network with GOS 5% or above >95 <1 per BSC/RNC / BH of a week per BSC/RNC / BH of a week 23 24 RXQUAL 0 to 3 AMR FER voice % % >97 <1 Comments on case: 1. Requirements for KPIs like GPRS average DL throughout per TBF and EDGE average 5 DL throughout per TBF are higher. Requirements for evaluation of CS voice quality are higher. 3.999 (< 6 sec) >99. This KPI comprises statistical KPI、testing KPI and equipment performance KPI.

5% <1% 5 GSM: <3% GSM: <2% GSM: <1% 6 Handover Success Rate Pre Defined Drive Test Route or NMS >90% >97% >97% 9 SQI (TEMS) Call setup delay (PSTN to MS. With condition that Core Network is achived the same value of Level 1 and Level 2 Average value per city / BH of a week 3 Paging Success Rate NMS >90% >95% >97% 4 Call blocking rate Drop Call Rate (excluding inter RAT) pre-defined locations and Drive test route/NMS Pre Defined Drive Test Route/NMS <0. time from send pressed to ring) Pre Defined Drive Test Route >20(95%) > 25(95%) > 25(95%) 10 Pre Defined Drive Test Route <6s < 6s <6s per Media Gateway/ monthly 11 Pre Defined Drive Test Route <5s < 5s <5s per Media Gateway/ monthly This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.Secret▲ Secret▲ interval % of outdoor area with 2G signal level > 104 dBm Call Setup Success Rate (exclude blocking) 1 pre-defined Drive test route >90% >97% >99% per city / monthly 2 pre-defined locations and Drive test route/NMS 95% >98% >99% per city / BH of a week (drive test monthly) per city / BH of week.5% <0. time from number dialed to ring) Call setup delay (MS to PSTN. With condition that Core Network is achived the same value of Level 1 and Level 2 per city / BH of a week (drive test monthly) per city / BH of a week (drive test monthly) per city / BH of a week (drive test monthly).per city / BH of week. Page 37,Total 45 pages .

5% <0.5% 19 Handover Success Rate Pre Defined Drive Test Route/NMS Inter BSS: >92% : Inter Cell: >92% Inter BSS: >97% : Inter Cell: >97% Inter BSS: >97% : Inter Cell: >97% 20 RXQUAL 0 to 3 Pre Defined Drive Test Route/NMS Pre Defined Drive Test Route/NMS NMS >80% >85% >90% 21 AMR voice FER Successful PS Attachment Successful PDP context activation Data session Setup Success Rate (PDP context already exist) <1% <1% < 1%.5% <1% 16 <0. 23 >98% >98% >98% 24 NMS >98% >98% >98% 25 Pre Defined Drive Test Route/NMS >95% >98% >98% per city / BH of a week This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. Page 38,Total 45 pages .5% <0.5% <1% 18 Drop Call Rate <5% <2% <1.5% 15 <0.Secret▲ Secret▲ Call Setup Successful Rate SDCCH Access Success SDCCH Blocking Rate TCH Blocking Rate per BSC/RNC / BH of a week per BSC/RNC / BH of a week per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) With condition that Core Network is achived the same value of Level 1 and Level 2 per BSC/RNC / BH of a week (drive test monthly) per BSC/RNC / BH of a week (drive test monthly) per city / BH of a week per city / BH of a week 12 NMS >95% >98% >99% 13 NMS Pre Defined Drive Test Route/NMS Pre Defined Drive Test Route/NMS Pre Defined Drive Test Route/NMS >99% >99% >99.

GPRS (Class 4 MS): > 20 Kbps. FTP download 1MB file Stationary UMTS MS in cell border (SHO). GPRS (Class 4 MS): > 9Kbps.8s per city / BH of a week per city / BH of a week 36 >98% >98% >99% This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements.5% per city / BH of a week 33 NMS > 95% > 95% >97% per city / BH of week 34 Pre Defined Drive Test Route Pre Defined Drive Test Route NMS <5s <5s <5s per city / BH of a week 35 <1 <1 <0. per city / BH of a month 30 Pre-defined locations N/A > 150 Kbps > 150 Kbps per city / BH of a month 31 NMS <0. FTP download 1MB file PDTCH blocking rate 60 second data transfer drop Rate (MS moving) Routing Area Update Successful rate MS initiated service setup time MS roundtrip Ping time (20 ping averaged) PDP update Pre Defined Drive test route GPRS>8kbps GPRS (Class 4 MS): > 9Kbps.5% <1%. per BSC / BH of a week 32 Pre Defined Drive Test Route <3% <2% <1.5% <0. per city / BH of a month 28 Pre-defined locations GPRS (Class 4 MS): > 40 Kbps GPRS (Class 4 MS): > 40 Kbps GPRS (Class 4 MS): > 40 Kbps per city / BH of a month 29 Pre-defined locations GPRS (Class 4 MS): > 20 Kbps GPRS (Class 4 MS): > 20 Kbps. Page 39,Total 45 pages . FTP download 1MB file Stationary GPRS MS in cell border.Secret▲ Secret▲ 26 Moving MS FTP download 1MB file Pre Defined Drive test route GPRS>30kbps GPRS (Class 4 MS): >30Kb GPRS (Class 4 MS):> 30Kbps per city / BH of a month 27 Moving MS FTP upload 1MB file Stationary MS near site.

But the attached prerequisites can lower the risk to some extent. mainly dealing with statistical KPI and testing KPI. It ranges from 2G to 3G network.. etc.xls Comments on case 15 1. This OM KPI just got some of the indicators. Due to market factors. which we need to make clear with customers in technical 10 clarification.6 KPI requirements for Indonesia Telkomsel network KPI requirements for Indinesia Telkomsel. and there is risk in some of the KPIs. the OM KPI of this network is set unreasonable. The requirements for handover success rate and paging success rate are very high. This document contains proprietary information of ZTE Corporation and is not to be disclosed or used except in accordance with applicable agreements. the definition of handover success rate varies with different manufacturers. The evaluation scale of KPI is relatively large. The evaluation of this KPI falls into three grades. Page 40,Total 45 pages . 2. 20 The division of KPI evaluation scenes and most KPI values are relatively reasonable. The requirements for data service and voice KPI are higher. 3. which are difficult to reach. Besides. 3. 5 2.Secret▲ Secret▲ success rate Comments on case: 1. Its service includes voice、GPRS and 3G data service. etc. excluding the weighing of all KPIs and 2/3G interoperate KPI.. 7.

Sign up to vote on this title
UsefulNot useful

Master Your Semester with Scribd & The New York Times

Special offer for students: Only $4.99/month.

Master Your Semester with a Special Offer from Scribd & The New York Times

Cancel anytime.