Professional Documents
Culture Documents
3G KPI Guidelines
3G KPI Guidelines
,
_
# $ R% &
# $ R% &
'
&
&
'
&
&
1
CSV 7uest Assi,nment RA8
CSV sponse Assi,nment RA8
SR8Attempt
SR8Success
Attempt Connection RRC
Success Connection RRC
The abo&e fo!mula definition shall be met $ith the follo$ing Selle!#s counte!s"
144H
1
]
1
,
_
Calls CSV
Calls CSV
7uest Connection RRC
Connect Alertin, CC
ailureRate CSVAccessF
8
8
R% 8
9 8
1 ' 166
14 of 34
Measurement Condition$
n the e&ent that the!e a!e se&e!al consecuti&e 11, ,onnection 1e.uest onl/ the fi!st 11, connection
!e.uest shall be ta(en into account fo! the KP calculation"
,alls a!e conside!ed as failed du!ing access $hen a connection is attempted and the UE does not !ecei&e
Ale!tingD,onnect message in case of d!i&e test measu!ement" *o! OSS 1ANAP: 1A0 Assignment
1esponse message f!om the 1N, to co!e Net$o!( is conside!ed as a call successful setup"
Table /$ CS4 0ccess 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(6 7 5 .(6 7 5 .(6 7
/(1(8 ,S< 7!op
,i!cuit S$itched <oice 7!op measu!es the Net$o!(#s inabilit/ to maintain a call" ,S< 7!op is
defined as the !atio of abno!mal speech disconnects% !elati&e to all speech disconnects 'both no!mal
and abno!mal)"
A no!mal disconnect is initiated b/ a 1A0 7isconnect 1ANAP message f!om the 5S, at the
completion of the call" An abno!mal 1A0 disconnect includes 1adio 9in( *ailu!es% U9 o! 79
inte!fe!ence o! othe! !eason and can be initiated b/ eithe! UT1AN o! ,N"
#1uation /$ CS4 'ro* +ate ,Counter 2ormula-
144H 1
]
1
,
_
# $ R% & # $ R% &
# $ R% &
1
CSV lease l RA8Abnorma CSV lease RA85ormal
CSV lease 5ormal RA8
144H
1
]
1
,
_
Calls CSV
Calls CSV
uccess CallSetupS
d CallDroppe
e CSVDropRat
8
8
' 166
11 of 34
Measurement Condition$
An/ ,S< call successfull/ handed o&e! f!om =2 to 22 net$o!( $ithin the ,S< Se!&ice A!ea shall be
conside!ed as d!op call fo! 5ilestone 2"
Table 9$ CS4 'ro* +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(6 7 5 .(6 7 5 .(67
/(1(9 ,S< Aualit/
<oice .ualit/ shall be measu!ed b/ 09E1
#1uation 9$ CS4 UL :uality ,Counter 2ormula-
144H
# $ &
# $ &
Speech ombinin, SelectionC A#ter 4plin1 )n 8loc1s port +otal+rans
Speech ombinin, SelectionC A#ter 4plin1 )n 8loc1s +ransport Fault
U9 09E1 is also a&ailable as a&e!age o&e! the $hole 1epo!ting pe!iod '1@ minutes) as a counte!
desc!ibed in the follo$ing fo!mula using 1N, based counte!s:
144H
2; ,<U%R/ (,4/=3A/U .-T)*+3.4)
2; R/ /=3A/U,<U% *+3.4)(,4 .-F*5,(:T)
2
2
Calls CSV
Calls CSV
ples All83ERSam
et ow83ER+ Samples8el
t CSVD3Quali
8
8
*)>
' 166
Measurement Condition$
79 .ualit/ shall be measu!ed in all th!ee '=) milestones 'P!e:9aunch% 9aunch and Post 9aunch)
This KP shall be measu!ed at 1? 09E1 ope!ating point set in UT1AN fo! &oice call" The do$nlin( 09E1
&alue shall be collected f!om the UE ha&ing !epo!ting pe!iod of 2 seconds and agg!egated o&e! a pe!iod
of 14 seconds in Post P!ocessing Tool fo! calculation of KP" An/ f!action of 14 seconds shall also be
included in this KP calculation" The 09E1 calculation shall be made f!om the time $hen ,onnect
message is !ecei&ed"
Table =$ CS4 :uality KPI
KPI PreLaunc% Launc% Post Launc%
CS4 :uality ,'L- >9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
1= of 34
KPI PreLaunc% Launc% Post Launc%
CS4 :uality ,UL- >9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
3.1.6 ,S< ,ell ,apacit/
#1uation =$ CS4 Cell Ca*acity ,Counter 2ormula-
ll A&,R30erCa rR3 A&,0ower0e
c0ower Cell+ra##i
acit CSVCellCap
'
74
6
74
6
; < 12@
; < 12@ ' # " . 6 6 $
i
i
i 0owerS# pmDpchCode
i 0owerS# pmDpchCode i
rR3 A&,0ower0e
erhead %ando&er'& So#tSo#ter ll A&,R30erCa
Note the abo&e is an app!oximation as SoftDSofte! Eando&e! O&e!head includes both ,S and PS
connections"
Measurement Condition$
,S< ,ell ,apacit/ shall be calculated based on a&e!age 79 po$e! allocated to A51 12"2 10 fo! this KP"
The abo&e fo!mula is fo! the pu!pose of calculating ,ell ,apacit/ not a guideline fo! 1* PlanningD7esign
pu!poses"
Table >$ Cell Ca*acity 'efinition
Key Performance Indicator Term 'efinition
CSV CellCapacity A&e!age numbe! of <oice ,alls 'A51 12"2) that can be
suppo!ted b/ cell
CellTra!!ic%o$er Net 79 Po$e! a&ailable in a cell to ca!!/ use! t!affic and
is e.ual to total cell ca!!ie! 1* po$e! 'at s/stem
!efe!ence point) minus ,ommonDsignaling channel
po$e! as pe! 1* Planning 2uidelineD9in( 0udget
AvgRL PerCall A&e!age numbe! of 1adio 9in( used to suppo!t a <oice
,all 'A51 12"2)
A&g%o$er%erR' A&e!age 1* Po$e! used fo! a 1adio 9in( to suppo!t
<oice ,all 'A51 12"2)
#1uation >$ Cell Ca*acity ,'rive Test 2ormula-
ll A&,R30erCa rR3 A&,0ower0e
c0ower Cell+ra##i
acit CSVCellCap
'
' 166
Table 16$ Cell Ca*acity KPI
13 of 34
PreLaunc% Launc% PostLaunc% Units
? 86 ,*rovided it is
ac%ieved in +2
desi!n-
? 86 ,*rovided it is
ac%ieved in +2
desi!n-
? Measure and
re*ort
@ of 0M+1.(. U#As
Measurement Condition$
,S< ,ell ,apacit/ shall be calculated based on a&e!age 79 po$e! allocated to A51 12"2 10 fo! this KP"
The $hole of ,luste!D5a!(et d!i&e data shall be used to calculate this KP"
3.1.7 ,S< SoftDSofte! Eando&e! O&e!head
SoftDSofte! Eando&e! O&e!head KP p!o&ides an indication of ho$ man/ ,ells o! Secto!s $e!e in the
acti&e set du!ing the call on an a&e!age basis"
#1uation 16$ SoftBSofter Candover "ver%ead ,Counter 2ormula-
6
AS
6
AS
AS Duration
AS Duration AS
erhead %ando&er'& So#tSo#ter
1
1
# $
# $ '
+A/(S%(# (04R,34R,I .-S5-U%3W2 +A/(S%( (03R,34R,I .-S5-U%3W2 +A/(S%( (03R,33R,I .-S5-U%3W2
+A/(S%( (02R,34R,I .-S5-U%3W2 +A/(S%( (02R,33R,I .-S5-U%3W2 +A/(S%( (02R,32R,I .-S5-U%3W2
+A/(S%( (01R,33R,I .-S5-U%3W2 +A/(S%( (01R,32R,I .-S5-U%3W2 I+A/(S%( 2(01R,31R, $.-S5-U%3W
+A/(S%(## (04R,34R,I .-S5-U%3W2 +A/(S%( (03R,34R,I .-S5-U%3W2 I+A/(S%( 2(02R,34R, $.-S5-U%3W ' 4
+A/(S%(# (03R,33R,I .-S5-U%3W2 +A/(S%( (02R,33R,I .-S5-U%3W2 I+A/(S%( 2(01R,33R, $.-S5-U%3W ' 3
+A/(S%(# (02R,32R,I .-S5-U%3W2 I+A/(S%( 2(01R,32R, $.-S5-U%3W ' 2 I+A/(S%( 2(01R,31R, $.-S5-U%3W
+ + +
+ + +
+ + +
+ + +
+ + +
+ +
erhead %ando&er'& So#tSo#ter
The counte!s fo! this KP measu!es not onl/ ,S< SoftDSofte! Eando&e! O&e!head fo! all ,S
connections but also fo! PS connections"
Measurement Condition$
The counte!s ha&e a sampling !ate of 1 minute and the counte!s should be agg!egated o&e! a sufficientl/
long pe!iod fo! statistical &alidit/"
Table 11$ SoftBSofter Candover "ver%ead definition
Key Performance Indicator Term 'efinition
( 5aximum Acti&e Set si6e as defined in 1N,
AS Acti&e Set si6e
#uration(AS) 7u!ation of the call in Acti&e Set si6e of AS 'ASI1 to 5)
#1uation 11$ SoftBSofter Candover "ver%ead ,'rive Test 2ormula-
1@ of 34
6
AS
6
AS
AS Duration
AS Duration AS
%ando&er So#tSo#ter
1
1
# $
# $ '
Table 1.$ SoftBSofter Candover "ver%ead KPI
PreLaunc% Launc% PostLaunc%
5 1(; 5 1(; 5 1(<
3.1.8 ,S< nte!:1adio Access Technolog/ Eando&e! *ailu!e
nte!:1adio Access Technolog/ '1AT) Ea!d Eando&e! *ailu!e !ate f!om U5TS and 2S5 S/stem fo!
&oice calls"
#1uation 1.$ CS4 I+0T 2ailure +ate ,Counter 2ormula-
mand om4tranCom %ando&erFr
lure om4tranFai %ando&erFr
ailureRate 9%ando&erF 9 CSV
&
&
' 166 2 3
2i!ure /$ I+0T C" Call 2low D CS4 Call
1F of 34
pmNoSuccessOut!atEoSpeech'2sm1elation): the t!igge! is $hen U 1E9EASE ,O55AN7 is
!ecei&ed $ith cause ;No!mal !elease# o! ;Successful !elocation# and based on the ,S 1A0 state"
pmNoAttOut!atEoSpeech'2sm1elation): this counte! is inc!eased $hen 1N, sends EAN7O<E1
*1O5 UT1AN ,O55AN7"
1
]
1
(24+# /0$G3-R%,* I)*(H4S.%% .-N4A((O5(
R%,*(24+# S.%%/0$G3- 3O5(I)*(H4 .-N4S5//%3
1 ' 166 2 3 ailureRate 9%ando&erF 9 CSV
The abo&e fo!mula captu!es speech 12"2( and A51 na!!o$ band"
Measurement Condition$
n o!de! to &e!if/ ,S< 1AT EO pe!fo!mance% some p!e!e.uisites ha&e to be fulfilled such as: definition of
1AT st!ateg/% setting up se!&ices p!io!ities" 0oth =2 and 22 Net$o!(s shall ha&e 1AT neighbo!s defined"
The 2S5 Net$o!( shall ha&e a&ailable !esou!ces $ithout sho$ing congestion" 5utuall/ ag!eed test UE
'$ith the latest a&ailable Soft$a!e% *i!m$a!e and E.uipment) shall be used fo! the 1AT KP &e!ification"
1G of 34
The 22 and =2 Net$o!(s shall be p!ope!l/ configu!ed in acco!dance $ith Pu!chase!#s Net$o!( design
including the definition of the !outing tables th!ough the ,o!e Net$o!(" PU1,EASE1 shall info!m Selle!
about maJo! changes in the configu!ation of the 2S5 Net$o!( 'f!e.uenc/ !e:plan% ,ell pa!amete!
changes% etc) that $ill deg!ade the =2 1AT pe!fo!mance. Selle! ma/ !e&ie$ Pu!chase!#s 2S5 Net$o!(
changesDplanned acti&ities befo!e% du!ing o! afte! 1AT KP &e!ification d!i&e"
,S< 1AT Ea!d Eando&e! *ailu!e !ate shall be measu!ed b/ a specific d!i&e pe! 5a!(et Unit" The specific
d!i&e shall be a!ound U5TS and 2S5 se!&ice bounda!/" ,S< 1AT EEO failu!e KP does not include
EEO P!epa!ation failu!e" The EEO P!epa!ation failu!e accounts fo! configu!ation mismatch and
a&ailabilit/ of !esou!ces in the 2S5 S/stem"
Table 1/$ CS4 I+0T Term 'efinition
Key Performance Indicator Term 'efinition
CSV)*+*,an-o&erFailureRate Ea!d Eando&e! failu!e !ate $hen a <oice ,all
fail to hando&e! f!om U5TS net$o!( to 2S5
net$o!(
#,an-o&erFromTRAN !ailure The numbe! of Eando&e! f!om UT1AN *ailu!e
messages sent f!om UE to 1N,
#,an-o&erFromtranComman- The numbe! of Eando&e! f!om UT1AN
command sent b/ 1N, to UE
#1uation 1/$ CS4 I+0T 2ailure +ate ,'rive Test 2ormula-
1
1
1
]
1
Calls CS
Calls CS
%ando&er
%ando&er
9%ando&er 9 CSV
8
8
C4--*+A UTRAN F)4-
F*2,5)% UTRAN F)4-
' 166 R*(% F*2,5)% 2 3
T!igge! fo! Eando&e! f!om UT1AN ,ommand is $hen the ,ommand is sent to the UE"
T!igge! fo! Eando&e! f!om UT1AN *ailu!e is $hen it is !ecei&ed f!om the UE"
Measurement Condition$
,S< 1AT EEO failu!e KP does not include EEO P!epa!ation failu!e" Specific d!i&e !oute shall be
identified at the U5TS 1* Se!&ice A!ea bounda!/ to &e!if/ this KP"
Table 18$ CS4 I+0T 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
NB0 5 9(6 7 5 9(67
/(1(> ,S< ,all Setup Time
<oice call set up time indicates Net$o!( !esponse time to a use! !e.uest fo! a &oice
se!&ice" This KP is applicable onl/ fo! d!i&e test"
#1uation 18$ CS4 Call Setu* Time ,'rive Test 2ormula-
Voice Call setup time . CC/Alerting((0C) 1 RRC Connection Request((0C)
Measurement Condition$
*o! mobile to mobile call% calling UE shall be mobile and called UE shall be stationa!/"
Table 19$ CS4 Call Setu* time KPI
18 of 34
KPI PreLaunc% Launc% Post Launc%
4oice Call Setu* time
,Mobile to PSTN-
>9
t%
*ercentile 5 ;
seconds
>9
t%
*ercentile 5 ;
seconds
>9
t%
*ercentile
5 ; seconds
4oice Call Setu* time
,Mobile to Mobile-
>9
t%
*ercentile 5 >
seconds
>9
t%
*ercentile 5 >
seconds
>9
t%
*ercentile
5 > seconds
Selle! ag!ees to the B@
th
pe!centile p!o&ided the impact of non UT1AN E.uipment is $ithin the indust!/
t/pical &alue !ange"
/(1(16 ,S7 Access *ailu!e
Access failu!e is the p!oduct of the 11, ,onnection *ailu!e% NAS setup failu!e and the 1A0
Establishment *ailu!e" 11, ,onnection Success is counted $hen the 1N, !ecei&es a 11, Setup
,omplete f!om the UE" NAS Setup is conside!ed successful $hen the signaling messages in the
call flo$ du!ing call setup flo$ is successfull/ completed b/ !ele&ant Net$o!( elements" A 1A0 is
conside!ed successfull/ established $hen the 1A0 Assignment 1esponse is sent b/ 1N, to the
,N"
#1uation 19$ CS' 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
# $ R% &
# $ R% &
'
&
&
'
&
&
1
CSD 7uest Assi,nment RA8
CSD sponse ent RA8Assi,nm
SR8Attempt
SR8Success
Attempt Connection RRC
Success Connection RRC
The follo$ing fo!mula includes both ,on&entional ,S F3DF3 (bps and St!eaming ,S @G"FD@G"F (bps:
144H
1
1
1
1
1
]
1
,
_
+
+
,
_
Calls CSD
Calls CSD
7uest Connection RRC
Connect Alertin, CC
ate Failure R CSD Access
8
8
R%
9 8
1 ' 166
Measurement Condition$
n case the!e a!e se&e!al consecuti&e 11, ,onnection 1e.uests onl/ the fi!st 11, connection !e.uest
$ill be ta(en into account fo! the KP calculation"
Table 1<$ CS' 0ccess 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
5 /(67 5 .(6 7 5 .(6 7
/(1(11 ,S7 7!op
#1uation 1<$ CS' 'ro* ,Counter 2ormula-
144H
1
]
1
,
_
# $ R% & # $ R% &
# $ R% &
1
CSD lease l RA8Abnorma CSD lease RA85ormal
CSD lease 5ormal RA8
The follo$ing fo!mula includes both ,on&entional ,S F3DF3 (bps and St!eaming ,S @G"FD@G"F (bps"
144H
1
1
1
1
1
]
1
,
_
+ +
+
+
Calls CSD
Calls CSD
Success CallsSetup
CallsDrop
DropRate CSD
8
8
' 166 8
Table 1>$ CS' 'ro* +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(9 7 5 .(9 7 5 /(6 7 ,Usin! Counter met%od-
5 .(9 7 ,Usin! 'rive Test met%od-
/(1(1. ,S7 Aualit/
This e.uation is simila! to that of ,S<K ho$e&e! it is specific fo! ,S7 1A0"
#1uation 1>$ CS' :uality ,UL-
144H
# $ &
# $ &
CSD 4plin1 in,)n tionCombin A#terSelec 8loc1s port +otal+rans
CSD 4plin1 in,)n tionCombin A#terSelec 8loc1s +ransport Fault
144H
2; ,<U%R/ (,4/=3A/U .-T)*+3.4)
2; R/ /=3A/U,<U% *+3.4)(,4 .-F*5,(:T)
Calls CSD
Calls CSD
ples All83ERSam
et ow83ER+ Samples8el
D3 CSDQualit
8
8
*)>
' 166
Measurement Condition$
79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e:9aunch% 9aunch and Post 9aunch)
Table .1$ CS' :uality KPI
KPI PreLaunc% Launc% Post Launc%
CS' :uality
,'L-
>9
t%
*ercentile of
sam*les 5 17 3L#+
>9
t%
*ercentile of
sam*les 517 3L#+
>9
t%
*ercentile of
sam*les 5 17 3L#+
CS' :uality
,UL-
>9
t%
*ercentile of
sam*les 5 17 3L#+
>9
t%
*ercentile of
sam*les 5 173L#+
>9
t%
*ercentile of
sam*les 5 173L#+
This KP $ill be measu!ed at 4"= ? 09E1 ope!ating point set in UT1AN fo! ,S <ideo ,all"
/(1(1/ ,S7 ,all Setup time
,i!cuit S$itched 7ata call set up time indicates Net$o!( !esponse time to a use! !e.uest fo! a &ideo
se!&ice" The test shall be initiated b/ ma(ing a &ideo call f!om one U5TS UE to anothe! U5TS UE"
22 of 34
n case of multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be ta(en into
account fo! KP calculation"
#1uation ..$ Mobile to Mobile 4ideo call ,'rive Test 2ormula-
Vi-eo Call setup time . CC/Alerting ((0C) 1 RRC Connection Request ((0C)
Table ..$ CS' Call Setu* time KPI
Parameter PreLaunc% Launc%
4ideo Call Setu* time N(0 >9
t%
*ercentile 5 > seconds
Selle! ag!ees to the B@
th
pe!centile and B seconds p!o&ided the impact of non UT1AN E.uipment is $ithin
the indust!/ t/pical &alue !ange"
Packet Switc%ed Level1 Key Performance Indicators
1BB 79 1A0 allo$ed: =83 (bps%128 (bps% and F3 (bps% onl/
1BB U9 1A0 allo$ed: =83 (bps% F3 (bps onl/
ES7PA 79 ES:7S,E allo$ed: UE ,at 12 '1844 (bps)
ESUPA U9 allo$ed: UE ,at = '1"3@4 5bps)
/(1(18 Pac(et S$itched ,all Setup
*igu!e 3 is a flo$ diag!am fo! a PS call" f a p!oblem occu!s bet$een 11, ,onnection 1e.uest
'step 1) and the 1A0 Assignment 1esponse 'step 2G)% the !esult is conside!ed Access *ailu!e" An/
1A0 abno!mal !elease afte! the 1A0 Assignment 1esponse is conside!ed a call 7!op"
2= of 34
2i!ure 8$ Packet Switc%ed Setu* 2low 'ia!ram
/(1(19 PS7 Access *ailu!e
The aim is to measu!e Pac(et S$itch 7ata access failu!e f!om a use! pe!specti&e"
#1uation ./$ PS' 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
# $ R% &
# $ R% &
'
&
&
'
R% &
&
1
0SD 7uest ent RA8Assi,nm
0SD sponse ent RA8Assi,nm
SR8Attempt
SR8Success
7uest Connection RRC
Complete Connection RRC
The follo$ing fo!mula includes Pac(et nte!acti&e and Pac(et 0ac(g!ound" Please !efe! to Section F
of the ,P document Use! 7esc!iption ,onnection Eandling 3D1@@=:ES7 141 42D@ Uen"
23 of 34
144H
1
]
1
,
_
Calls 0SD
Calls 0SD
7uest Connection RRC
0D0
ate Failure R 0SD Access
8
8
R%
A//%.( C4+(%?( A/(2B*(%
1 ' 166
Measurement Condition$
Access *ailu!e 1ate shall be measu!ed b/ data session acti&ation 'PS) follo$ed b/ do$nload" n case of
multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be conside!ed fo! KP calculation"
Table .8$ PS' 0ccess 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(6 7 5 .(6 7 5 .(6 7
3.1.16 PS7 7!op
Pac(et session is conside!ed as d!opped $hen associated 1A0 has been !eleased abno!mall/ b/
eithe! UT1AN o! ,N" An/ d!op afte! 1ANAP: 1A0 Assignment 1esponse is conside!ed as PS d!op
call"
#1uation .9$ PS' 'ro* +ate ,Counter 2ormula-
144H
# $ &
# $ &
0SD mplete RA8SetupCo
0SD RA8Drop
144H
1
]
1
,
_
#tpSession
#tpSession
uccess CallSetupS
dSuccess #tpDownloa
pRate 0SDCallDro 1 ' 166
Measurement Condition$
PS7 d!op 1ate shall be measu!ed afte! sta!t of ftp do$nload " PS7 call is conside!ed as d!opped
$hen ftp session is manuall/Dabno!mall/ disconnected $ithout completing file t!ansfe! due to an/
!eason"
2F of 34
Table .;$ $ PS' 'ro* +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(9 7 5 .(67 5 .(6 7
/(1(1< PS7 9atenc/
The follo$ing is ext!acted f!om =2PP Specification 2="14G% Section F"3"="1 fo! !efe!ence:
Transfer delay ,ms-
'efinition: ndicates maximum dela/ fo! B@
th
pe!centile of the dist!ibution of dela/ fo! all deli&e!ed
S7Us du!ing the lifetime of a bea!e! se!&ice% $he!e dela/ fo! an S7U is defined as the time f!om a
!e.uest to t!ansfe! an S7U at one SAP to its deli&e!/ at the othe! SAP"
N"T# /$ T!ansfe! dela/ of an a!bit!a!/ S7U is not meaningful fo! a bu!st/ sou!ce% since the last
S7Us of a bu!st ma/ ha&e long dela/ due to .ueuing% $he!eas the meaningful !esponse dela/
pe!cei&ed b/ the use! is the dela/ of the fi!st S7U of the bu!st"
Table .<$ PS' Latency Term 'efinition
Key Performance Indicator Term 'efinition
%S# 'atency
1ound t!ip time fo! a =2 0/tes ping fo! an/
1BB PS 1A0
Measurement Condition$
9atenc/ $ill be measu!ed $ith the destination se!&e! fo! ping connected di!ectl/ to the 22SN 'i"e"
the se!&e! on the same nt!anet domain as 22SN)" 1TT $ill be measu!ed in stationa!/ position"
This test $ill be done $ith a single UE $ith 1BB 1A0 PS call $ith Ping application"
Table .=$ PS' Latency KPI
Latency at Launc% +03
>9
t%
*ercentile 5 .66 ms +>> +03 ,;8 Kb*s or 1.= Kb*s or /=8 Kb*s-
Selle! ag!ees to the B@
th
pe!centile and the 244ms p!o&ided the impact of non UT1AN E.uipment is $ithin
the indust!/ t/pical &alue !ange"
/(1(1= PS7 Th!oughput
Total numbe! of 19, bloc(s sent o&e! the obse!&ation $indo$ including !e:t!ansmission pe!
t!anspo!t t/pe"
#1uation .<$ PS' 0vera!e T%rou!%*ut ,Counter 2ormula-
Call 0SD
Call 0SD
Duration SD4 R3C A6
1b Data SD4 R3C A6
hput 4ser+hrou,
8
8
8 8 8
# $ 8 8 8
The abo&e fo!mula is applicable fo! both 7o$nlin( and Uplin(
# $
# $
4tranCell r0ac1et+hp ctDlRlc4se pmSamplesA
4tranCell 1et+hp Rlc4ser0ac pmSumActDl
u,hput Dl4ser+hro
# $U()*+C%,, )P*/=%(T0. /(U,R,/U3% .-S*-.,%3A
*+C%,,# =%(T0.$U() R,/U3%)P*/ .-S5-A/(U,
u,hput 4l4ser+hro
2G of 34
Measurement Condition$
This met!ic shall be measu!ed onl/ fo! Pac(et S$itch T!affic ,lass 'nte!acti&e and 0ac(g!ound)"
KP 5easu!ement shall be based on 19, 'S7U) la/e! th!oughput $ith fi&e pe!cent '@?) ta!get fo!
79DU9 09E1 fo! 1BB 1A0"
Table .>$ PS' 0vera!e T%rou!%*ut Term 'efinition
Key Performance Indicator Term 'efinition
A(/R'C/S#/#ata(kb) Total A5 19, S7Us '(b) t!ansfe!!ed excluding !e:
t!ansmission in the do$nlin( o! uplin(
#lserT"roug"put 7o$nlin( A&e!age Pac(et data th!oughput '(bps)
A(/R'C/S#/#uration The total 19, S7U t!ansmission du!ation in seconds" *o!
79DU9% this excludes the pe!iod $hen the 79DU9
t!ansmission buffe! fo! the 19, entit/ is empt/
#1uation .=$ PS' 0vera!e T%rou!%*ut ,'rive Test 2ormula-
Call 0SD
Call 0SD
ation SessionDur
1b ans#erred 4serData+r
1bps u,hput 0SDA&,+hro
8
8
$3%/#
# $
# $
*o!mula is &alid fo! uplin( and do$nlin("
Measurement Condition$
KP 5easu!ement shall be fo! application la/e! th!oughput $ith fi&e:pe!cent '@?) ta!get 79DU9
09E1 ope!ating point fo! 1BB 1A0" Th!oughput shall be calculated using data f!om the enti!e
,luste!D 5a!(et d!i&e test fo! 5ilestone 1 and 5ilestone 2"
The do$nloadDupload file shall be comp!essed t/pe"
Table /6$ PS' 0vera!e T%rou!%*ut 'efinition
Key Performance Indicator Term 'efinition
ser#ataTrans!erre-(kb) *TP do$nload in (ilo:bit du!ing one session"
Session#uration(sec) Time du!ation 'seconds) to do$nloadDupload a file"
%S#/T"roug"put(kbps) Pac(et data th!oughput in (bps using 1BB 1A0
measu!ed at application la/e!"
Table /1$ PS' 0vera!e 'L T%rou!%*ut KPI
KPI PreLaunc% Launc% Post Launc%
0vera!e 'L t%rou!%*ut
,Unloaded- kb*s
? .86 ? .86 ? 196 ,Counter-
? .86 ,'rive Test-
0vera!e 'L T%rou!%*ut
,Loaded- kb*s
? .16 ? .16 ? 196 ,Counter-
? .16 ,'rive Test-
Table /.$ PS' 0vera!e UL T%rou!%*ut KPI
28 of 34
KPI PreLaunc% Launc% Post Launc%
0vera!e UL t%rou!%*ut
,Unloaded- kb*s
? .66 ? .66 ? 196 ,Counter-
? .66 ,'rive Test-
0vera!e UL T%rou!%*ut
,Loaded- kb*s
? 1=6 ? 1=6 ? 196 ,Counter-
? 1=6 ,'rive Test-
Measurement Condition$
KP 5easu!ement shall be fo! application la/e! th!oughput $ith fi&e:pe!cent '@?) 09E1 ope!ating
point fo! both U9 and 79" Th!oughput shall be calculated using data f!om the enti!e ,luste!D 5a!(et
d!i&e test fo! 5ilestone 1 and 5ilestone 2 using all a&ailable 1BB 1adio 0ea!e!"
Table //$ PS' 0vera!e T%rou!%*ut 'efinition
Key Performance Indicator Term 'efinition
ser#ataTrans!erre-(kb) Total ftp si6e do$nload in (ilo:bit in one session
Session#uration(sec) Total time 'seconds) du!ation to do$nload single
fileSession7u!ation'sec) I 'time stamp of Session End o!
Session E!!o! - time stamp of Session Sta!t)
%S#A&gT"roug"put Pac(et S$itched 7ata a&e!age th!oughput using 1BB 1A0
measu!ed at application la/e!
/(1(1> PS7 ,all Setup Time
PS7 call setup time indicates Net$o!( !esponse time to a use! !e.uest fo! a pac(et data se!&ice" n
case of multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be conside!ed fo!
KP calculation"
#1uation .>$ PS' Call Setu* Time ,'rive Test 2ormula-
%S Call setup time . %#% Conte3t Acti&ation accept ((0C) 4 RRC Connection Request ((0C)
Measurement Condition$
The UE is al!ead/ attached to the UT1AN net$o!("
Table /8$ PS' Call Setu* time KPI
KPI PreLaunc% 0t Launc% Post Launc%
PS' Session
0ctivation time
N(0 >9
t%
*ercentile
sessions 5 9
seconds
N(0
Selle! ag!ees to the B@
th
pe!centile and the @ seconds p!o&ided the impact of non:UT1AN E.uipment is
$ithin the indust!/ t/pical &alue !ange"
3.1.20 PS7 nte!:1adio Access Technolog/ Eando&e! *ailu!e
nte!:1adio Access Technolog/ '1AT) is a ha!d hando&e! bet$een U5TS and 2S5"
*o! Pac(et S$itched hando&e!% the 1N, sends a ,ell ,hange O!de! f!om UT1AN command to the
UE" A successful hando&e! can be monito!ed b/ the 1N, u 1elease message f!om the ,N"
#1uation /6$ PS' I+0T 2ailure +ate ,counter formula-
d +RA5Comman 'rderFrom4 CellChan,e
e +RA5Failur 'rderFrom4 CellChan,e
te rFailureRa 90S%ando&e 9
&
&
' 166 2 3
2B of 34
pmNoOut!at,c1etu!nOld,h is inc!eased $hen the ,E99 ,EAN2E O17E1 *1O5 UT1AN
*A9U1E '11,) message is !ecei&ed f!om the UE"
pmNoOut!at,cAtt is inc!eased $hen the ,E99 ,EAN2E O17E1 *1O5 UT1AN '11,) message
has been sent to the UE"
R%,*(24+# (C/A(($G3- .-N4O5(I)*
,*(24+# ,AC0$G3-R% (C/R%(5)+O .-N4O5(I)*
' 166 2 3 te rFailureRa 90S%ando&e 9
Measurement Condition$
PS7 1AT EEO failu!e KP does not include EEO P!epa!ation failu!e"
n o!de! to &e!if/ PS7 1AT EO pe!fo!mance% some p!e!e.uisites ha&e to be fulfilled such as: definition of
1AT st!ateg/% setting up se!&ices p!io!ities" 0oth =2 and 22 Net$o!(s shall ha&e 1AT neighbo!s defined"
The 2S5 Net$o!( shall ha&e a&ailable !esou!ces $ithout sho$ing congestion" 5utuall/ ag!eed test UE
'$ith the latest a&ailable Soft$a!e% *i!m$a!e and E.uipment) shall be used fo! the 1AT KP &e!ification"
The 22 and =2 Net$o!(s shall be p!ope!l/ configu!ed in acco!dance $ith Pu!chase!#s Net$o!( design
including the definition of the !outing tables th!ough the ,o!e Net$o!(" PU1,EASE1 shall info!m Selle!
about maJo! changes in the configu!ation of the 2S5 Net$o!( 'f!e.uenc/ !e:plan% ,ell pa!amete!
changes% etc) that $ill deg!ade the =2 1AT pe!fo!mance. Selle! ma/ !e&ie$ Pu!chase!#s 2S5 Net$o!(
changesDplanned acti&ities befo!e% du!ing o! afte! 1AT KP &e!ification d!i&e"
Table /9$ PS' I+0T 2ailure Term 'efinition
Key Performance Indicator Term 'efinition
)*+*%S,an-o&erFailureRate Ea!d Eando&e! failu!e !ate $hen a PS 7ata call
'1BB) fail to hando&e! f!om U5TS net$o!( to
2S5 net$o!(
#CellC"ange0r-erFromTRAN Failure(%S) 11,: The numbe! of ,ell ,hange O!de! f!om
UT1AN *ailu!e messages f!om UE to 1N,
#CellC"ange0r-erFromTRAN Comman-(%S) 11,: The numbe! of ,ell ,hange O!de!
5essages f!om 1N, to UE
#1uation /1$ PS' I+0T 2ailure +ate ,'rive Test 2ormula-
Call 0SD
Call 0SD
R5C d +RA5Comman 'rderFrom4 CellChan,e
4E e +RA5Failur 'rderFrom4 CellChan,e
90S%%' 9
8
8
8
8
' 166 % F*2,5)%R*( 2 3
11,,ell,hangeO!de!*!omUT1AN*ailu!eLUE message is sent b/ UE"
11,,ell,hangeO!de!*!omUT1AN,ommandL1N, message is sent b/ 1N,"
Measurement Condition$
PS7 1AT EEO failu!e KP does not include EEO P!epa!ation failu!e" Specific d!i&e !oute shall be
identified at the U5TS 1* Se!&ice A!ea bounda!/ to &e!if/ this KP"
Table /;$ PS' I+0T 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
NB0 5 9(6 7 5 9(6 7
3.1.21 PS7 1AT nte!!uption time
=4 of 34
This KP is an indicato! of inte!!uption time fo! the pac(et s$itch data du!ing nte!:1adio Access
Technolog/ ha!d hando&e!"
#1uation /.$ PS' I+0T Interru*tion time ,'rive Test 2ormula-
%S#/2RAT2nterruptionTime . (TimeRAp-ateComplete/5 1 TimeCellC"ange0r-er/RNC)
#1uation //$ PS' I+0T User 'ata Interru*tion time ,'rive Test 2ormula-
%S#/2RATser#ata2nterruptionTime . (TimeFirst%acket#ataRecei&e-2n+* 1
Time'ast%acket#ataRecei&e-2n)*)
Measurement Condition$
This KP is applicable fo! dedicated d!i&e test !oute on =2:22 1* se!&ice bo!de! a!ea du!ing 5a!(et
Acceptance"
The inte!!uption time shall be measu!ed du!ing =2 to 22 PS7 EEO"
Table /<$ PS' I+0T Interru*tion 'efinition
Key Performance Indicator Term 'efinition
%S#/2RAT2nterruptionTime 7u!ation of inte!!uption to Pac(et data se!&ice du!ing
Ea!d Eando&e!
TimeRAp-ateComplete/5 The timestamp in d!i&e test Tool $hen UE sends
1outing A!ea Update complete message in the
uplin( to the 22 S2SN
TimeCellC"ange0r-er/RNC The timestamp in d!i&e test Tool $hen UE !ecei&es
,ell ,hange O!de! message f!om 1N, in the
do$nlin(
Table /=$ PS' I+0T User 'ata Interru*tion 'efinition
Key Performance Indicator Term 'efinition
%S#/2RATser#ata2nterruptionTime 7u!ation in seconds to inte!!uption of Pac(et data
se!&ice f!om Use! pe!specti&e du!ing 1AT Ea!d
Eando&e! f!om =2 to 22
TimeFirstPacketDataReceivedIn2G Timestamp in d!i&e test Tool $hen fi!st data is
1ecei&ed in 22 S/stem afte! successful 1AT
Eando&e!"
TimeLastPacketDataReceivedIn3G Timestamp in d!i&e test Tool $hen UE !ecei&es last
Pac(et 7ata in =2 S/stem befo!e 1AT Eando&e!"
Table />$ PS' I+0T Interru*tion time KPI
KPI Term 0t Launc%
PS' I+0T Interru*tion time >9t% *ercentile 5 1.
seconds
PS' I+0T User 'ata
Interru*tion time
Measure and +e*ort
Selle! ag!ees to the B@
th
pe!centile and the 12 seconds p!o&ided the impact of non UT1AN E.uipment is
$ithin the indust!/ t/pical &alue !ange"
/(1(.. ES7PA Access *ailu!e
=1 of 34
This test shall be done $ith a single UE doing ES7PA call in the ,ell unde! test $ith =83DF3 Kbps
associated 7,E on the uplin("
#1uation /8$ CS'P0 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
# $ R% &
# $ &
'
&
&
'
R% &
&
1
DSC% %S 7uest ent RA8Assi,nm
DSC% %S Success ent RA8Assi,nm
SR8Attempt
SR8Success
7uest Connection RRC
Complete Connection RRC
144H
1
1
1
1
]
1
,
_
Session %SD0A
Session %SD0A
7uest Connection RRC
0D0
ate ssFailureR %SD0A Acce
8
8
R%
A//%.( C4+(%?( A/(2B*(%
1 ' 166
Measurement Condition$
n case of multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be conside!ed fo!
KP calculation"
Access *ailu!e 1ate shall be measu!ed b/ data session acti&ation 'ES7PA) follo$ed b/ do$nload"
Table 81$ CS'P0 0ccess 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(6 7 5 .(6 7 5 .(6 7
/(1(./ ES7PA 7!op
ES7PA session is conside!ed as d!opped $hen associated ES:7S,E has been !eleased
abno!mall/ b/ eithe! UT1AN o! ,N" This test $ill be done $ith a single UE pe!fo!ming ES7PA call
in the ,ell unde! test $ith =83DF3 Kbps associated 7,E on the uplin( and ES:7S,E in the 79 $ith
do$ng!adeDupg!ade toDf!om 1BB 1A0"
#1uation /;$ CS'P0 'ro* +ate ,Counter 2ormula-
144H
33 *(24+S5//% DSCH8A,,4/ - HS &
,5)% 3%D5%T4F*2 DSCH8R%,%* - HS &
144H
1
1
1
1
]
1
+ +
+
#
%H3 I+(%)*/(2B /%33P*/=%( (*1,230S5/ $.-N4R*1E3
3 R1R%,%*3%H .-N4S:3(%-
ul chSuccessE pm4l4pswit Eul nteracti&e ess0ac1et) ablishSucc pm5oRabEst
s chSuccess% pmDl4pswit
pmNoSstemR!Release"s: Numbe! of successful s/stem !eleases of pac(et 1A0s mapped on
ES:7S,E in the Se!&ing ES:7S,E cell" The counte! is stepped fo! the Se!&ing ES:7S,E cell at
1A0D10 combination t!ansition f!om PS nte!acti&e F3DES : ES:7S,E to S10:7,E o! to dle mode
due to the same !easons as fo! stepping the existing counte! pmNoS/stem1ab1eleasePac(et"
pmNoS/stem1ab1eleasePac(et is onl/ inc!eased due to a 1ANAPu 1elease ,ommand o! 1A0
Assignment 1e.uest message $ith M!elease causeM I an/thing except NNo!mal 1eleaseN%
NSuccessful 1elocationN% N1esou!ce Optimisation 1elocationN% NUse! nacti&it/N o! N!elease:due:to:UE:
gene!ated: signalling:connection:!eleaseN" This counte! is inc!emented fo! the best cell in the Acti&e
Set in the S1N, and $hen !eleasing a ES 1A0% this counte! is stepped fo! the Se!&ing ES:7,E
cell"
pmNoRa!#sta!lis$S%ccessPacketInteractive"s: The numbe! of successful 1A0 establishments
fo! PS nte!acti&e 1A0 mapped on ES:7S,E" The counte! is stepped fo! the selected Se!&ing ES:
7S,E cell at 1A0 establishment afte! the successfull/ t!ansition S10:7,E to PS nte!acti&e F3DES
: ES:7S,E"
pmDl&ps'itc$S%ccess"s( Numbe! of successful 79 ups$itches to an/ ES state" The counte! is
stepped fo! successful 79 ups$itch to a 10 combination containing ES" The counte! is inc!emented
in all cells of the acti&e set"
== of 34
pmNoRa!#sta!lis$S%ccessPacketInteractive#%l( The numbe! of successful 1A0
establishments fo! PS nte!acti&e 1A0 mapped on E:7,EDES7PA" ,ounte! is stepped fo! the
Se!&ing E:7,E cell at successful 1A0D10 combination t!ansition to PS nte!acti&e E:7,EDES : ES:
7S,E due to 1A0 establishment" The counte! is t!igge!ed afte! sending of 1A0 Assignment
1esponse 'successful)"
pm&l&ps'itc$S%ccess#%l( Numbe! of successful up:s$itches% t!igge!ed b/ U9 use! acti&it/% to a ta!get
10 combination E:7,EDES7PA" Stepped fo! the ta!get cell" ,ounte! in ta!get cell is stepped at a
successful ups$itch t!igge!ed b/ U9 use! acti&it/"
Measurement Condition$
The Selle! counte! based met!ics fo!mula shall be updated as ne$ functionalit/ is int!oduced in the
S/stem
Table 8.$ CS'P0 'ro* Term 'efinition
Key Performance Indicator Term 'efinition
,S4#SC,/Release#ueToFailure Numbe! of ES:7S,E allocation !eleases due to !adio
lin( and othe! failu!es
,S4#SC,/AllocationSuccess Numbe! of allocations $hen the 1N, has !ecei&ed
11,: 1adio 0ea!e! 1e:,onfigu!ation ,omplete
message f!om the UE afte! successful ES:7S,E 5A,:
d flo$ setup
#1uation /;$ CS'P0 'ro* +ate ,'rive Test 2ormula-
Call %SD0A
Call %SD0A
Success Allocation DSC% %S
DropRate %SD0A
8
8
8
DSCH8D)4. - HS
' 166 8
Measurement Condition$
ES7PA 7!op 1ate shall be measu!ed b/ data session acti&ation 'ES7PA) follo$ed b/ ftp do$nload
Table 8/$ CS'P0 'ro* +ate KPI
PreLaunc% Launc% PostLaunc%
5 /(6 7 5 .(6 7 5 .(6 7
/(1(.8 ES7PA 9atenc/
Table 88$ CS'P0 Latency Term 'efinition
Key Performance Indicator Term 'efinition
,S#%A 'atency
1ound t!ip time fo! a =2 0/tes ping fo! ES7PA
N1T 1A0
Measurement Condition$
9atenc/ shall be measu!ed $ith the destination se!&e! fo! ping connected di!ectl/ to the 22SN 'i"e
the se!&e! on the same nt!anet domain as 22SN)" 1TT shall be measu!ed in a stationa!/ test" This
test shall be done $ith a single UE doing ES7PA call in the ,ell unde! test"
Table 89$ CS'P0 Latency KPI
=3 of 34
KPI Latency at Launc%
CS'P0 Latency >9
t%
*ercentile sessions 5 166 ms
Selle! ag!ees to the B@
th
pe!centile and the 144ms p!o&ided the impact of non UT1AN E.uipment is $ithin
the indust!/ t/pical &alue !ange"
3.1.2 ES7PA Th!oughput
Total numbe! of 19, bloc(s sent o&e! the obse!&ation $indo$ including !e:t!ansmission"
#1uation />$ CS'P0 T%rou!%*ut ,Counter 2ormula-
Call %SD0A
Call %SD0A
Duration 0D4 R3C A6
1b Data 0D4 R3C A6
+hrou,hput %SD0A
8
8
8 8 8
# $ 8 8 8
8
# R% $ ' 2 rames 7uiredSubF &e pm5o)nacti SubFrames pm5oActi&e
8its pmSumAc1ed
hrou,hput %SD0ACell+
+
Call %SD0A
Call %SD0A
ation SessionDur
1b ans#erred 4serData+r
+hrou,hput %SD0A
8
8
$3%/#
# $
8
Measurement Condition$
5easu!ement shall be fo! Application 9a/e! bit !ate" The ES7PA th!oughput is onl/ applicable $hen
the UE is on ES:7S,E"
Table 8<$ Stationary Ma)imum 'L CS'P0 3it +ate ,kb*s- KPI
=@ of 34
PreLaunc% Launc% PostLaunc% 1=66 kb*s
,usin! U# cate!ory 1.-
? 1/66 ? 1/66 ? 1/66
,at +LC Layer
usin! counter-
Under no load condition
? 1166 ? 1166 N(0 967 of 0vailable Power at
System +eference Point
allocated to CS'P0
Measurement Condition$
UE shall be in Stationa!/ location unde! excellent 1* condition ',P,E 1S,P C :84 d0m and
,P,E EcDNo C : 8 d0)"
The do$nload file shall be comp!essed t/pe"
5easu!ement shall be based on *TP file do$nload of minimum ten '14) 50 file to !educe the
impact of T,P slo$ sta!t"
5easu!ement shall be at application la/e! th!oughout the ES7PA Se!&ice A!ea"
Table 8=$ 0vera!e 'L T%rou!%*ut ,kb*s- KPI
PreLaunc% Launc% PostLaunc% Usin! U# cate!ory 1.
1(= Mb*s
? <66 ? <66 ? <66
,at off *eak-
Under no load condition
? ;66 ? ;66 N(0 967 of 0vailable Power at
System +eference Point
allocated to CS'P0
Measurement Condition$
UE shall be in mobile en&i!onment $ithin designed ES7PA Se!&ice A!ea" The suppo!ted 79 ES:
7S,E du!ing d!i&e test is 1844 (bps fo! UE ,atego!/ 12" The ,ell shall be loaded in such a $a/
that ES7PA is allocated fift/:pe!cent '@4?) of the a&ailable po$e! at S/stem 1efe!ence Point" The
!emaining @4 ? of a&ailable 79 po$e! at S/stem 1efe!ence Point shall include common channels
po$e!% load due to one d!i&e test UE '<oice) and the load simulated b/ O,NS speech mode" The!e
shall be one UE ma(ing sho!t <oice ,all 'A51 12"2() in the same cell as ES7PA call to monito! the
impact of ES7PA on the &oice use!" Selle! shall p!o&ide measu!ement !epo!t on sho!t &oice call fo!
Setup *ailu!e and ,all 7!op 1ate as defined in Section ="1"= and Section ="1"3 !especti&el/" The
a&e!age 79 th!oughput measu!ed du!ing the enti!e d!i&e test !oute $ithin ,luste!D5a!(et A!ea shall
be based on ES:7S,E Application 9a/e! th!oughput" 5easu!ement shall be based on d!i&e test
$ith *TP file do$nload of minimum ten '14) 50 file to !educe the impact of T,P slo$ sta!t"
ES7PA Se!&ice A!ea shall be same as PS7 F3( Se!&ice A!ea"
3.1.26 ESUPA Th!oughput
Total numbe! of 19, bloc(s sent o&e! the obse!&ation $indo$ excluding !e:t!ansmission"
#1uation />$ CSUP0 T%rou!%*ut ,Counter 2ormula-
=F of 34
Session %S40A
Session %S40A
Duration 0D4 R3C A6
1b Data 0D4 R3C A6
+hrou,hput %S40A
8
8
8 8 8
# $ 8 8 8
8
# 16 ' 16 $ l msFramesEu pm5oActi&e
l 8itsCellEu pmSumAc1ed
hrou,hput %S40ACell+
pmSumAc(ed0its,ellEul: The numbe! of 5edia Access ,ont!ol Enhanced Uplin( 'Eul) bits
!ecei&ed and ac(no$ledged b/ the 10S"
pmNoActi&e14ms*!amesEul: The numbe! of 14ms f!ames containing enhanced uplin( data
t!ansmitted b/ the UE
Table 8>$ CSUP0 T%rou!%*ut Term 'efinition
Key Performance Indicator
Term
'efinition
A(/R'C/%#/#ata(kb) Total A5 19, P7Us '(ilo:bit) t!ansfe!!ed excluding !e:
t!ansmission in the uplin(
A(/R'C/%#/#uration The total 19, P7U t!ansmission du!ation 'in seconds)"
#1uation 86$ CSUP0 T%rou!%*ut ,'rive Test 2ormula-
Session %S40A
Session %S40A
ation SessionDur
1b ans#erred 4serData+r
+hrou,hput %S40A
8
8
$3%/#
# $
8
Measurement Condition$
5easu!ement shall be at Application 9a/e! bit !ate" The upload file shall be comp!essed t/pe"
ESUPA Se!&ice A!ea shall be same as PS7 F3( Se!&ice A!ea"
UE shall be in Stationa!/ location unde! excellent 1* condition ',P,E 1S,P C :84 d0m and
,P,E EcDNo C : 8 d0)
Table 96$ CSUP0 Stationary UL 3it +ate ,kb*s- KPI
PreLaunc% Launc% PostLaunc% U# Cate!ory / ,1(89 Mb*s-
? 1166 ? 1166 Measure and
+e*ort
Stationary Peak T%rou!%*ut
,kb*s- under no load
? 966 ? 966 Measure and
+e*ort
0vera!e T%rou!%*ut ,kb*s-
under no load
3.1.27 ES7PA 7ata Session Setup Time
ES7PA 7ata Session setup time indicates Net$o!( !esponse time to a use! !e.uest fo! an ES7PA
data se!&ice"
#1uation 81$ CS'P0 session definition ,'rive Test 2ormula-
,S#%A #ata Session setup time . %#% Conte3t Acti&ation accept ((0C) 4 RRC Connection
Request ((0C)
Measurement Condition$
=G of 34
This test shall be done $ith a single UE pe!fo!ming ES7PA call in the cell unde! test" The UE is
al!ead/ attached to the UT1AN Net$o!("
Table 91$ CS'P0 'ata Session Setu* time KPI
KPI PreLaunc% Launc%
CS'P0 Session 0ctivation time N(0 >9
t%
*ercentile sessions 5
9 seconds
Selle! ag!ees to the B@
th
pe!centile and the @ seconds p!o&ided the impact of non UT1AN E.uipment is
$ithin the indust!/ t/pical &alue !ange"
System 0vailability
S/stem A&ailabilit/ is defined as the pe!centage of time the Net$o!( can handle one hund!ed pe!:cent
'144?) of the t!affic it is designed fo! as measu!ed at ,ell 9e&el"
The pu!pose of this met!ic is to calculate the total amount of time 'in pe!centage) out of the total
ope!ating time the 1N, and Node:0 a!e a&ailable to ca!!/ comme!cial t!affic" 5inimum g!anula!it/ fo!
KP pu!poses is total loss of t!affic at ,ell le&el"
Selle! is !esponsible onl/ fo! the Sub:S/stem supplied to Pu!chase!: 1N, and Node:0" This excludes
Antenna S/stems% T!anspo!t S/stems% Po$e!D0atte!/ 0ac(up% non:Selle! ,o!e Net$o!("
The loss of t!affic at ,ell 9e&el can be due to one o! mo!e !easons:
1" E.uipment failu!es
2" Soft$a!e failu!es
=" Selle! o!iginated 'accidental% misuse% !eset etc")
3" Planned e&ents autho!i6ed b/ Selle! 'Soft$a!e upg!ade% E.uipment upg!ade% Pa!amete! change
etc)
*o! A&e!age ,ell A&ailabilit/% Selle! shall be !esponsible fo! se!&ice deg!adation due to 1% 2% = 'caused
b/ Selle!#s pe!sonnel o! sub:cont!acto!s of Selle!) and 3"
*o! A&e!age ,ell Non:5aintenance A&ailabilit/% Selle! shall be !esponsible fo! se!&ice deg!adation due
to 1% 2 and = 'caused b/ Selle!#s pe!sonnel o! sub:cont!acto!s of Selle!)"
The le&el of agg!egation fo! this met!ic is Pu!chase!#s enti!e U5TS Net$o!( fo! $hich Selle! has
supplied the E.uipment and Soft$a!e '1N, and Node:0)" The ala!m agg!egation fo! this met!ics shall
be pe!fo!med on dail/ basis" S/stem A&ailabilit/ KP fo! Selle! shall be calculated on a /ea!l/ basis fo!
the pu!pose of achie&ing KP ta!get sta!ting f!om the Net$o!( comme!cial 9aunch fo! 1N, and Node:0
E.uipment" Selle! shall p!o&ide all the necessa!/ ala!m details to assist Pu!chase! in !eali6ing S/stem
A&ailabilit/ KP mat!ices fo! the sub:S/stems supplied b/ Selle! '1N, and Node:0)" Selle! shall
!ecommend to Pu!chase! $hich ala!ms to use to measu!e these KPs"
7ail/ S/stem A&ailabilit/ shall be measu!ed as follo$s:
3.1.28 A&e!age ,ell A&ailabilit/
#1uation /<$ 0vera!e Cell 0vailability formula
Using Ala!ms and S/stems notification% the follo$ing fo!mula shall appl/
1
1
1
]
1
R5C
R5C
rCount +otalSecto 6in %rs
owntime +otalCellD
' $3%/# 66 ' # $ 66 ' # $ 24
$3%/#
1 ' 166
Table 9.$ 0vera!e Cell 0vailability Term 'efinition
Key Performance Indicator Term 'efinition
=8 of 34
Key Performance Indicator Term 'efinition
TotalSectorCo%nt Total numbe! of acti&e Node:0 ,ells $ithin 1N,
AvgCellAvaila!ilit A&e!age Node:0 ,ells a&ailabilit/ to ca!!/ use! t!affic
calculated as a pe!centage of total time
Table 9/$ 0vera!e Cell 0vailability KPI
0vera!e Cell 0vailability KPI SubSystem +0N +elease
? >>(>9 ,>>(<- 7 +NC E Node3 P9
? >>(>9 ,>>(=- 7 +NC E Node3 P;
? >>(>9 ,>>(>- 7 +NCE Node3 P<
? >>(>9 ,F>>(>-7 +NCE Node3 ?P=
3.1.2! A&e!age ,ell Non:5aintenance A&ailabilit/
#1uation /=$ 0vera!e Cell NonMaintenance 0vailability 2ormula
1
1
1
]
1
R5C
R5C
rCount +otalSecto 6in %rs
time enanceDown on6a +otalCell5
' $3%/# 66 ' # $ 66 ' # $ 1@
$3%/# 2+(
1 ' 166
Table 98$ 0vera!e Cell NonMaintenance 0vailability Term 'efinition
Key Performance Indicator Term 'efinition
TotalCellNon)aintenanceDo'ntime*sec+ Total du!ation 'in seconds) of Node:0 ,ells $ithin
a 1N, not able to ca!!/ an/ t!affic du!ing no!mal
ope!ation 'excluding planned e&ents) due to 1N,
and Node:0 E.uipment !eason" The du!ation shall
be calculated $hen Ala!mDS/stem notification
clea!s minus $hen Ala!mDS/stem notification
t!igge!s"
TotalSectorCo%nt Total numbe! of acti&e Node:0 ,ells $ithin 1N,
AvgCellNon)aintenanceAvaila!ilit A&e!age Node:0 ,ells a&ailable calculated as a
pe!centage of a&ailable time at ,ell le&el
Table 99$ 0vera!e Cell NonMaintenance 0vailability KPI
0vera!e Cell NonMaintenance 0vailability KPI SubSystem +0N +elease
? >>(>>9 ,>>(<- 7 +NC E Node3 P9
? >>(>>9 ,>>(=- 7 +NC E Node3 P;
? >>(>>9 ,>>(>- 7 +NCE Node3 P<
? >>(>>9 ,F>>(>- 7 +NCE Node3 ?P=
Com*arison of UMTS and &SM Network Performance
Selle! shall collect some 22 measu!ements defined belo$ at the same time as =2 measu!ements
fo! all ,luste! Acceptance and all 5a!(et Acceptance d!i&es"
=B of 34
The 22 measu!ements collected b/ Selle! f!om a 22 te!minal in the &ehicle executing a p!e:defined
call se.uence a!e defined belo$:
a" <oice Access *ailu!e !ate
b" <oice 7!op 1ate
/. <oice Aualit/K 5OS
The 22 te!minal used shall be specified b/ Pu!chase! and shall be a comme!ciall/ a&ailable
te!minal used b/ Pu!chase!s 22 ,ustome!s" ,all se.uences used b/ the 22 te!minals shall be
identical to the call se.uences used b/ the =2 te!minals" To the extent possible% the numbe! of 22
calls made shall be the same as the numbe! of =2 calls made"
Test cases fo! 22 te!minals executed to de!i&e the abo&e stated KP must be executed at the same
time $ithin the test &ehicle as the test cases to de!i&e the same KP fo! the =2 te!minals"
t is a !e.ui!ement fo! ,luste! Acceptance and 5a!(et Acceptance that the =2 KP a!e met" f the
collected 22 KPs do not meet =2 KP ta!get then =2 !esults shall be bette! than o! e.ual to the
obtained 22 !esults% using the same call p!ofiles and call se.uences" f the measu!ed 22 KP#s
exceed the measu!ed =2 KP the Selle! shall onl/ ha&e to meet the =2 ta!get"
Im*act of UMTS on &SM Network Performance
The deplo/ment of the U5TS Net$o!( shall not deg!ade Pu!chase!#s existing 2S5 Net$o!(
pe!fo!mance" Excluding 1AT Ea!d Eando&e! *eatu!e% both U5TS and 2S5 Net$o!(s a!e
conside!ed independent of each othe!" This section add!esses an/ conce!n !elated to U5TS
E.uipment installation on 2S5 Sites and !elated faults fo! $hich Selle! has !esponsibilit/ that could
deg!ade 2S5 pe!fo!mance"
The KP shall be collected fo! the enti!e unde!l/ing 22 Site 's) !ele&ant to =2 Node:0:
5OUDd!op fo! <oice ,alls
Access failu!e !ate fo! &oice calls
7ail/ '23 hou!) <oice E!lang T!affic
Selle! shall ensu!e that int!oduction of the U5TS Net$o!( does not deg!ade Pu!chase!#s existing 2S5
Net$o!( pe!fo!mance b/ no mo!e than '14?) ten pe!cent at ,ell 9e&el% no mo!e than 'G"@?) se&en and a
half pe!cent at ,luste! 9e&el and no mo!e than '@?) fi&e pe!cent at 5a!(et 9e&el" The method of
calculation shall be as desc!ibed in the U5TS S/stems Acceptance 'Appendix U1F)"
8 UT+0N Level. Key Performance Indicators
Pu!chase! shall p!o&ide Selle! a document desc!ibing the KP 9e&el:2 counte! based !e.ui!ements"
Selle! shall p!o&ide Pu!chase! all the a&ailable counte!s do$n to the lo$est cause le&el fo! 1N, and
Node:0" Selle! shall p!o&ide '$ith a collabo!ati&e effo!t b/ Pu!chase!) a document that desc!ibes the
9e&el:2 KPs 'fo!mulas and counte!s) $ithin ten '14) $ee(s afte! !eceipt of the 9e&el 2 !e.ui!ements
f!om Pu!chase!" An/ de&iations on the abo&e mentioned time schedule shall be mutuall/ ag!eed"
*o! counte!s that a!e not li(el/ to be a&ailable at the time of comme!cial launch '5ilestone 2)% Selle!
shall mutuall/ ag!ee $ith Pu!chase! '$ithin '=) months of execution of the *ifth '@
th
) Amendment) on a
!easonable !oadmap to de&elop !e.ui!ed counte!s"
Pe!fo!mance 5anagement 5easu!ement Entit/ shall be a&ailable at ,ell% Node:0% ,luste!% 1N,% 5a!(et%
1egion and Net$o!( le&el fo! e&e!/ KP unless othe!$ise stated in 9e&el:2 KPs"
1N, 5easu!ement 2!anula!it/ shall be a minimum pe!iod of fifteen '1@) minutes unless othe!$ise stated in
the 9e&el:2 KPs"
34 of 34