Professional Documents
Culture Documents
Objectives
After this module the delegate shall be able to:-
• Understand the different elements required for an effective drive test
program
• Understand how all aspects of drive data can be used to obtain a view of
network performance
• Differentiate between genuine (RF) and non-genuine (system) failures
• Understand the KPIs that can be obtained
Drive Test Process
Cluster Data Preparation Data Analysis Trouble
Preparation and Collection • Levels of Reporting Shooting
• Define Cluster • Services to test • Failure Type • Root Cause
• Define Drive Route • KPI definitions Breakdown Analysis
• Equipment • Post Processing • Corrective Action
• Exclusions functionality • Further data
• Call Patterns • KPI Gap Analysis logging (maybe)
• OSS Alarms
• Network Stats
Land Unit
NQMP
FTP
Server
Threshold KPIs
Signalling Statistics Count Success rate
MOC Setup time 5 sec Attach Attempt 155
MOC CCR 99 % Attach Success 140 90.32%
Attach Time more than threshold 5 3.57%
RAW END USER Attach Time less than threshold 135 96.43%
Attach Failed 15 9.68%
Event Count Ratio Count Ratio Average Attach Setup Time 1.36
Call Attempts 132 122 Activate PDP Context Attempt 124
Call Setup Success Rate 108 81.8% 108 88.5% Activate PDP Context Success 124 100.00%
Activation Time more than threshold 2 1.60%
Call Setup Failure Rate 24 18.2% 14 11.5%
Activation Time less than threshold 123 98.40%
Failures due to Tool (TSF) 10 41.7% Activate PDP Context Failed 0 0.00%
Failures due to Core Problem 10 41.7% 10 71.4% Average PDP Context Activation Time 0.96
Failure ASU (Sync) Problem 2 8.3% 2 14.3% FTP Download Attempts 51
Failure due to Low Coverage Levels 2 8.3% 2 14.3% FTP Download Success 48 94.12%
FTP Download throughput more than threshold 25 52.08%
Call Setup Success and Setup Time > 5s 7 6.5% 7 6.5%
FTP Download throughput less than threshold 23 47.92%
Long Setup due to slow cell reselection 0.0% 0 0.0% Average FTP Download Throughput 107.02
Long Setup due to clash with InterRAT reselection 0.0% 0 0.0% FTP Upload Attempts 32
Long Setup due to Unknown (suspect UE) 0.0% 0 0.0% FTP Upload Success 30 93.75%
Long Setup due to Unknown 0.0% 0 0.0% FTP Upload throughput more than threshold 20 66.67%
FTP Upload throughput less than threshold 10 33.33%
Average Call Setup Time 3.66 3.66 Average FTP Upload Throughput 55.53
Call Completetion Rate 105 97.2% 105 97.2% Data Transfer Cut-off Ratio 6.02%
Call Drop Rate 3 2.8% 3 2.8% PDP Context Dropped 4 3.23%
Call Drop Poor 3G Coverage 1 33.3% 1 33.3% Deactivate PDP Context Request 121
Deactivate PDP Context Accept 121 100.00%
Call Drop on GSM due to Interference 2 66.7% 2 66.7% Deactivate PDP Context Failure 0 0.00%
Overall Call Completion Rate 105 79.5% 105 86.1% Detach Request 281
ISHO Attempt 14 14 Detach Accept 129 45.91%
ISHO Success 14 100.0% 14 100.0% Overall Data Session Completion Rate 78 62.90%
ISHO Failed 0 0.0% 0 0.0%
RAU Statistics Count Success rate
ISHO Failed cause physical channel failure 0 N/A 0 N/A
RAU Attempt 22
RAU Success 13 59.09%
KPI-08 PS PDP •Same as 10 •PS PDP activation trigger point: •Cluster_PDP_Context_Activation_SR_% = PDP 98%
context •350 occurrences •UE not PS attached Context Activation Completion / PDP Context
activation •UE sends 1st ‘RRC Connection Request’ Activation Attempts *100
•PS PDP activation completion trigger point:
•UE receives ‘RRC: Downlink Direct Transfer (SM: Activate PDP
Context Accept)’
•Successful completion if:
•UE receives ‘RRC: Downlink Direct Transfer (SM: Activate PDP
Context Accept)’
KPI-09 PS •Repeated FTP calls, 1 Mbyte file •Data Session Set-up trigger point: •Cluster_PS_DL_Throughput = Average 200 Kbps
throughput download, 1 Ue •UE receives 1st DL packet Throughput Over Data Sessions
downlink •384 kbps •Data Session Completion trigger point:
•Average throughput •UE receives last packet
•350 calls •Session output:
•Average downlink throughput
Need to Define the KPI measurement
(from Drive test)
• Call Setup Success - CSSR (voice, circuit switched data)
– Successful call setup means that “DL/UL Direct Transfer (CC: Alerting)” message is received by
UE.
• Call Setup Time (voice, circuit switched)
– Call setup delay is measured from L3 messages, starting from “RRC Connection Setup” message
to “DL Direct Transfer (CC: Alerting)” message.
• Call Drop (voice, circuit switched)
– A dropped call occurs. The call will be dropped in case RRC connection release (not normal
release) message has been send from RNC to UE.
Call Released
UE
Definition of Session Setup Time - PS
WBTS RNC
CN
UE already has an RRC connection
INITIAL DIRECT TRANSFER (Attach Request)
INITIAL UE MESSAGE (GPRS Attach)
SCCP: Connection Request
Uplink Direct Transfer (Authentication & Ciphering Response) RANAP: Authentication & Ciphering Response
Security Mode Command RANAP: Security Mode Command
Downlink Direct Transfer: Attach Accept Direct Transfer: Attach Accept Session
Set-up
Uplink Direct Transfer: Attach Complete Direct Transfer: Attach Complete Time
INITIAL DIRECT TRANSFER (Active PDP Context Request) DIRECT TRANSFER (Active PDP Context Request)
RANAP: RAB ASSIGNMENT
RRC: Radio Bearer Set-up REQUEST
RRC: Radio Bearer Set-up Complete
RANAP: RAB ASSIGNMENT
RRC: Measurement Control RESPONSE
DIRECT TRANSFER (Active PDP context Accept)
Failure Breakdown
• Non-genuine failures
– Measurement system fault (Collection
Tool or Analysis)
UE
Iub Iu
WBTS RNC Core NW
Failure Breakdown
• The KPI measurement conditions should be used to define
exclusion areas during drive test for acceptance of a cluster.
• All failures happening in those area, that do not respect the
coverage requirements should be discarded.
RSCP
Example of Call Success Criteria Ec/No
Signal Call
above OK
Signal above
Call - (B)
RSCP
Call
Call Ec/No
- 80dBm OK
NOK - 5dB threshold
threshold
- -95dBm - 12dB
Signal Signal
below below
RSCP Call Ec/No
OK
threshold -110dBm
Threshold
Call
- 20dB threshold
Call- (A) NOK Discard sample
Time
Failure Breakdown
AMR Call Setup Failures
Call Set-up Failures Breakdown - Benchmark Drive
Call Setup Failure Breakdown - Final Drive
5% 5% 0%
0% Equipment
0%
Registration Clash
0% Equipment
15%
Core Network 19% 19% Registration Clash
20%
Fail in 2G Core Network
Fail in 2G
RAN (fixed in next release) 0%
0% RAN (fixed in next release)
Site maintenance (TMUK) 0%
Site maintenance (TMUK)
0% RAN (Other)
RAN (Other)
10%
5% Missing neighbours
Missing neighbours
0% 3G RF 3G RF
0%
0%
slow cell Reselection 0% Slow cell reselection
LA Update
Request
Call attempt
RRC Release
Non Genuine Call Setup Failures
Measurement system failures by Actix workbook
– Successful or failed Location Area update interpreted as call setup failure
LA Update
Request
RRC Connection
for Inter-RAT cell
reselection
Non Genuine Drop Call Scenarios
Measurement system failure examples:
– Drive test tool
• User initiated “UL CC Disconnect”
– Analysis Workbook
• Inter-Rat cell reselection from 2G to 3G interpreted as
drop call
• Complete (e.g 90 seconds) call on either 3G or 2G
• No drop in the log file / same drop listed twice
Genuine Call Setup Failure Scenarios
– RF issue
• Interference / Dominance / Coverage
• Missing neighbour
– System Issue - BTS
• No response to “RRC Connection Request”
• “RRC Connection Reject” to “RRC Connection Request”
– System issue - RNC
• “CC Disconnect” after “Call Proceeding” due to “DL RRC
Connection Release”
– Core NW
• “CM Service Abort” after “CM Service Request”
– System issue (test number)
• “CC Disconnect” after “CC Progress”
Genuine Drop Call scenarios
• RF issue
– Interference / Dominance / Coverage
– Missing Neighbours
4. RAB set-up
6. Service Established
8. Service Released
Call Setup Failure Start
Yes
UL coverage & RACH
B parameter. Optimization
(changing serving cell)
No AICH(ACK) received? Report & Finish
(Check failure cause)
Yes No
“RRC Connection
Setup” received?
No “RRC Setup
Reject” received?
C
Yes Yes
AC optimization (check PrxNoise
Acquisition Indicator/AICH
L1 Synchronisation
UE in CELL_DCH state
RACH Process B
L1 ACK / AICH
Downlink Not detected
BS
UEtxPowerMaxPRACH
PowerRampStepPRACHpreamble
… … … …
Uplink
MS Preamble Preamble
Message part
1 2
PowerOffsetLastPreamblePRACHmessage
PRACH_preamble_retrans
# PRACH preambles transmitted during one PRACH cycle without receiving AICH response
RACH_tx_Max
# preamble power ramping cycles that can be done before RACH transmission failure is reported
Yes
Yes
Is UL Interference Report there might be an interfering
abnormally HIGH? source Nearby the serving cell
No
– Overload Area:
Initial Dire ct Tra nsfer (CM S ervice Re quest) S CCP : Conne ction Re que st
• R R C: Initial Direct Trans fe r me ss a ge is s ent us ing acknowle dge d mode RLC to the CS core
doma in. Routing is to be bas e d upon the loca l P -TMSI
• The NAS me s s a ge is not rea d by the RNC but is forwa rded to the multime dia ga te way. The NAS
me ss a ge includes the IMS I a s a UE ide ntity
• The S CCP: Conne ction R eques t me s sa ge es ta blishes the conne ction orienta te d s igna lling link in
the s a me wa y a s it wa s for the RRC conne ction pha se .This does no t re s erve a ny re source s for the
AMR ca ll its e lf.
• The Connection Confirm message identifies the RNC with a destination local reference which is the
same as the source reference within the Connection Request message
• The Connection Confirm message identifies the CS core with a source local reference
• The CS core sends a RANAP: Location Reporting Control message to the RNC requesting
information regarding the location of a particular UE
• The RANAP: Common ID message specifies the IMSI belonging to the UE
• The S e curity Mode Comm and mes sa ge triggers the s ta rt or s top of ciphering a nd inte grity
prote ction.
Call setup failures – System Issue (testE
• number)
“CC Disconnect” after “CC Progress”
• Cause: recovery on timer expiry
• The call goes via IN SCP to a recording.
• A static test was done by Nokia
Customer Care and in few instances the
call dropped after 30 seconds of
recording passed. Hence the problem is
associated with the test number not
the RAN
30 sec
Cause: recovery on
timer expiry
Start
No
Best server’s No
Coverage Optimization
RSCP > -102dBm
Yes
Check Iur Inter RNC HO
Yes
Check neighbour definition parameters
No
Yes No DL ASU
Fix SC Clash SC Clash
received
C
Yes
No
DL Tx Power Max No
Yes
D
Yes Load Optimisation/
Uplink Interference
External Interferer
Yes
No
Yes
Link Unbalanced CPICH Optimisation
Drop call failures – RF issue A
• RF drops mostly due to poor dominance or
interference
• Poor coverage could lead to ISHO,
although poor dominance or interference
can cause ISHO to fail.
• Rapid field drop can cause drop due to
coverage
• Poor dominance or interference can cause
Compressed Mode (CM) to start even if
RSCP is still good.
• In CM UE transmits with higher power
(more interference) and spends less time
on 3G (less accurate measurement
reporting)
• Poor dominance or interference can lead
to Active Set update failures and Poor dominance
eventually to drop call. causes Active Set
update failures
Drop call failures – RF issue A
TrChAgg and DL
DPCCH BER high
Drop call failures – RF issue A
Fairly good
CPICH Pilot EcNo
Transport Channel
BER. Btw UE<->RNC
(MAC layer)
Drop to IDLE
Drop call failures – System issue B
• “CC Disconnect” due to RNC DPCCH BER
All Routes
100% 800
90% 700
80%
600
70% Call SetUp Success Rate
0% 0
KPI reporting
BTS failure chart (call setup failure & drops)
• Cumulative number of failures that occurred per site over time
• If the UE is spending only a small percentage of time on 3G problems may not be
identified.
Cell_D
Cell_A
CELL_C
CELL_B
BTS failure examples: CELL_A
• Long history of failures (over weeks 46, 47, 02)
• Call Setup failure scenarios:
– “CC Disconnect” after “CC Call Proceeding”
– “CM Service Abort” after “CM service Request”