1

2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm

Application Key Application Key
Performance Indicators Performance Indicators
for Mobile WiMAX for Mobile WiMAX
Raj 1ain
Washington University in Saint Louis
jaincse.wustl.edu
Presentation to WiMAX Forum Application Working Group
Meeting, Orlando, FL, February 4-9, 2009
These slides are also available at:
http://www.cse.wustl.edu/~jain/wimax/kpi.htm
2
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
;er;iew ;er;iew
What is a Key PerIormance Indicator
KPIs Ior Telecom Applications
Steps in KPI Study

2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm

What is a Key Performance Indicator What is a Key Performance Indicator
Gives a good indication oI perIormance
Commonly used in business
Metrics to deIine and measure business goals
Examples:
GNP (Gross National Product)
ARPU (Average Revenue Per User)
Dow Jones Index
4
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
KPIs for Telecom Applications KPIs for Telecom Applications
Connection Establishment Success Rate
Connection Drop Rate
Handover Success Rate
Throughput
Block Error Rate
ReI: UTRAN and GERAN KPI (GPP TR2.814,
March 2007)

2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm

PP KPIs Categories PP KPIs Categories
Retainability: Call drop rate
Availability: Cell unavailability
Integrity: Block error rate

2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm

KPIs KPIs -- Complete Set Complete Set
7
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
Selecting KPIs Selecting KPIs
Include:
PerIormance Time, Rate, Resource
Integrity: Error rate, probability
Availability: Time to Iailure and duration
Consider including:
Mean and variance
Individual and Global
Selection Criteria:
Low-variability
Non-redundancy
Completeness
8
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
Steps in KPI Study Steps in KPI Study
Key Applications
For each application:
User perceived perIormance
Relationship to measurable quantities
Precise deIinition and Iormula Ior computation
9
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
KPIs in Planes KPIs in Planes
Data Plane: User throughput
Control Plane: Scheduling overhead
Management Plane: Faults
Data
Control
Mgmt
PHY
MAC
TCP/IP
Application
10
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
KPIs for All Parts of Networks KPIs for All Parts of Networks
Mobile/stationary Subscriber
Base Stations
Base Station to Mobile Subscriber Link
Cell
Backbone network
Base
Stations
Mobile Station
Downlink (DL)
Uplink (UL)
Backhaul
11
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
Summary Summary
Application KPIs can be used by service providers to set their
business goals
User level KPIs can also be used by major customers to
compare services
Need to deIine KPIs that include key systems and subsystems
and include operations and data transIer
12
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
References References
R. Kreher, 'UMTS PerIormance Measurement: A
Practical Guide to KPIs Ior the UTRAN
Environment, Wiley, 200, ISBN:047002499.
GPP, 'Technical SpeciIication group Services and
System Aspects; Telecommunication management;
UTRAN and GERAN Key PerIormance Indicators
(KPI) (Release 7), TR 2.814, V7.0.0, March 2007.
1
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
Acronyms Acronyms
EDGE Ehanced Data Rates Ior GSM Evolution
GERAN GSM EDGE Radio Access Network
GSM Global System Ior Mobile Communicaiton
KPI Key PerIormance Indicator
KQI Key Quality Indicator
RAT Radio Access Technology
UMTS Universl Mobile Telecommunications System
UTRAN UMTS Radio Access Network
14
2009 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/wimax/kpi.htm
Thank You! Thank You!