2g Meerut Report

Meerut 2G Benchmark Report
February 2012
All Rights Reserved Alcatel-Lucent 2006, #####
Executive Summary Meerut

Meerut Population Area Population Density
Meerut Operators Airtel Vodafone Docomo Idea RCOM CDMA TATA CDMA
Details 3,447,405 272 km 1342 /km

Band of No. of 2G Operation Cells* (MHz) 1800 900 1800 900 850 850 471 306 361 339 -
Tech GSM GSM GSM GSM EVDO EVDO
Subscribers (UP West Circle) 6620368 9413864 8528526 9829965 467950 8528526
*No of Cells is an indicative no the cells encountered during the drive

Subscriber figures are for UP West Circle taken from the latest COAI report. *TATA & Reliance Subs includes GSM + CDMA.
Demographics of Meerut
Meerut is a metropolitan city in the Indian state of Uttar Pradesh. It is an ancient city located 70 km (43 mi) northeast of the national capital New Delhi, and 453 km (281 mi) northwest of the state capital, Lucknow. It is the second largest city in the National Capital Region of India (the largest being Delhi), the 16th largest metropolitan area and 17th largest city in India. It ranked 292 in 2006 and 242 in 2010 in the list of largest cities and urban areas in the world and is the second fastest developing city in Uttar Pradesh (after Noida). It has the 2nd largest army cantonment in the country. The city is one of the largest producers of sports goods, and the largest producer of musical instruments in India.
Section 1
Benchmarking Methodology
Benchmarking Equipment and setup Data Collection Details Voice Testing Algorithm Data Testing Algorithm Strategic Location Testing Benchmarking KPIs: Score Evolution Voice & Data KPI weightages
Benchmarking Equipment and Setup

The XCAL MO is a drive test data collection and analysis system for mobile networks. XCAL tool is a system that collects radio performance and QoS Key Performance Indicators (KPIs) of wireless networks. It is built upon a modular platform for Quality of Service (QoS) wireless network drive testing, RF Optimization and Competitive network benchmarking. The systems uses specially configured commercial phones attached to controlling device in isolation chambers to perform various test such as voice call, data calls, video calls etc. The equipment is flexible in configuration supporting a maximum of 20 handset devices on the same testing platform.
Data Collection Details

A benchmarking activity, was carried out in Meerut for across the city. The details of the activity are:
Measurement Period : 15th Jan 2012 to 11th Feb2012 Measurement time during the day : 8 AM to 9 PM Measurement days during the week : Monday to Saturday The drive route was created to cover the dense population area , key commercial area, key residential area. The city was divided into 5 clusters/areas.
CL -1 Ishwar Nagar, Kanjar Mohalla, CL-2 Prem Puri , sharda Puri Ph1 CL-3 Beripura, Muftiyan , Islamabad CL-4 Garh Raod, Tejgarhi, Prabhat Nagar
CL- 5 Sharma Nagar, Jawahar Nagar.
Voice Testing Algorithm

Test Details
No of Operators tested
Specifications
2G Network (Airtel, Docomo, Idea, Vodafone, Reliance CDMA, Tata CDMA) 3 mins (180 Secs) 10 Secs
Voice Test Algorithm

Call Duration Idle time in between calls
Continuous call for 3 minute duration with 10 seconds of Idle time. Speech samples (DL and UL) are sent and received which provide the MOS score for voice quality. This was repeated for the entire duration of collection
Data Testing Algorithm

Test Details
Specifications
GSM Network (Airtel, Docomo, Idea, Vodafone) EVDO Network (Reliance, Tata)
No
1 2 3 4 5 6 7 8
HTTP Websites
google.com facebook.com nimbuzz.com airtel.in vuclip.com youtube.com admob.com nokia.com
Data Test Algorithm

Attach and PDP Activation Ping FTP Download FTP Upload HTTP Email send Email Receive Before every test 3 times - 32 bytes on www.google.co.in 10 MB (for EvDo), 500KB (for GSM) from server 1 MB ( for EvDo), 100KB (for GSM) to Server 8 different websites. 100 KB Email to SMTP server 100 KB Email from POP3 server
After every application test, we have 5 sec Idle time before the next Application is tested.
Strategic Location Testing

Strategic Locations
Specifications
GSM Network (Airtel, Docomo, Idea, Vodafone) EVDO Network (Reliance, Tata) Data Test Algorithm 8 different WAP sites 10 MB (for EvDo), 1MB (for GSM) from Server 100 KB Email to SMTP server 100 KB Email from POP3 server SMS send to same number (160 char) MMS send to same number 15 Kb
WAP Test FTP Download Email send Email Receive SMS MMS
WAP sites wap.google.com m.facebook.com m.samsungmobile.com wapin.com m.vuclip.com m.youtube.com m.admob.com m.sonyericsson.com
Apart from the above tests during the drive, at 5 strategic locations across the city, additional stationary tests were carried out. These locations are important locations of the city. 1. Abu Lane 2. Begam Pul 3. Roadways Bus Stand 4. Sadar Bazar 5. Shastri Nagar
Benchmarking KPIs: Score Evolution

Top 20% percentile draws the border line to T global to 20% performers the o p Maximum value shows the best result in this case best performing operator call setup time(2.62 S)
2.62s
50% operators are above median value and 50% of operator are below this value
1
3.8s
Low 20% percentile shows that 20% of all operators are on this level or lower.
2 Here you find individual operators
3
5.00s
Minimum Values shows poor performing network in this category . Here the lowest performing operator having call setup time(5.00 s)
Each KPI is then measured on a scale of 0 to 200 on the basis of performance. Value of the Particular KPI is not reported default score is 100. The Score is then weighted with the respective weightages to arrive at an overall Voice or a Data Score.
Voice & Data KPI weightages

5 KPIs are used to arrive at the Voice Quality Score and 19 KPIs are used to arrive at the Data Quality Score. Following are the details of weightings assigned to different KPIs. These are used for arriving at the final ranking of the operator.
*Coverage Calculation: Coverage = A%*10+B%*8+C%*6+D%*1 10
Section 2 Management Summary

Overall Voice Quality Score Overall Data Quality Score Voice Quality Score Data Quality Score
Voice Quality Score

VCQI
172
CST
CSSR
10.0
1
100%
CCSR
100% 99%
MOS
4.01
Coverage
100%
99%
5 3
1 128
97% 1
1 45 3.8 97% 3 6 4 3.6 2 3
4 6 92%
5 3
\
1 2 3
4 5
92%
2
4 94
2 3 1
4.7 3.8
92% 3.4
74%
53
3.2
56
2
2
61%
5 6
Best Operator
1 2 3 4 5 6 Operator Airtel Docomo Vodafone Idea RCOM Tata VCQI 140.29 34.32 84.62 107.79 94.69 56.85 CST 4.58 5.00 4.97 4.74 2.62 2.68
Airtel
CSSR 98.25% 93.51% 96.73% 96.06% 97.60% 93.91% CCSR 98.21% 94.26% 96.24% 97.80% 97.86% 95.76% MOS 3.89 3.21 3.59 3.71 3.28 3.27 Coverage 90.81% 90.62% 90.56% 90.09% 84.44% 74.89%
Retainability,Accessibility Voice quality and coverage
CST= Call Setup Time CSSR= Call Setup Success Rate
CCR= Call Completion Rate
MOS= Mean Opinion Score
12
Data Quality Score

DCQI
183
GPRS
200
PDP
FTP DL
197
200
FTP UL
196 5
HTTP
200
Email
Ping
199
56
200
153
146
4
3 5 4 1 96 6 117
4
130
56
6 5
133
136
3 1
124
12 3 4 56 100
129
56
100
94
91
1 4
99
95 4 1 2
52
100
1
66 2
55
57 4
2 44
4
1 5
6 41
40
41 2
12
Best Operator Overall

1 2 3 4 5 6 Operator Airtel Docomo Vodafone Idea RCOM Tata DCQI 94 57 125 102 111 114 HTTP 89 32 104 84 119 135 FTP DL 55 0 98 134 47 56 FTP UP 67 41 135 138 176 94 SMS 199 200 199 200 100 100
Vodafone among GSM Operators

MMS 188 149 184 89 100 100 Email 63 59 157 77 142 143 GPRS ATT 120 120 120 120 100 100 PDP 0 0 76 51 100 100 PING 117 64 124 28 179 182
Section 3 Detailed Voice Analysis

Voice Performance Analysis Coverage Distribution Call Setup Time Call Setup Success Rate
Call Setup Failure Analysis
Call Completion Success Rate

Call Completion Failure Analysis
Accessibility V/s Retainability: Market Comparison Voice Quality: MOS
Airtel MOS Performance

Airtel RxQual
Voice Codec Distribution Handover Analysis
Voice Performance Analysis

Call Setup Time:
Airtel Is no. 3 with Call Setup time of 4.58s
Call Setup Success Rate:

Airtel No. 1 call setup success Rate 98.25%
Call Completion Success Rate:

Airtel is no. 1 for CCSR 98.21%
Voice Quality:
Airtel Ranked No. 1 for speech quality for with MOS 3.89
Parameter Call Setup Time Accessibility Retainability MOS Best Value 2.62 98.25% 98.21% 3.89 Operator RCOM Airtel Airtel Airtel
Coverage
90.81%
Airtel
Airtel
Best Operator
1 2 3 4 5 6
Operator Airtel Docomo Vodafone Idea RCOM Tata
CST 3 6 5 4 1 2
Accessibility Retainability Voice Quality Coverage 1 1 1 1 6 6 6 2 3 4 3 3 4 3 2 4 2 2 4 5 5 5 5 6
Ranking for Voice KPIs
15
Coverage Distribution
Coverage was measured with the help of a digital scanner for all the networks.
Operator Airtel 2G Tata Docomo 2G Vodafone 2G Idea 2G RCOM CDMA TATA CDMA % of samples > 85dBm 89.53% 89.67% 89.69% 85% 86.61% 83.38% Coverag e Rate using formula 90.81% 90.62% 90.56% 90.09% 84.44% 74.89% Rank 1 2 3 4 5 6
All the GSM operators have an almost equal coverage. Out of these Airtel is best
Airtel Distribution
Range Samples Percentage <0 to >=-65 29749 69.35% <-65 to >=-75 8961 20.89% <-75 to >=-85 2812 6.56% <-85 to >=-95 1314 3.06% <-95 to >=-105 62 0.14%
400000 350000 300000 250000 200000 150000 100000 50000 0
Coverage RSSI
Tata CDMA Reliance CDMA Idea Vodafone Docomo
Airtel
0 TO 65 65 TO 7575 TO 8585 TO 95 95 TO 105
Coverage Plot
Airtel has an average GSM coverage footprint across the city.
Coverage Legends -65<=x -75<=x<-65 -85<=x<-75 -95<=x<-85 -110<=x<-95
Samples Percentage 22147 57786 62911 14064 1568 13.97% 36.46% 39.70% 8.87% 0.99%
Need to look on the circled area
Call Setup Time (CST)

80 70 60 50 40 30 20 10 0 -10 0 1 Airtel Idea 30 25 20 15 10 5 0 3.9 Airtel 4.7 Docomo 4.1 Vodafone 4.08 Idea 14.73 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 Vodafone Tata CDMA 27.57 Docomo Reliance CDMA
Call Set up Time (PDF)
Airtel have least call setup time amongst all GSM operators.
CST Avg.
17.53 13.55
22.93 16.13 MIN MAX 4.74 Avg.
4.58
5.00
4.97
2.62
2.68 1.1
1.54
Reliance Tata CDMA CDMA
Call Setup Success Rate

Call Setup Success Rate is a measure of subscriber experience associated with the access to network resource. It consists of congestion of network or unavailability of network resources.
Operator
Airtel 2G Docomo 2G Vodafone 2G Idea 2G Reliance CDMA Tata CDMA
Call Attempts
479 487 496 418 442 447
Blocked Calls 9 37 17 20 11 26
CSSR
98.25% 93.51% 96.73% 96.06% 97.60% 93.91%
Blocked Rate 1.75% 6.49% 3.27% 3.94% 2.40% 6.09%
Airtel has the best accessibility amongst all Operators with value of 98.25%
Call Setup Success Rate Total Calls Attempts Blocked Call Reasons (Radio Cause) SDCCH Drop SDCCH blocking CM Setup Phase Failure SDCCH Drop, High RxQual Temporary failure
Airtel 2G Docomo 2G Vodafone 2G Idea 2G 479 487 496 418 9 37 17 20
Reliance CDMA 442 11
Tata CDMA 447 26
28
14
17
22
High RxQual Poor Coverage Failed after TCH Assignment/progress Total CSSR
2 1 9 98.25% 37 93.51%
2 1 17 96.73%
1 1
2 2 26 93.91%
20 96.06%
11 97.60%
Call Completion Success Rate

Call Completion Success Rate is a measure of subscriber experience associated with the continued use of network resources that have been granted. It consists of radio link drops or abnormal network-initiated releases.
Operator Airtel 2G Docomo 2G Vodafone 2G Idea 2G Reliance CDMA Tata CDMA Established 470 450 479 398 431 421 Dropped Calls 9 23 18 9 10 16 CCSR 98.21% 94.26% 96.24% 97.80% 97.86% 95.76% Dropped Rate 1.79% 5.74% 3.76% 2.20% 2.14% 4.24%
Airtel has best retainability.
Call Completion Success Rate Total Calls Established Dropped Call Reasons
Airtel 2G 470 9 5 1
Docomo 2G 450 23 18 2
Vodafone 2G 479 18 17
Idea 2G 398 9 5 2
Reliance CDMA 431 10 7 2
Tata CDMA 421 16 12 2
High RxQual Missing Handover, High RxQual Resource Unavailable High RxQual, FER
Total
CCSR
3 9 98.21%
3 23 94.26%
1 18 96.24%
2 9 97.80%
1 10 97.86%
2 16 95.76%
Call Failed & Drop Plot

FAILEDCALLS DROPPED CALLS
Accessibility V/s Retainability: Market Comparison
99% 98% 97% 96% 95% 94% 93% 92% 9 98.25%
37
CSSR
26 17 20 11
40 35 30 25 20 15 93.91% 10 5
99%
98% 97% 96% 95% 98.21% 94% 9 94.26% 23
CCR
18 16 10 97.86% 95.76%
25
20 15 10 5 0
9 96.24% 97.80% Idea
93.51%
96.73%
96.06%
97.60%
93%
92%
91%
Airtel
Docomo Vodafone CCSR CSSR
Idea
Reliance
Tata
Airtel
Docomo Vodafone CCR
Reliance
Tata
NO OF CALL BLOCKS
NO OF CALL DROPS
Voice Quality: UL & DL MOS
4.5 4 3.5 3 2.5 2 1.5 1 0.5 0
3.89 3.21
3.59
3.71
MOS UL/DL
3.28
3.27
4.50 4.00 3.50 3.00 2.50 2.00 1.50 1.00 0.50 0.00
Airtel is having the best MOS value amongst all operators
3.42 3
3.6 3.82
3.86 3.92
3.89 3.22
3.21 3.35
Airtel
Docomo DL MOS
Vodafone
Idea
UL MOS
Reliance CDMA Avg. MOS
Tata CDMA
3.81 3.72
Plot DL MOS
MOS Legend Samples Percentage 3.8 < x < 5 29655 24.85% 2.8 < x < 3.8 79418 66.56% 2.2 < x < 2.8 0 0.00% 0 < x < 2.2 10244 8.59%
Plot RxQualSub
Rx Qual Legend Samples Percentage 7 <= x < 9 4402 2.78% 5 <= x <7 14148 8.94% 0 < =x < 5 139655 88.27%
Need to work on circled areas
Voice Codec Distribution

80 70 60 50 40 30 20 10 0
CODECS
73.76
26.24
24.12
75.88
64.72
35.28
71.71
Airtel
Docomo
AMR HALF RATE
Vodafone
AMR FULL RATE
Idea
900000 800000 700000 600000 500000 400000 300000 200000 100000 0
800000
TCH FR
700000 600000 500000 400000
TCH HR
300000
200000 100000 0 AMR 4.7 AMR 5.6 AMR 6.7 AMR 7.9 AMR 11.9 AMR 12.2 Airtel Docomo Vodafone Idea AMR 4.7 Airtel AMR 5.6 AMR 6.7 AMR 7.9 AMR 11.9 AMR 12.2 Idea
Docomo
28.29
Vodafone
Handover Performance
2G HANDOVERS AIRTEL DOCOMO VODAFONE IDEA RELIANCE CDMA TATA CDMA HO ATTEMPTS 1396 1375 1257 1168 675 467 HO SUCCESS 1375 726 1146 1076 645 449 HO FAILURE 22 649 111 92 30 18 HO SUCCESS RATE 98.50% 52.80% 91.17% 92.12% 95.56% 96.15% Avg. HO TIME 0.18 0.17 0.17 0.18 0.16 0.17
Section 3
Detailed Data Analysis

Data Performance Analysis FTP Performance
FTP Application Throughput Analysis
HTTP Browsing Analysis

HTTP Performance (Airtel)
FTP DL/UL and HTTP Failures Email Performance GPRS Attach and PDP performance Data Access Technology Distribution
EDGE - GPRS Codecs GPRS Timeslot Allocation
Ping Response: Latency Performance KPI Overview Table
Data Performance Analysis

Test Operator FTP UP (5%) FTP DL (20%) HTTP (30%) Email Sent (5%) Email Retrive(5%) Ping (10%) FTP UP FTP UP FTP DL FTP DL HTTP HTTP Email Email Email Email Ping RTT Success( Through Success( through Success( downloa sent sent retrive Retrive 60%) put(40%) 60%) Put (40%) 60%) d Success( time(40%) Success( time(40%) time(40%) 60%) 60%) 4 4 3 5 4 5 4 5 5 6 4 6 6 4 6 6 6 4 4 6 5 5 3 3 2 3 3 3 1 3 1 3 3 1 5 1 4 5 4 4 6 4 4 6 2 1 4 2 2 2 3 1 2 2 2 5 2 4 1 1 1 2 2 3 1 1 GPRS Attached(5%) PDP Attached(5%) GPRS GPRS PDP PDP Airtel FTP UL performance ranked 4, FTP DL Attach attach context context Success delay(40 success(6 delay(40 Performance rank 3 Rate % 0%) %) Airtel Ranked 4th for FTP UL throughput, no 5 for 1 3 5 4 FTP DL throughput 1 3 5 4 1 3 1 3 Airtel is at 4th for email sent and 5th retrieve 1 3 4 4 performance 5 1 2 1 Ranked 4th for HTTP performance 5 1 2 1 PDP context performance Airtel ranked 5th MMS(5%) SMS(5%) SMS SMS MMS MMS Airtel, Docomo, Vodafone and Idea has comparable success delivery success delivery GPRS Attach performance (60%) time(40%) (60%) time Airtel, Docomo, Vodafone and Idea have same rank (40%) 1 4 1 2 for SMS performance while Vodafone has best MMS 1 1 3 3 delivery time while Docomo is best for SMS delivery 1 3 2 1 time 1 2 6 4 5 5 4 5 5 5 4 5
1 2 3 4 5 6
Airtel Docomo Vodafone Idea RCOM Tata Test Operator
1 2 3 4 5 6
Airtel Docomo Vodafone Idea RCOM Tata Test Operator
1 2 3 4 5 6
Airtel Docomo Vodafone Idea RCOM Tata
Ranking for Data KPIs
29
FTP Statistics
100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%
FTP SUCCESS RATE
File transfer is becoming increasingly and legitimately popular as a method of transferring media files (movies and music).
32.69% 76.36% 73.26% 78.68% 49.70% 72.82% 87.32% 93.31% 94.93% 94.64% 0.00% 94.48%
Airtel
Docomo
Vodafone
Idea
FTP DL SUCCESS RATE
FTP UL SUCCESS RATE
The FTP test is used to test the FTP service availability and to measure the application throughput for file download or file upload. The test is successful when the desired operation (uploading or downloading) has succeeded. Airtel has an average throughput as compared to other GSM providers.
Airtel Docomo Vodafone Idea Reliance CDMA Tata CDMA
72.4 69.1 64.3 35.8 99.8 113.4 70.0 97.8 566.3 232.0 553.6 457.6
0.00 100.00 200.00 FTP UL SUCCESS RATE
FTP THROUGHPUT
FTP UL Throughput FTP DL Throughput
300.00 400.00 500.00 FTP DL SUCCESS RATE
600.00
HTTP Browsing Analysis

HTTP STATISTICS
38.88 35.17 27.80 33.63
100% 90% 80% 70% 60% 50%
45 40 35 30
19.62
25 17.37 20 15
40%
30%
53.04%
88.41%
89.84%
86.84%
91.04%
93.13%
20% 10% 0%
10 5 0
Airtel
Docomo HTTP SUCCESS RATE
Vodafone
Idea HTTP DL TIME
Reliance CDMA
Tata CDMA
The web browsing quality of experience is generally associated with the time it takes to locate and download a web page within a web browser application. The HTTP Download test was conducted with 8 different websites. The Downloaded Page size was approx 350Kb. HTTP browsing time for above three sites is also high lowering down overall average value.
HTTP Performance (Airtel)
100% 90% 80% 70%
HTTP BROWSING AIRTEL

86.7
100 90 80 67.9 70
60%
50% 40% 30% 20% 97.5% 10% 0% 24.0 98.7% 98.2% 37.1 24.8 78.0%
61.3 55.3 44.8
60
50 40 30 20
65.0%
90.0%
66.7%
86.1%
10 0
HTTP SUCCESS RATE
HTTP DL TIME
FTP DL/UL and HTTP Failures

The Plots show the Failure events encountered during FTP Download, FTP upload and HTTP Browsing for Airtel .
Email Send / Retrieve

120% 100% 80% 60% 40% 68.3% 68.3% 83.2% 83.2% 98.1% 98.1% 85.7% 85.7% 92.0% 92.8% 20% 0% Airtel Docomo Vodafone Reliance Tata CDMA CDMA Email Receive success rate Idea 92.8% 92.8%
EMAIL SEND / RECEIVE RATE
A 100KB email was sent and downloaded via the POP and SMTP protocols. This is a close simulation of Users accessing pull mail from their work IDs using their handphones. Airtel has average email send success rate. Airtel has highest email send delay as compared to other operators.
Email Send success rate
EMAIL SEND/RECEIVE TIME

Airtel 2G Docomo 2G Vodafone 2G Idea 2G Reliance CDMA Tata CDMA 36.4 28.3 31.7 23.3 18.2 20.4 29.3 28.7 8.7 6.3 6.7 10.2 10.00 20.00 Email Send time 30.00 40.00
0.00
Email Retrieve time
GPRS Attach and PDP Context

120% 100% 80% 18.78 9.55 10 40% 100% 100% 100% 100% 20% 0% Airtel Docomo Vodafone Idea GPRS Attach Success rate Attach Time 5 0 22.55 19.82 20 15 25 100% 98% 96% 94% 92% 3.71 3.25 5.16 8.15 9 8 7 6 5 4 3 2 92% 89% 99% 98% 1 0 Airtel Docomo Vodafone Idea PDP Time PDP Context Activation rate
60%
90%
88% 86% 84%
GPRS STATISTICS
PDP STATISTICS
Airtel has poor average GPRS attach Delay amongst all operators. PDP performance is also poor for Airtel.
35
EDGE GPRS Codecs

40.00 35.00 30.00 25.00 20.00 15.00 10.00 CS4 CS3 CS2 CS1
GPRS Downlink
40.00 35.00 30.00 25.00 20.00 15.00
GPRS Uplink
CS4 CS3 CS2 CS1
10.00
5.00 0.00
5.00
0.00 Airtel Docomo Vodafone Idea
Airtel
Docomo
Vodafone
Idea
EDGE Downlink
100.00 90.00 80.00 70.00 60.00 50.00 40.00 30.00 20.00 10.00 0.00 Airtel Docomo Vodafone Idea MCS9 MCS8 MCS7 MCS6 MCS5 MCS4 MCS3 MCS2 MCS1 100.00 90.00 80.00 70.00 60.00 50.00 40.00 30.00 20.00 10.00 0.00 Airtel
EDGE Uplink
MCS9 MCS8 MCS7 MCS6 MCS5 MCS4 MCS3 MCS2 Docomo Vodafone Idea
MCS1
Timeslot Allocation
TS Downlink
TS Uplink
Airtel has got average TS allocation.
Ping Response: Latency Performance

600 500 400 300 200
Ping RTT (msec)

800 700 600 500 400 300 200 100 0 Airtel 2G Docomo 2G Vodafone 2G >1000 400-600 Idea 2G Reliance Tata CDMA CDMA 600-800 0-200 573
Ping RTT
370
348
Airtel Airtel
Docomo Vodafone Docomo Vodafone
Idea Idea
714
100
Reliance Tata CDMA CDMA Reliance CDMA Tata CDMA
800-1000 200-400
A Latency Test was Conducted with www.google.co.in with 32bytes of data to figure out the round trip time. A Ping Response signifies the average delay it takes to access a particular service.
Airtel has an average ping delay in all GSM Service Providers.

The ping delay response is however not a comprehensive representation of the service access time since it is dependent on factors beyond the GGSN such as the number of hops to the destination and the pipe available
The delay in the RTT can point to: UL/DL TBF allocation algorithm Different Implementation of QoS on the Gn/Gi and giving priority to other traffic than the tunnelled ICMP
164
153
SMS & MMS Analysis

14 12 10 8 60% 6 4 2 5.5 9.5 5.9 0 40% 20% 11.6 12.3 10.3 7.3 6.2 0% 100%
SMS STATISTICS
100% 100% 100%
120% 100% 80%
35 30 25 20 100%
MMS STATISTICS
96%
120% 100% 80%
72%
60%
15 34% 10 40% 20% 0% Airtel Docomo Vodafone Idea MMS SUCCESS RATE
18.29
22.87
15.97
13.94
Airtel
Docomo
Vodafone
SMS RECEIVE TIME
Idea
SMS SUCCESS RATE
SMS SEND TIME
MMS SEND TIME
MMS RECEIVE TIME
SMS Statistics is comparable whereas MMS performance is best for Airtel.
29.1
20.59
KPI Overview Table

The attached KPI table gives an overview about the most important performance figures collected during this Benchmarking campaign.
Section 4 Clusterwise Analysis

City Vs Cluster Standings Cluster wise Summary Voice Cluster wise Snapshot Voice Cluster wise Summary Data Cluster wise Snapshot Data Cluster Analysis
Cluster 1 Cluster 2 Cluster 3 Cluster 4
Cluster 5
Dehradun CityVs Cluster

VCQI
172
DCQI
183
0 1
4
5
128
top 20% performers internationally

117 1 0 34
2
94
96
international average
53
66
low 20% performers internationally

Meerut 2G
0 1 2 3 4 5
Overall Cl1 Cl2 Cl3 Cl4 Cl5
CL -1 Ishwar Nagar, Kanjar Mohalla, CL-2 Prem Puri , sharda Puri Ph1 CL-3 Beripura, Muftiyan , Islamabad CL-4 Garh Raod, Tejgarhi, Prabhat Nagar CL- 5 Sharma Nagar, Jawahar Nagar.
42
City vs Cluster Voice Quality Score

VCQI
2 179
CST
10.0
CSSR
2
100% 99%
CCSR
2
5
MOS
100% 99%
2 01
4.20
3 4 5 3.8
Coverage
3 4 1 2 0
100%
4 1 3
0
97%
4 1 3
0
1
3.6 3.4
92%
4
5
128
97%
94
0 1 2 34 5 4.7 3.8 3.2 92%
74%
53
92%
61%
Meerut 2G
VCQI
CST
CSSR
CCR
0 1 2 3 4 5
Overall Cl1 Cl2 Cl3 Cl4 Cl5
140 122 178 118 138 130
4.58 4.64 4.66 4.53 4.56 4.52
98.25% 97.14% 100.00% 97.10% 98.36% 98.67%
98.21% 97.06% 100.00% 97.01% 98.33% 98.65%
MOS (Avg of DL/UL) 3.89 3.87 4.20 3.80 3.84 3.755
Coverage
90.81% 93.22% 92.96% 99.27% 95.23% 73.35%
CST= Call Setup Time CSSR= Call Setup Success Rate
CCR= Call Completion Rate
MOS= Mean Opinion Score
43
City vs Cluster Data Quality Score

DCQI
183
GPRS
200
PDP
197
FTP DL
200
FTP UL
196
HTTP
200
Email
199
PING
200
153
146
1
1
129
130
133 1
4
136
2 0
5 124
117 1 0 3
2
0 1 2 34 5 100
100
45
96
94 3 1 2
2 1
4
91
99 5
0 3
95
100
66
55
57
5 4
0 3
41
3
2
45 40
2 41
1
52
44
3 0 2 45
Meerut 2G 0 1 2 3 4 5 Overall Cl1 Cl2 Cl3 Cl4 Cl5
DCQI 94 111 89 96 98 100
GPRS 120 120 120 120 120 120
PDP Context 0 120 0 14 0 0
FTP DL 55 71 73 75 43 66
FTP UL 67 75 98 57 51 49
HTTP 89 110 48 92 101 85
Email 63 35 55 84 111 100
Ping RTT 117 152 140 65 102 134

44
Clusterwise Summary Voice
1
Voice Index Airtel Docomo C1 1 2 3 6 4 5 C2 1 6 4 3 2 5 C3 1 6 3 2 4 5 C4 1 6 3 2 4 5 C5 1 4 5 3 2 6
Vodafone Idea
RCOM TATA
2 3
Clusterwise Snapshot Voice

100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%
CALL SETUP SUCCESS RATE
120% 100% 80% 60% 40% 20% 0%
CALL COMPLETION RATE
Cluster 1 Cluster 2 Cluster 3 Airtel Docomo Vodafone Idea 4.5
Cluster 4 Cluster 5 Reliance Tata CDMA 8 7 6 5 4 3 2 1 0
Cluster 1 Cluster 2 Airtel Docomo Vodafone
Cluster 3 Cluster 4 Cluster 5 Idea Reliance Tata CDMA
4
3.5 3 2.5 2 1.5 1 0.5 0 Cluster1
VOICE QUALITY (MOS)
CALL SETUP TIME
Cluster1 Cluster2 Cluster3 Cluster4 Cluster5 Airtel Idea
Cluster2
Cluster3 Docomo Reliance CDMA
Cluster4 Vodafone Tata CDMA
Cluster5
Airtel
Docomo
Vodafone
Idea
Reliance CDMA
Tata CDMA
Clusterwise Summary Data
1
Data Index Airtel Docomo C1 4 6 1 3 5 2 C2 5 6 1 4 3 2 C3 5 6 1 4 3 2 C4 5 6 1 3 4 2 C5 3 6 1 5 2 4
Vodafone Idea
4 2
RCOM TATA
Clusterwise Snapshot: Data

120% 100% 80% 60% 40% 20% 0% Cluster 1 Airtel 70 60 50 40 30 60% 40% 20% Cluster 1 Airtel Cluster 2 Cluster 3 Idea Cluster 4 Reliance Cluster 5 Tata CDMA 0% Cluster 1 Airtel Cluster 2 Cluster 3 Idea Cluster 4 Reliance Cluster 5 Tata CDMA Docomo Vodafone Docomo Cluster 2 Vodafone Cluster 3 Idea Cluster 4 Reliance Cluster 5 Tata CDMA 120% 100% 80%
FTP DL ACCESSIBILITY
900 800 700 600 500 400
FTP DL THROUGHPUT
300
200 100 0 Cluster 1 Cluster 2 Cluster 3 Airtel Docomo Vodafone Idea Cluster 4 Reliance Cluster 5 Tata CDMA
HTTP DOWNLOAD TIME
HTP SUCCESS RATE
20
10 0 Docomo Vodafone
48
Cluster 1
Best Operator (GSM)
CST CCR
Good
MOS CSSR
Excellent
Focus Area: Coverage and FTP Success Rate FTP DL and UL both are poor in comparison with other operators.
Voice: Airtel Data: Vodafone
Average
Coverag e
Poor
FTP SUCCESS RATE
100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0%
79.03%
82%
96.30%
97%
FTP DL Success Rate
Airtel
Docomo Vodafone
Idea
38% 81.82%
0% 92.31%
88.89%
100%
81%
100%
FTP UL Success Rate
Cluster 2
CCR
Best Operator (GSM)

Focus Area: FTP DL Success Rate Average HTTP browsing success rate FTP DL Success Rate is Poor. Voice: Airtel Data: Vodafone
CSSR
Good
CST
Excellent
MOS
Coverag e
Average
Poor
90% 80% 70% 60% 50% 40% 30% 20% 10% 0%
79%
90%
100%
94%
FTP DL SUCCESS RATE
374.73
400
350
300
54%
214.5 137.96 105.16 33%
250 200 150 100
72.04
36.84
0%
50 0 Tata CDMA
Airtel
Docomo
Vodafone
Idea
FTP DL Success Rate
FTP DL Throughput
Reliance CDMA
Cluster 3
CSSR MOS
Coverag e
Focus Area: FTP UL Success Rate Low FTP Upload success rate
Best Operator (GSM)

Good
CST CCR
Excellent
3
Average Poor
100% 90% 80% 70%
FTP UL SUCCESS RATE & THROUGHPUT

873.1
1000 900 800 700
40% 30% 20% 10%
77%
88%
94%
50%
95%
100%
100%
60%
511.33
600
500 400 300 200 100
73.98
84.83
110.11
70.11
0%
Airtel Docomo Vodafone FTP UL Success Rate Reliance CDMA FTP UL Throughput Idea Tata CDMA
Cluster 4
CST
Cove rage
CSSR
Focus Area: FTP Success Rate (DL/UL) Excellent Poor FTP UL and DL Success rate.
Best Operator (GSM)

Good
CCR
MOS
Average
Poor
FTP SUCCESS RATE

100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% FTP DL Succe ss Rate FTP UL Succe ss Rate
74%
84.62%
100.00%
100.00%
75.00%
96.15%
Airtel
Docomo
Vodafone
Idea
0% 96.77%
25% 100.00%
0% 0%
Cluster 5
CCR
Focus Area: Coverage and FTP Success Rate

CSSR
Best Operator (GSM)

Good
CST MOS
Excellent
Low FTP DL success rate Weak Coverage
5 Average
Coverage
Poor
FTP DL SUCCESS RATE
FTP DL Succes s Rate 79% 89%
100%
90%
80% 70%
60%
50% 70% 40% 30% 20% 75% 86% 92% 86% 10% 0% Airtel Docomo Vodafone Idea Reliance CDMA Tata CDMA 0% 93% 75%
0.00% 0.00%
FTP UL Succes s Rate
Section 5 Strategic Locations Analysis

Strategic Location: Overview Strategic Location: Voice Analysis Strategic Location: Data Analysis Overall Location 1: Abu Lane Location 2: Roadways Bus Stand Location 3: Begampul Location 4: Shastri Nagar Location 5: Sadar Bazar
Strategic Location: Overview
Locations
Latitude
Longitude
Abu Lane
Roadways Bus Stand Begampul Shastri Nagar Sadar Bazar
28.996955
28.988847 28.998006 28.953555 28.990762
77.700448
77.701049 77.706027 77.732892 77.696893
Strategic Location: Data Analysis

Over All Static Data DOCOMO 2G VODAFONE 2G 25 5 20.00% 32.486 25 92.00% 18.572 25 96.00% 34.134 50 100.00% 7.692 12.134 25 2.00% 4.778 25 22 88.00% 113.942 25 100.00% 20.318 25 100.00% 15.284 50 100.00% 7.612 11.324 25 10.00% 10.734
Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Retrieve Access Email Retrieve Success % Email Retrieve Delay SMS send Access SMS e2e Success % SMS send Delay (sec) Delivery Time (sec) MMS send Access MMS e2e Success % MMS send Delay
Airtel 2G 25 25 100.00% 88.084 25 100.00% 19.786 25 100.00% 13.02 50 100.00% 7.332 7.242 25 76.00% 16.174
IDEA 2G 25 25 100.00% 85.85 25 100.00% 37.884 25 100.00% 22.29 50 100.00% 7.624 7.88 25 54.00% 12.894
Reliance EVDO 15 13 86.67% 110.396 25 96.00% 47.082 25 96.00% 37.544 -
TATA EVDO 25 13 52.00% 339.818 25 874.00% 10.406 25 874.00% 10.784 -
Location 1: Abu lane

ABU LANE Test FTP DL Acces s FTP DL Succes s FTP DL Acces s i bi l i ty FTP DL Mea n Da ta ra te(Kbps ) Ema i l Send Acces s Ema i l Send Succes s % Ema i l Send Del a y Ema i l Retri eve Acces s Ema i l Retri eve Succes s % Ema i l Retri eve Del a y SMS s end Acces s SMS e2e Succes s % SMS s end Del a y (s ec) Del i very Ti me (s ec) MMS s end Acces s MMS e2e Succes s % MMS s end Del a y Airtel 2G 5 5 100.00% 46.9 5 100.00% 41.44 5 100.00% 28.85 10 100.00% 6.7 7.2 5 80.00% 15.78 DOCOMO 2G 5 0 0.00% 13.21 5 80.00% 21.17 5 80.00% 35.21 10 100.00% 8.4 10.22 5 10.00% 23.89 VODAFONE 2G 5 2 40.00% 144.21 5 100.00% 14.03 5 100.00% 11.75 10 100.00% 7.3 10.21 5 10.00% 18.23 IDEA 2G 5 5 100.00% 98.3 5 100.00% 92.92 5 100.00% 10.6 10 100.00% 6.2 9.3 5 30.00% 11.23 Reliance EvDo 0 0 0.00% 0 5 80.00% 38.38 5 80.00% 21.37 TATA EVDO 5 1 20.00% 1030.48 5 70.00% 3.32 5 70.00% 1.86 -
Location 2: Roadways Bus Stand

ROADWAYS BUS STAND Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Retrieve Access Email Retrieve Success % Email Retrieve Delay SMS send Access SMS e2e Success % SMS send Delay (sec) Delivery Time (sec) MMS send Access MMS e2e Success % MMS send Delay Airtel 2G 5 5 100.00% 92.84 5 100.00% 14.82 5 100.00% 9.23 10 100.00% 7.92 9.98 5 80.00% 15.24 DOCOMO 2G 5 1 20.00% 18.12 5 80.00% 16.35 5 100.00% 80.37 10 100.00% 5.5 10.1 5 0.00% 0 VODAFONE 2G 5 5 100.00% 133.34 5 100.00% 34.44 5 100.00% 13.47 10 100.00% 6.8 11 5 20.00% 19.21 IDEA 2G 5 5 100.00% 91.74 5 100.00% 42.65 5 100.00% 43.1 10 100.00% 9.28 9.34 5 100.00% 12.78 Reliance EvDo 0 0 0 0 5 100.00% 82.37 5 100.00% 72.47 TATA EVDO 5 2 40 149.28 5 40 11.13 5 40 4.41 -
Location 3: Begam Pul

BEGAM PUL Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Retrieve Access Email Retrieve Success % Email Retrieve Delay SMS send Access SMS e2e Success % SMS send Delay (sec) Delivery Time (sec) MMS send Access MMS e2e Success % MMS send Delay Airtel 2G 5 5 100.00% 94.37 5 100.00% 13.21 5 100.00% 8.98 10 100.00% 8.34 9.93 5 60.00% 13.89 DOCOMO 2G 5 1 20.00% 38.34 5 100.00% 18.93 5 100.00% 30.32 10 100.00% 9.67 11.78 5 0.00% 0 VODAFONE 2G 5 5 100.00% 87.88 5 100.00% 21.78 5 100.00% 18.97 10 100.00% 10.67 13.78 5 0.00% 0 IDEA 2G 5 5 100.00% 73.78 5 100.00% 23.42 5 100.00% 34.78 10 100.00% 4.78 8.34 5 100.00% 18.98 Reliance EvDo 5 3 60% 187.21 5 100.00% 79.63 5 100.00% 65.97 TATA EVDO 5 1 20% 166 5 100% 13.56 5 100% 22.67 -
Location 4: Shastri Nagar

SHASTRI NAGAR Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Retrieve Access Email Retrieve Success % Email Retrieve Delay SMS send Access SMS e2e Success % SMS send Delay (sec) Delivery Time (sec) MMS send Access MMS e2e Success % MMS send Delay Airtel 2G DOCOMO 2G VODAFONE 2G IDEA 2G Reliance EvDo TATA EVDO
5 5 100.00% 107.28 5 100.00% 16.72 5 100.00% 9.76 10 100.00% 7.4 3.67 5 100.00% 18.97
5 0 20.00% 0 5 100.00% 16.56 5 100.00% 15.67 10 100.00% 8.67 18.88 5 0.00% 0
5 5 100.00% 125.67 5 100.00% 13.89 5 100.00% 17.98 10 100.00% 4.7 11.22 5 20.00% 16.23
5 5 100.00% 76.34 5 100.00% 19.31 5 100.00% 12.76 10 100.00% 8.66 7.23 5 0.00% 0
5 5 100% 198.54 5 100.00% 18.23 5 100.00% 18.3 -
5 4 80% 156.77 5 100% 11.49 5 100% 18.88 -
Location 5: Sadar Bazar

SADAR BAZAR Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Retrieve Access Email Retrieve Success % Email Retrieve Delay SMS send Access SMS e2e Success % SMS send Delay (sec) Delivery Time (sec) MMS send Access MMS e2e Success % MMS send Delay Airtel 2G DOCOMO 2G VODAFONE 2G IDEA 2G Reliance EvDo TATA EVDO
5 5 100.00% 99.03 5 100.00% 12.74 5 100.00% 8.28 10 100.00% 6.3 5.43 5 60.00% 16.99
5 3 60.00% 92.76 5 100.00% 19.85 5 100.00% 9.1 10 100.00% 6.22 9.69 5 0.00% 0
5 5 100.00% 78.61 5 100.00% 17.45 5 100.00% 14.25 10 100.00% 8.59 10.41 5 0.00% 0
5 5 100.00% 89.09 5 100.00% 11.12 5 100.00% 10.21 10 100.00% 9.2 5.19 5 40.00% 21.48
5 5 100% 166.23 5 100.00% 16.8 5 100.00% 9.61 -
5 5 100% 196.56 5 100% 12.53 5 100% 6.1 -
Section 6
Summary
SWOT Analysis for Airtel Key findings
SWOT Analysis for Airtel

STRENGHTS Voice Quality Accessibility Retainability
Poor Email success rate as compared to other operators WEAKNESS HTTP browsing success rate is poor as www.zedge.net , www.nokia.com and www.cricinfo.com site was the Coverage most failed sites. FTP FTP DL success Low DL Throughput rate Ping delay Lowest call drop rate
THREATS OPPORTUNITIES
By improving HTTP statistics for few of the sites overall data score can be improved
Coverage improvement Download Throughput
Both Vodafone & Idea can take the lead by improving little coverage & quality and enjoy the facilities ping latency as compared to competitor Lowest of MNP
indicating lowest delay to access data network
Key Findings
Voice:
Speech Quality: Airtel is leading as per Speech Quality amongst all other operators. Data: GPRS utilization is high on Airtel compared to EDGE with other operators leading to lower FTP download throughput. Key Suggestions: Resource allocation (TS) need to be verified for optimum DATA usage. Coverage & Quality need to be looked upon in main city center (Cluster 5).

2g Meerut Report

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

2g Meerut Report

Uploaded by

Copyright:

Available Formats

Meerut 2G Benchmark Report

All Rights Reserved Alcatel-Lucent 2006, #####

Executive Summary Meerut

Details 3,447,405 272 km 1342 /km

Tech GSM GSM GSM GSM EVDO EVDO

*No of Cells is an indicative no the cells encountered during the drive

All Rights Reserved Alcatel-Lucent 2006, #####

All Rights Reserved Alcatel-Lucent 2006, #####

Benchmarking Equipment and Setup

All Rights Reserved Alcatel-Lucent 2006, #####

Data Collection Details

CL- 5 Sharma Nagar, Jawahar Nagar.

All Rights Reserved Alcatel-Lucent 2006, #####

Voice Testing Algorithm

Voice Test Algorithm

All Rights Reserved Alcatel-Lucent 2006, #####

Data Testing Algorithm

Data Test Algorithm

All Rights Reserved Alcatel-Lucent 2006, #####

Strategic Location Testing

All Rights Reserved Alcatel-Lucent 2006, #####

Benchmarking KPIs: Score Evolution

2 Here you find individual operators

All Rights Reserved Alcatel-Lucent 2006, #####

Voice & Data KPI weightages

*Coverage Calculation: Coverage = A%*10+B%*8+C%*6+D%*1 10

All Rights Reserved Alcatel-Lucent 2006, #####

Section 2 Management Summary

All Rights Reserved Alcatel-Lucent 2006, #####

Voice Quality Score

1 45 3.8 97% 3 6 4 3.6 2 3

Retainability,Accessibility Voice quality and coverage

CST= Call Setup Time CSSR= Call Setup Success Rate

CCR= Call Completion Rate

All Rights Reserved Alcatel-Lucent 2006, #####

MOS= Mean Opinion Score

Data Quality Score

Best Operator Overall

Vodafone among GSM Operators

All Rights Reserved Alcatel-Lucent 2006, #####

Section 3 Detailed Voice Analysis

Call Completion Success Rate

Accessibility V/s Retainability: Market Comparison Voice Quality: MOS

Airtel MOS Performance

Voice Codec Distribution Handover Analysis

All Rights Reserved Alcatel-Lucent 2006, #####

Voice Performance Analysis

Call Setup Success Rate:

Call Completion Success Rate:

Operator Airtel Docomo Vodafone Idea RCOM Tata

Accessibility Retainability Voice Quality Coverage 1 1 1 1 6 6 6 2 3 4 3 3 4 3 2 4 2 2 4 5 5 5 5 6

Ranking for Voice KPIs

All Rights Reserved Alcatel-Lucent 2006, #####

400000 350000 300000 250000 200000 150000 100000 50000 0

Tata CDMA Reliance CDMA Idea Vodafone Docomo

0 TO 65 65 TO 7575 TO 8585 TO 95 95 TO 105

All Rights Reserved Alcatel-Lucent 2006, #####

Coverage Legends -65<=x -75<=x<-65 -85<=x<-75 -95<=x<-85 -110<=x<-95

Need to look on the circled area

All Rights Reserved Alcatel-Lucent 2006, #####

Call Setup Time (CST)

Call Set up Time (PDF)

22.93 16.13 MIN MAX 4.74 Avg.

Coverage Calculation: Coverage = A%10+B%8+C%6+D%*1 10