You are on page 1of 34

3G Benchmarking in Taipei City

FET vs. TCC

July, 2005
Testing Equipment

• 4 x USIM
–3 x FET USIM
–1 x TCC USIM
2005-08-02
2
Equipment Listing
• 1 x laptop with P4 2G Hz processor and 1G Bytes RAM
• 1 x TEMS Investigation Set consisting of:
– 1x TEMS Investigation hardware lock
– 2x Moto A835 UEs with connecting cables and charger
– 1x GPS with external antenna and connecting cables
– 1x AC/DC converter

• 2 x SE Z1010 UE supporting video calls to act as B-party during


video call test
• 4 x USIM
– 3 x FET USIM
– 1 x TCC USIM

2005-08-02
3
Drive Test Route

2005-08-02
4
Benchmarking
Network Status
Network Status FET-ERICSSON TCC-Nokia
Nokia-Siemens-Nokia in
North Taipie
RAN-MSC-GSN All Ericsson All Nokia in South Taipei
(The border is Civic
Boulevard)
RAN Release P 3.0.4 R 1.5

2005-08-02
5
Benchmarking
Coverage status
• From PS Long Call

RF Enviroment FET-ERICSSON TCC-Nokia

CPICH RSCP Average (dBm) -73.37 -70.35

CPICH Ec/Io Average (dB) -5.63 -5.57

• FET-Ericsson network set CPICH power is 27 dBm, TCC-Nokia is 30 dBm

RF Enviroment FET-ERICSSON TCC-Nokia

AS SC count 148 146

• From Video Long Call

Active Set Size Distribution (%) FET-ERICSSON TCC-Nokia

Active Set Size = 1 ( % ) 38.4 47.3

Active Set Size = 2 ( % ) 32.2 35.9

Active Set Size = 3 ( % ) 29.4 16.7

• TCC-Nokia site density is less than FET-Ericsson

2005-08-02
6
Testing items
• PS Long Call
– Download 500 Mbytes file from public FTP server:
FTP.NCTU.EDU.TW
• PS Short Call
– Download 300 kbytes file from public FTP server:
FTP.NCTU.EDU.TW
• Video Long Call
– Moving FET (Moto A835) to Stationary FET (SE Z1010)
– Moving TCC (Moto A835) to Stationary FET (SE Z1010)
• Video Short Call
– Stationary FET ( SE Z1010) to Stationary TCC (Moto A835)
– Stationary TCC ( SE Z1010) to Stationary FET (Moto A835)
• Voice Short Call
– Moving FET (Moto A835) to FET fix line testing number: 02-
29505578
– Moving TCC (Moto A835) to TCC fix line testing number: 5899

2005-08-02
7
PS Long Call FTP DL Test
FET-Ericsson RLC Throughput

2005-08-02
8
PS Long Call FTP DL Test
TCC-Nokia RLC Throughput

2005-08-02
9
PS Long Call FTP DL Test
• User Throughput Perception-1

Application status FET-ERICSSON TCC-Nokia

Total FTP session time (mins) 134.30 131.43

Radio Bearer Distribution FET-ERICSSON TCC-Nokia

PS64/64 ( % ) 2.29 0.00

PS64/128 ( % ) 19.29 13.35

PS64/384 ( % ) 78.37 86.58

RACH/FACH ( % ) 0.05 0.06

•Two channel switch modes can be set in Nokia network, one is common->64->128-
>384, the other one is common->128->384.
• TCC-Nokia selected second mode that is no up-switch RAB 64 .

2005-08-02
10
PS Long Call FTP DL Test
• User Throughput Perception-2
Packet Switched
Throughput FET-ERICSSON TCC-Nokia
Average DL RLC Throughput
during drive test ( kbps ) 291.15 222.44
Overall DL RAB Utilization on
DCH ( % ) 91.77 66.99

PS RABs Throughput
Analysis FET-ERICSSON TCC-Nokia
Mean RLC Throughput in
PS64/64 RAB ( Kbps ) 55.97 0.00
Average DL RAB Utilization in
PS 64/64 ( % ) 83.30 0.00
Mean RLC Throughput in
PS64/128 RAB ( Kbps ) 130.56 105.16
Average DL RAB Utilization in
PS 64/128 ( % ) 97.14 78.24
Mean RLC Throughput in
PS64/384 RAB ( Kbps ) 365.14 261.08
Average DL RAB Utilization in
PS 64/384 ( % ) 90.56 64.75

2005-08-02
11
PS Long Call FTP DL Test
•PS long call observation-1
• TCC-Nokia RAN can support channel switching between
RAB128/384 directly

2005-08-02
12
PS Long Call FTP DL Test
•PS long call observation-2
• TCC-Nokia RAN doesn’t support RAB 64 (SF=32)

• FET-Ericsson RAN support RAB 64/128/384

2005-08-02
13
PS Long Call FTP DL Test
•PS long call observation-3
• FET-Ericsson peak throughput is fluctuating

• TCC-Nokia peak throughput is relative stable


2005-08-02
14
PS Long Call FTP DL Test
•PS long call observation-4
• However there was around 64 minutes drive test period in TCC-Nokia
network occurred fluctuating throughput during RAB 384 and RF
environment still good.

2005-08-02
15
PS Long Call FTP DL Test
• User Retainability Perception
User Retainability
Perception FET-ERICSSON TCC-Nokia
Packet Switched Minutes per
dropped 67.15 21.91

# of Session Dropped 1 5

2005-08-02
16
PS Long Call FTP DL Test
Summary:
• FET-Ericsson network performed better mean throughput,
RAB utilization and Retainability
• Two channel switch modes can be set in Nokia network,
one is common->64->128->384 as Ericsson, the other one
is common->128->384. TCC-Nokia selected second mode
that is no up-switch RAB 64.
• TCC-Nokia network performed strong peak throughput but
not stable
• TCC-Nokia network more often triggered RAB 384 but
utilization is not efficient -> Congestion ?

2005-08-02
17
Testing items
• PS Long Call
– Download 500 Mbytes file from public FTP server:
FTP.NCTU.EDU.TW
• PS Short Call
– Download 300 kbytes file from public FTP server:
FTP.NCTU.EDU.TW
• Video Long Call
– Moving FET (Moto A835) to Stationary FET (SE Z1010)
– Moving TCC (Moto A835) to Stationary FET (SE Z1010)
• Video Short Call
– Stationary FET ( SE Z1010) to Stationary TCC (Moto A835)
– Stationary TCC ( SE Z1010) to Stationary FET (Moto A835)
• Voice Short Call
– Moving FET (Moto A835) to FET fix line testing number: 02-
29505578
– Moving TCC (Moto A835) to TCC fix line testing number: 5899

2005-08-02
18
PS Short Call FTP DL Test
•User Accessibility Perception

User Acessibility Perception FET-ERICSSON TCC-Nokia


PDP Context Activation Success
Rate ( % ) 100.0 98.3
Average PDP Context Activation
Setup Time ( Sec ) 1.58 1.29

2005-08-02
19
PS Short Call FTP DL Test
•PS short call observation
• To compare the PDP context activation process, FET-ERICSSON
network performed more steps “Radio Bearer Reconfiguration” and it
costs approximate 0.3~0.5 seconds to activate PDP context

FET-ERICSSON TCC-Nokia

2005-08-02
20
PS Short Call FTP DL Test
Summary:
• FET-Ericsson network performed better accessibility up to
100%

• TCC-Nokia network occurred two times “network out of


order” result in 98.3% access rate -> GSN down in next
whole day

• TCC-Nokia network performed 0.5 sec quicker PDP


context activation time due to less steps to complete
activation process

2005-08-02
21
Testing items
• PS Long Call
– Download 500 Mbytes file from public FTP server:
FTP.NCTU.EDU.TW
• PS Short Call
– Download 300 kbytes file from public FTP server:
FTP.NCTU.EDU.TW
• Video Long Call
– Moving FET (Moto A835) to Stationary FET (SE Z1010)
– Moving TCC (Moto A835) to Stationary FET (SE Z1010)
• Video Short Call
– Stationary FET ( SE Z1010) to Stationary TCC (Moto A835)
– Stationary TCC ( SE Z1010) to Stationary FET (Moto A835)
• Voice Short Call
– Moving FET (Moto A835) to FET fix line testing number: 02-
29505578
– Moving TCC (Moto A835) to TCC fix line testing number: 5899

2005-08-02
22
Video Long Call Test
• User Retainability Perception
User Retainability Perception FET-ERICSSON TCC-Nokia

Average Minute Per Drop ( mins ) 28.8 12.3

Total Number of Dropped Call 3 5

•Most of dropped calls in two networks are due to suddenly Ec/No drop in
fast moving or poor coverage -> Basic RAN Tuning jobs

2005-08-02
23
Video Long Call Test
Summary:
• FET-Ericsson network performed better retainability than
TCC-Nokia network did

• Most of dropped in two networks are due to


suddenly Ec/No drop in fast moving or poor
coverage

2005-08-02
24
Testing items
• PS Long Call
– Download 500 Mbytes file from public FTP server:
FTP.NCTU.EDU.TW
• PS Short Call
– Download 300 kbytes file from public FTP server:
FTP.NCTU.EDU.TW
• Video Long Call
– Moving FET (Moto A835) to Stationary FET (SE Z1010)
– Moving TCC (Moto A835) to Stationary FET (SE Z1010)
• Video Short Call
– Stationary FET ( SE Z1010) to Stationary TCC (Moto A835)
– Stationary TCC ( SE Z1010) to Stationary FET (Moto A835)
• Voice Short Call
– Moving FET (Moto A835) to FET fix line testing number: 02-
29505578
– Moving TCC (Moto A835) to TCC fix line testing number: 5899

2005-08-02
25
Video Short Call Test
• Due to only one TCC USIM available for benchmark test, the 10 inter-
network MT calls were tested for each network and the MT call setup
time only calculate from “Paging Type 1” to “Alerting”.
FET-ERICSSON TCC-Nokia

2005-08-02
26
Video Short Call Test
•User Accessibility Perception

User Acessibility
Perception FET-ERICSSON TCC-Nokia
MT Call Setup
Successful Rate (%) 100.0 90.9
Ave user Call Setup
Time (sec) 2.47 4.30

• TCC-Nokia network occurred one block call (RRC connection reject due to
congestion)

• Call setup time is from system paged UE to UE ringing. The video display on UE
screen takes extra 3~5 seconds

2005-08-02
27
Video Short Call Test
Summary:
• FET-Ericsson network performed better accessibility and
call setup time than TCC-Nokia network
• FET-Ericsson network performed “Authentication” in
each call setup but TCC-Nokia network skipped
• TCC-Nokia network occurred one block call (RRC
connection reject due to congestion)

2005-08-02
28
Testing items
• PS Long Call
– Download 500 Mbytes file from public FTP server:
FTP.NCTU.EDU.TW
• PS Short Call
– Download 300 kbytes file from public FTP server:
FTP.NCTU.EDU.TW
• Video Long Call
– Moving FET (Moto A835) to Stationary FET (SE Z1010)
– Moving TCC (Moto A835) to Stationary FET (SE Z1010)
• Video Short Call
– Stationary FET ( SE Z1010) to Stationary TCC (Moto A835)
– Stationary TCC ( SE Z1010) to Stationary FET (Moto A835)
• Voice Short Call
– Moving FET (Moto A835) to FET fix line testing number: 02-
29505578
– Moving TCC (Moto A835) to TCC fix line testing number: 5899

2005-08-02
29
Voice Short Call Test
•User Accessibility Perception
User Acessibility
Perception FET-ERICSSON TCC-Nokia
Call Setup Successful
Rate (%) 97.8 86.3
Ave user Call Setup Time
(sec) 2.58 4.30

2005-08-02
30
Voice Short Call Test
•Block call reason
TCC-Nokia
FET-ERICSSON
Distribution chart of Access Failures
Blocked Call Classification Total
10.0%
No Setup 2 10.0%
40.0%
N300 and T300 Expiry 1
10.0%
Total 3
20.0%
10.0%

Distribution chart of Access Failures


No RRC Connection Setup RRC Connection Reject
No Alerting or Connect No Setup
No Radio Bearer Setup Complete N300 and T300 Expiry

33.3% Blocked Call Classification Total


No RRC Connection Setup 2
RRC Connection Reject 2
No Alerting or Connect 2
66.7% No Setup 4
No Radio Bearer Setup
Complete 2
N300 and T300 Expiry 8
No Setup N300 and T300 Expiry Total 20

2005-08-02
31
Voice Short Call Test
Summary:
• FET-Ericsson network performed better accessibility and
call setup time than TCC-Nokia network
• FET-Ericsson network performed “Authentication” in
each call setup but TCC-Nokia network skipped
• TCC-Nokia network occurred two block call (RRC
connection reject due to congestion)

2005-08-02
32
Benchmarking
Summary:
• Advantage
– FET-Ericsson performed better accessibility, retainability, integrity
and channel utilization for PS, video and voice
• Improvement area
– TCC-Nokia network performed strong peak throughput -> How to
archive maximized peak throughput ?
– GPI PS module is tuning RF part but not include IuPS, Gi, Iub,
GSN… optimize -> End to end service ?

• TCC-Nokia network occurred RRC connection reject due to


congestion
– Could be product/tuning problem since not too many users now
– Central FET-Nokia RF engineer also observed congestion and the
excuse is all about Ericsson CS network

2005-08-02
33
2005-08-02
34