Professional Documents
Culture Documents
PS Domain Analysis Guide PDF
PS Domain Analysis Guide PDF
Analysis Guide
November 2004
www.actix.com
The content of this manual is provided for information only, is subject to change without
notice, and should not be construed as a commitment by Actix. Actix assumes no
responsibility or liability for any errors or inaccuracies that appear in this documentation.
Copyright © Actix 2004-2008. All rights reserved. All trademarks are hereby acknowledged.
www.actix.com
Contents 2
1 INTRODUCTION .........................................................................................4
7 APPENDIX A.............................................................................................9
8 APPENDIX B.............................................................................................9
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Introduction 4
2
1 Introduction
For many operators, GPRS-based services are a key element of their strategies to boost
average revenue per user. The convergence of wireless networks and IP—not originally
conceived of as a wireless data protocol—brings a unique challenge to operators of GPRS
networks. As new services and devices for transmitting data are launched onto the market,
and traffic increases, more pressure will be placed on monitoring and optimizing GPRS
networks.
In the market there are many products that allow users to monitor radio or network
performance (drive test tools and protocol analyzers, although with poor KPIs creation and
troubleshooting capability), but none that combine that with a clear vision of the user
perception of services with the availability of indicators to dig down into the service
behavior. Actix Analyzer now supports GPRS and EDGE KPIs and detailed messaging,
thereby offering this functionality.
This document gives an insight into the structure of the new trackers, attributes and
events. It starts with an overview of the different levels of investigation, and goes on to
document the definition of the single parameters and processes. A full set of practical real-
life examples enable users to become confident with the new capabilities.
The final aim is to offer a level of detail that gives an unrivalled flexibility on the type of
analysis. Users will be able, in the same tool, to have a very high-level overview of service
utilization and user behavior, as well as to be able to do a very low-level drilldown on
messages belonging to a specific service or TCP/IP session.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Service analysis 5
2
2 Service analysis
Performance of data services depends on the interaction of many entities and different
protocol levels. Flexibility in data filtering and aggregation possibilities is necessary, so
Actix solutions allow:
• Data aggregation per single users, PdP Contexts, service sessions, single IP
connections and many others.
• Analysis from the service (HTTP, MMS etc.1) to TCP/IP transport layer and further
down to GPRS specific protocols.
1
The services that have predefined KPIs are: FTP, HTTP, MMS, WAP and ICMP. SMTP and POP3 are
decoded and listed in summary queries.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Aggregation levels and trackers 6
2
3 Aggregation levels and trackers
The aggregation of measurements to provide metrics can be done in two different ways:
The first case applies when we want to maximize the network performance and efficiency,
the second when we want to achieve an optimal user experience (QoS as perceived by the
customers). Of course, the best optimization needs to find the trade-off between the two.
This section specifies the trackers (i.e. identifiers attached to every message belonging to
the particular session) used to aggregate performance indicators, thus measuring the user
perception of services.
The following table lists all the available trackers and their applicability:
Tracker Um Gb Gn Gi Server
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Aggregation levels and trackers 7
• IP sniffer files, collected on any interface from R (between TE and MT) to the
2
server side2
• a complete e-mail
2
The traces outside the GPRS network must be based on a protocol stack similar to the Gi
interface.
3
For the complete list of protocol analyzers and interfaces supported see IVS release notes or
contact Actix support.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Aggregation levels and trackers 8
• TCP
• WTP
• ICMP
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Trigger points and Key Performance Indicators 9
2
4 Trigger points and Key Performance Indicators
Every entity defined above can be subdivided in a setup phase, an activity phase and a
release phase, and that applies to any investigation level.
For example, for the user level, the setup corresponds to the attach procedure, the activity
phase is the time where the user remains attached, and the release phase corresponds to
the detach procedure. At the lower level, the setup is, for instance, the signaling phase of
the HTTP protocol for a single object of a web page and the activity phase is the actual
object download.
The following diagrams (Figure 1, Figure 2 and Figure 3) define the:
• Trigger points for the different events (set-up, data transmission and release
phase, when applicable).
• Measurements and KPIs available in the different phases (signaling times, success
and failure events, data volumes and throughput, retransmissions, durations).
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Trigger points and Key Performance Indicators 10
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Trigger points and Key Performance Indicators 11
• Measurements (like delta and cumulative packets, bytes, throughput with and
without retransmissions, times).
• Events and events’ time (also failure causes are included here).
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Trigger points and Key Performance Indicators 12
Every level sets similar names for these parameters (the prefix distinguish them). That
gives a broad, comprehensive and easy-to-understand set of KPIs or attributes that can be
aggregated in KPIs. Reports and queries can be designed on top of them. Appendix A gives
details for every single indicator definition, while in Appendix B the formula of every single
aggregated value is provided.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 13
2
5 Analysis examples
This section provides example analyses using the indicators and trackers presented in the
previous sections. The aim is to show how it is possible to use the information described in
the previous sections to:
• Provide a statistical view of the content of the traces (users, traffic, events etc.).
• Drill down into the causes and circumstances that generated the problems.
The queries presented below can be also used to generate a summary report, since they
provide information on all levels:
• Subscriber
• PdP Context
• Service
• Task
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 14
The first query gives statistics of the attached subscribers (124 unique IMSIs4 are in the
trace):
2
Clicking on the query “Active subscribers per application”, we can see that only 5 of them
are active5 in the trace (one using FTP, generating most of the data volume, and the
others doing WAP):
4
Sometimes the traces contain only parts of user sessions (for example they do not include the
attach or the PdP Context activation); Analyzer tracks the sessions anyway but assigns progressive
internal identifiers, substituting the IMSI if it is found at some point in the trace, otherwise leaving
the internal ID.
5
A subscriber or other dimension is defined “Active” when at least one packet is transmitted
during the session.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 15
With the query “Active Context per trace”, we get the list of active PdP Contexts:
Any of these queries can be used to filter on a specific quantity (a subscriber or a context)
for more detailed analysis.
Using the queries activated by the scenarios, it is also possible to extract the subscribers in
separate sub-streams. See the IVS release notes and online help for details.
A second step in the analysis is given by the queries on service, task or packet level.
The service summary shows the events and data throughput and volumes. It is clear from
it that most of the sessions, although generating traffic, have been abnormally terminated
(see statistic “# Service abort”):
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 16
We need then to have a better insight on the causes, selecting the query “Subscriber and
service report”:
2
From that we can appreciate not only the causes of the aborts, but also KPIs like the time
taken to connect to the server, the total duration of the connection, or the part dedicated
only to data transfer (thus cutting out the idle time and signaling), so that usage patterns
can be identified.
Scrolling on the right, we can see all the other KPIs (throughput values, data volumes and
retransmissions, in number of packets and percentage):
The throughput values represent the throughput average of the single tasks. The “Service
summary” query includes also the average of all the single throughput measurements
during the service (so the longest tasks have a higher influence on the resulting value,
whilst in the first case they all contribute in the same way).
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 17
In this case, the task level is not adding a lot, because there is a single download per
connection to the FTP server (that is not true in case of mget or mput with multiple files),
and the cause of abort is still the Packet Data Session Ended:
2
We have seen how to summarize in a single click the content of the trace, and then to
refine the statistics to a higher level of detail.
There are some problems related to the services used in the file so the investigation can
proceed with a drill-down. The follow-up of the investigation (possible in the same session)
will be performed in the next sections (5.2 and 5.3).
…of which 33 are active (31 on HTTP and 2 doing Pings, next picture). The logged trace is
quite short; one effect of this is that there are many sessions, of which the start of
signaling and data transfer is tracked, but not the conclusion (that explains the
discrepancy between the counters).
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 18
From the PDP Context query, we can see that there several open contexts for other
services, but they are not active in the trace (no packets are tracked):
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 19
If we analyze the WAP sessions, we can see that 3 of them are aborted because of a
connection redirect:
2
For a drill-down, “Packet report” query can be selected and a single WAP session filtered:
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 20
Then tables using WSP and WTP attributes and the Protocol Stack Browser can be used:
We can see that there are two Service Session Starts, but only one Service Session End.
Also, we find that Service Abort has happened. When we open individual FTP Sessions
(Figure 19), we find two Service Sessions. The first Service Session ends correctly, but the
second one has no Service End but a Service Abort. Let’s focus on the second Service
Session.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 21
We can use the filter functionality of the Statistic Explorer to narrow down the analysis to
the messages of the second Service Session. Let’s use the Service report query to
investigate that Service Session. From that query, we can see that the cause of abort was
“Packet Data Session Ended”6 (Figure 20).
The next step is to investigate individual tasks, and find out which task caused the
problem. From the Task report (Figure 21) view, we see that there are three FTP tasks,
and one of these is aborted. Also, other information on tasks is presented, although we will
not consider it in this analysis.
We will go further down to the packet level using a Packet report query. We can see that
the initiator of the abort was the FTP Server (Figure 22).
6
Another possible cause for abort is “Task Session Timeout”.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 22
Using Internet level attributes and the Protocol Stack Browser, we can investigate at a
more detailed level what really happened (Figure 23). The FTP Client has asked to store a
file (FTP_Event = STORE), and a new TCP Data connection was opened. TCP_Event_ID
2
attribute describes how TCP connection proceeds. Here we can see that there has been
normal data transfer, one retransmission and then the FTP server sends an abort.
Checking that packet from the Protocol Stack Browser, we can see that the TCP Reset bit is
set. By this way, it is possible to investigate all aspects of TCP level, and if necessary, go
still further down to IP level.
The event engine uses internal Event Diagrams to generate application level information
and events. Diagrams calculate part of attributes and events, but they are also a visual aid
to internal troubleshooting. For example, to find out how FTP Session proceeds, FTP
Diagram shows main states and transitions between states (Figure 24). There are
diagrams for Service and Task Sessions too, so one can start the investigation using these
diagrams, and proceed to lower levels if necessary. In this example, one may notice that
an Abort happens from the Transfer state to the End State, which means that whole FTP
Session is aborted. If the transition was from the Transfer state to the Ready state, only
that particular task was aborted (e.g. the user cancelled the current file download).
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 23
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 24
When scrolling the same query to the right, we can check the throughput values, both
including retransmissions and without retransmission. We can see that there is some
difference between these values, and if we check retransmission percentages, we see that
the first HTTP session has 0.30 % of packets retransmitted (Figure 26). The second
session is free of retransmissions.
After that, we can use Task level query to find out which tasks have had problems. Then
we can open a chart with the attribute Packet_Evt_Packet_Retransmitted. There are 10
retransmissions, but most of them occurred on the signaling phase, so they are not taken
into account when calculating the number of Service Packets and Bytes. Let’s zoom to the
task that we found had retransmissions (Figure 27). Using tables, charts and the Protocol
Stack Browser, we can see when retransmissions happened, in which session and task,
and also investigate particular IP packets if necessary.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 25
In this case there were only three retransmissions, which do not cause any significant
quality degradation to the end user. Anyway, in this way it is possible to focus on the
problematic tasks and analyze these only.
Another useful attribute is to use round trip time measurements: Packet_RTT_Server_Side
and Packet_RTT_Mobile_Side (Figure 28).
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Analysis examples 26
From this chart, we can see what the response times are. Since the logfile is captured on
Mobile Site, response times are short. From Server Side RTT we can see quite constant
response time, with some peaks, which can be due network delay or the server has been
busy. Every user can define some ideal threshold for the parameters and use them as
benchmarking to highlight a critical performance.
Although this specific trace shows no big problems, the process shown can be applied to
spot abnormal patterns and drill down to the root cause.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
27
UMTS
6.1 Introduction
Three event diagrams handle the PS NAS signaling and associated procedures for UMTS.
The events apply to radio interface logs only (e.g. drive test logs).
PMM Î PS Signaling Connection monitoring
GMM Î PS Mobility Management monitoring
SM Î Session Management monitoring
There are three new corresponding event diagrams (.aev), format groups (.xml), and
attributes (.xml) files.
There are also changes to some of the already existing files, mainly due to the fact that
some old attributes in the UMTS.xxx are now moved to the above new files, with the
intention of including the PS properties (attributes, format groups) in the specific PS files
rather than keep them in the more general UMTS files.
Description of events, attributes and values are specified in the relevant sections below.
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
28
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
29
While on the radio side the RRC Connection is shared between CS and PS Signaling
connections, on the Iu interface side the Iu resources are logically separated.
The PS signaling connection establishment is always initiated by the UE via:
RRC: Initial Direct Transfer with PS domain indication
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
30
1
Only if RB Release is used RRC: Signaling Connection Release Request with PS domain
indication
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
31
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
32
• PS Attach
• PS Detach
PS Attach
A PS Attach is always initiated by the UE via:
Attach Request
The message is included either in RRC:Initial Direct transfer or in RRC:Uplink Direct
Transfer messages.
Successful PS Attach
Note that in case of missing reply to Attach Request, the UE should re-send the message,
up to a total of 4 re-transmissions. The same mechanism is used by the SGSN to supervise
the reply (when expected) to Attach Accept.
The PS Attach procedure can fail for several reasons, the most common of which are
detected by the GMM Event diagram and listed below (see the table of attributes for more
details):
PS Detach
A UE can be PS detached explicitly (the procedure can be initiated by either the UE or the
SGN) or implicitly (normally by the SGSN only)
The GMM Event diagram can only detect an explicit PS Detach procedure; regardless of the
initiating node, the explicit PS Detach is triggered by:
Detach request
The message is included either in RRC:Initial Direct Transfer or in RRC:Uplink Direct
Transfer messages if UE initiated, in a RRC:Downlink Direct Transfer if SGSN initiated.
1 Only if P-TMSI is included in Attach Accept message
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
33
Successful PS Detach
2
The failure scenarios covered by the Event Diagram occur only in case of UE initiated
Detach without power-off:
• The network release the underlying RRC connection instead of accepting the
Detach request
RRC Connection
RAU complete1
Iu procedures
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
34
Except for “Network Failure” reasons, when a RAU fails the UE is still considered PS
Attached. The diagram is a simplified interpretation of the 3GPP specs (24.008), where
more specific failure scenarios are specified. However, all of the most common scenarios
are covered. 2
6.4.1 SM procedures
As in GMM most of the SM procedures are common to UMTS and GPRS. This initial version
of SM event diagram is focused on UMTS events; in most of the inter-system (3G ÅÆ2.5G)
handover scenarios also some GPRS events are considered. However the Event diagram
set only UMTS attributes.
The following procedures are analyzed:
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
35
• Although the Event Diagram can trace the number of PDP Contexts simultaneously
active for the UE, there is no differentiation between primary and secondary
contexts 2
PDP Context Activation
Both UE and SGSN can ask for the activation of a Primary PDP Context. Only the UE can
ask for the activation of a Secondary PDP Context.
The UE can have a PDP Context only if is PS Attached.
RRC Connection
Iu procedures
• Activation request not replied by the SGSN (after the 5th attempt)
• Activation request not sent by UE following SGSN initiation (after the 5th attempt)
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
36
• The first event usually detected by the SM Event Diagram is a PDP context
Activation with UE in UMTS coverage. However, the diagram also recognizes:
▫ A PDP context deactivation (from UMTS). This may occur if the logs start
with the UE already having an active PDP context.
▫ An inter-RAT Cell Change Order from UTRAN, which causes a UMTS J
GPRS transition for a UEs in Cell_DCH or Cell_FACH state.
▫ A GPRS J UMTS transition. In this case, it is always assumed that only one
PDP Context is active at the time the transition occurs. Moreover the GPRS
SM/GMM activity eventually occurring before the transition is not taken
into account.
• Just like during UMTS coverage the number of PDP Contexts active in GPRS is
tracked, although such information is not displayed until the UE returns to UMTS
coverage. Throughout the GPRS session only, an “in GPRS” flag will appear. No
attributes are displayed for SM events occurring in GPRS.
However, once the UE is in GPRS mode, the following GPRS NAS procedures are
detected:
▫ PDP context Activation/Deactivation
▫ PS Detach
▫ PS Attach
The detection of the above procedures in GPRS is fundamental in order to keep
track of the correct number of PDP Contexts active when the UE returns eventually
to 3G.
• The SM diagram takes into account the following inter-system handover and cell
re-selection procedures:
▫ Inter-RAT Cell Change Order from UTRAN (UMTS Q GPRS)
▫ Inter-RAT Handover to UTRAN (GPRS Q UMTS)
▫ Inter-RAT Cell Re-Selection to UTRAN (GPRS Q UMTS)
▫ Inter-RAT Cell Change Order to UTRAN (GPRS Q UMTS)
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
37
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
38
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Additional Radio Events for the PS domain in UMTS
39
1 PDP
2
.. Number of PDPs active
3 PDPs
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 40
2
7 Appendix A
Subscriber Session
Event
Event Times
Context Session
Event
Event Times
Service Session
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 41
Measure
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 42
Event
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 43
Event Times
2
Service_Time_Start_Session The time of Relative millisec
Service_Evt_Start_Session
Task Session
Measure
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 44
Event
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 45
Event Times
2
Task_Time_Start_Session Time of Task_Evt_Start_Session Time
Packet Session
Measure
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 46
Event
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix A 47
Event Initiator
Event Times
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix B 48
2
8 Appendix B
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix B 49
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix B 50
www.actix.com
Actix Analyzer PS Domain November 2004 Analysis Guide Appendix B 51
4103, 4128
www.actix.com