You are on page 1of 24

nGenius Business Analytics

CEI User Guide


C E IUs e r Gu id e

Software Version 6.3


Rev. 001

April 2020

© NETSCOUT CONFIDENTIAL & PROPRIETARY


Ver. 6.3 | April 2020
992-0695-08 Rev. 001

Use of this product is subject to the End User License Agreement available at http://www.NetScout.com/legal/terms-and-
conditions or which accompanies the product at the time of shipment or, if applicable, the legal agreement executed by and
between NetScout Systems, Inc. or one of its wholly-owned subsidiaries ("NETSCOUT") and the purchaser of this product
("Agreement").

Government Use and Notice of Restricted Rights: In U.S. government ("Government") contracts or subcontracts, Customer will
provide that the Products and Documentation, including any technical data (collectively "Materials"), sold or delivered pursuant
to this Agreement for Government use are commercial as defined in Federal Acquisition Regulation ("FAR") 2.101and any
supplement and further are provided with RESTRICTED RIGHTS. All Materials were fully developed at private expense. Use,
duplication, release, modification, transfer, or disclosure ("Use") of the Materials is restricted by the terms of this Agreement and
further restricted in accordance with FAR 52.227-14 for civilian Government agency purposes and 252.227-7015 of the Defense
Federal Acquisition Regulations Supplement ("DFARS") for military Government agency purposes, or the similar acquisition
regulations of other applicable Government organizations, as applicable and amended. The Use of Materials is restricted by the
terms of this Agreement, and, in accordance with DFARS Section 227.7202 and FAR Section 12.212, is further restricted in
accordance with the terms of NETSCOUT'S commercial End User License Agreement. All other Use is prohibited, except as
described herein.

This Product may contain third-party technology. NETSCOUT may license such third-party technology and documentation ("Third-
Party Materials") for use with the Product only. In the event the Product contains Third-Party Materials, or in the event you have
the option to use the Product in conjunction with Third-Party Materials (as identified by NETSCOUT in the Documentation
provided with this Product), then such third-party materials are provided or accessible subject to the applicable third-party terms
and conditions contained either in the "Read Me" or "About" file located in the Software or on an Application CD provided with
this Product, or in an appendix located in the documentation provided with this Product. To the extent the Product includes
Third-Party Materials licensed to NETSCOUT by third parties, those third parties are third-party beneficiaries of, and may enforce,
the applicable provisions of such third-party terms and conditions.

Open-Source Software Acknowledgement: This product may incorporate open-source components that are governed by the GNU
General Public License ("GPL") or licenses that are compatible with the GPL license ("GPL Compatible License"). In accordance
with the terms of the GNU GPL, NETSCOUT will make available a complete, machine-readable copy of the source code
components of this product covered by the GPL or applicable GPL Compatible License, if any, upon receipt of a written request.
Please identify the product and send a request to:

NETSCOUT SYSTEMS, INC

GNU GPL Source Code Request


310 Littleton Road
Westford, MA 01886
Attn: Legal Department

CEI User Guide 2


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020
992-0695-08 Rev. 001

To the extent applicable, the following information is provided for FCC compliance of Class A devices:

This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the
FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is
operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required
to correct the interference at their own expense.

Modifications to this product not authorized by NETSCOUT could void the FCC approval and terminate your authority to
operate the product. Please also see NETSCOUT's Compliance and Safety Warnings for NetScout Hardware Products
document, which can be found in the documents accompanying the equipment, or in the event such document is not
included with the product, please see the compliance and safety warning section of the user guides and installation
manuals.

No portion of this document may be copied, photocopied, reproduced, translated, or reduced to any electronic medium or
machine form without prior consent in writing from NETSCOUT. The information in this document is subject to change without
notice and does not represent a commitment on the part of NETSCOUT.

The products and specifications, configurations, and other technical information regarding the products described or referenced
in this document are subject to change without notice and NETSCOUT reserves the right, at its sole discretion, to make changes at
any time in its technical information, specifications, service, and support programs. All statements, technical information, and
recommendations contained in this document are believed to be accurate and reliable but are presented "as is" without
warranty of any kind, express or implied. You must take full responsibility for their application of any products specified in this
document. NETSCOUT makes no implied warranties of merchantability or fitness for a purpose as a result of this document or
the information described or referenced within, and all other warranties, express or implied, are excluded.

Except where otherwise indicated, the information contained in this document represents the planned capabilities and intended
functionality offered by the product and version number identified on the front of this document. Screen images depicted in this
document are representative and intended to serve as example images only.

Copyright NETSCOUT 2009-2020. All rights reserved.

992-0695-08-001

CEI User Guide 3


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Table of Contents
C E IUs e r Gu id e 1

T a b le o fC o n te n ts 4

What's New in nGenius Business Analytics 6.3 CEI Module User Guide 6

Revision History 7
1 CEI Module Overview 8
2 Accessing the CEI Module Application 9
2.1 CEI User Privileges 9
2.2 Accessing the CEI Application from the Launch Pad 10
3 Using the CEI Application 11
3.1 The CEI Summary Tab 12
3.1.1 Overall Voice Score 12
3.1.2 Overall Data Score 12
3.1.3 Voice Subscriber KQIs 13
3.1.4 Data Subscriber KQIs 13
3.1.5 Voice Network KQIs 13
3.1.6 Data Network KQIs 13
3.1.7 Used Handsets 13
3.2 The CEI Voice Tab 14
3.2.1 Overall Voice Score 14
3.2.2 Subscriber KQIs 15
3.2.3 Network KQIs 15
3.2.4 Threshold Breaches 15
3.2.5 Call Attempts 15
3.2.6 Top Responses 15
3.2.7 Top Call Drop Locations 16
3.3 The CEI Data Tab 16
3.3.1 Overall Data Score 16
3.3.2 Subscriber KQIs 17
3.3.3 Network KQIs 17

CEI User Guide 4


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020
992-0695-08 Rev. 001

3.3.4 Threshold Breaches 17


3.3.5 Data Usage 18
3.3.6 Top Locations 18
3.4 Creating Custom Views 18
A Appendix A – CEI Metrics 19
A.1 CEI Voice Metrics 20
A.2 CEI Data Metrics 22

CEI User Guide 5


© NETSCOUT CONFIDENTIAL & PROPRIETARY
What's New in nGenius Business
Analytics 6.3 CEI Module User Guide
FID Description

CEI User Guide 6


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Revision History
The revision history shows the documentation updates for this release. These updates include new
features and changes to existing features. They also include changes resulting from documentation
requests and issues.

Date Revision Reference Summary


April 2020 001 - Initial Release

CEI User Guide 7


© NETSCOUT CONFIDENTIAL & PROPRIETARY
1 CEI Module Overview
The optional nBA CEI (Customer Experience Indicator) Module automates understanding of the
customer experience and the services they consume by providing ‘happiness’ indicators which reflect
the user’s perception of the service they receive.

Comprising a smart data set and application, it dynamically calculates overall experience ‘scores' --,
key quality indicators and service threshold breaches relating to accessibility, retainability, mobility
and QoE across multiple dimensions. This avoids the need to manually interpret and correlate
multiple metrics from across services. Understanding the experience of groups of users, with given
devices in different locations, can aid churn reduction initiatives.

Predefined application dashboards are available for understanding the voice and data experience of
an individual subscriber, including where and when customers are having poor experiences with
VoLTE and Data. Users with appropriate privileges can create their own views of the data by copying
and editing the default application template.

If you want to know about... Refer to...


Accessing the CEI Module Application Section 2 Accessing the CEI Module Application
Using the CEI Module Application Section 3 Using the CEI Application
Creating custom views Section 3.4 Creating Custom Views
CEI Module Data Set Section A Appendix A – CEI Metrics

CEI User Guide 8


© NETSCOUT CONFIDENTIAL & PROPRIETARY
2 Accessing the CEI Module Application
This section explains how to access the optional CEI module application and the privileges required
to use it.

2.1 CEI User Privileges


Your administrator will need to give you a role with the nGenius Business Analytics and nBA – Allow
CEI Viewer privileges. These privileges allow you to access the CEI Module Application.

Note: This privilege must be granted by the administrator on nCM/nG1.

Additional privileges provide specific access to different areas of the CEI Application.

Privilege Description
nBA – Allow CEI Viewer This privilege allows you to access the CEI Module
Application.
nBA – Allow access to Explorer Dashboard Edit You can create and delete dashboards that you have
built.
nBA – Allow Explorer access to display IMSI data You can see the IMSI value displayed.
nBA – Allow Explorer access to display MSISDN You can see the MSISDN value displayed.
data
nBA – Allow access to Explorer Mapping and You can access the Configuration tab to map fields and
Exception Rule configuration create exception reports.

Note: Only the NETSCOUT Administrator is permitted to access the Metric Builder and Data Browser
in the CEI Application.

CEI User Guide 9


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 2  Accessing the CEI Module Application
992-0695-08 Rev. 001

2.2 Accessing the CEI Application from the Launch Pad


1. The Launch Pad application is accessible via:
https://<haproxy_host>:8443/portal
2. The Launch Pad login window is initially displayed:

3. Once logged in, you should see the main Launch Pad page. Based on licenses and privileges,
various modules will be displayed. Click on ‘CEI’ to launch the CEI application.

CEI User Guide 10


© NETSCOUT CONFIDENTIAL & PROPRIETARY
3 Using the CEI Application
The CEI application includes three default dashboard views of the subscriber experience:

l The CEI Summary tab provides a high-level summary dashboard view of the customer’s
experience of voice and data. The ‘scores’ and red/amber/green indicators quickly tell you
whether the subscriber has voice or data issues and how they compare to the network
average.
l The CEI Voice tab provides a more focused view of the experience of the VoLTE service. It
automatically identifies voice service threshold breaches, for example, dropped calls and when
and where they occurred.
l The CEI Data tab provides a more focused view of the experience of the data service. It
automatically identifies data service threshold breaches, for example, low throughput and
when and where they occurred.

Users with appropriate privileges can create their own views of the data by copying and editing the
above. See Section 3.4 Creating Custom Views for more details on creating custom views.

CEI User Guide 11


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.1 The CEI Summary Tab


The CEI Summary tab provides a high-level summary dashboard view of the customer’s experience
of voice and data. The ‘scores’ and red/amber/green indicators tell you whether the subscriber has
voice or data issues and how they compare to the network average.

The following image shows the main CEI Summary tab.

The view comprises:

l Overall Scores for Voice and Data


l Voice and Data Key Quality Indicators
l KQI comparison with Network averages
l The handsets used by the customer

Use the Global Filter to select time range and enter the IMSI of the subscriber of being investigated.

3.1.1 Overall Voice Score


This chart provides a high level, red/amber/green indication of the overall performance of the VoLTE
service for the selected Global Filter. The score uses the metrics detailed in Appendix A – CEI Metrics.

3.1.2 Overall Data Score


This chart provides a high level, red/amber/green indication of the overall performance of the Data
service for the selected Global Filter. The score uses the metrics detailed in Appendix A – CEI Metrics.

CEI User Guide 12


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.1.3 Voice Subscriber KQIs


The following Key Quality Indicators (KQI) are displayed for the selected Global Filter:

l Voice Accessibility: this tells you whether the subscriber experienced of setting up a call was
acceptable or not. Not being able to make a call or long call setup times would negatively
impact this score, for example.
l Voice Retainability: this tells you whether the subscriber experienced of completing the call was
acceptable or not. Dropped calls would negatively impact this score, for example.
l Voice Integrity: this tells you how the subscriber perceived the voice quality during the call,
whether they had any gaps in the audio, quality degradation etc.

The KQIs are detailed in Appendix A – CEI Metrics.

3.1.4 Data Subscriber KQIs


The following Key Quality Indicators (KQI) are displayed for the selected Global Filter:

l Data Accessibility: this tells you whether the subscriber experienced of creating data
connections was acceptable or not. Not being able to connect to data would negatively impact
this score, for example.
l Data QoE: this tells you how the subscriber perceived the quality of the data service. High
latency or low throughput should negatively impact this score, for example.
l Overall Data Score. This is the same as the Overall Data Score shown in the ‘gauge’ chart.

The KQIs are detailed in Appendix A – CEI Metrics.

3.1.5 Voice Network KQIs


These are the same KQI as detailed for Voice Subscriber KQI. However, they are calculated at
network level and therefore can be used to determine if the individual subscriber’s experience is
below or above average for the network.

3.1.6 Data Network KQIs


These are the same KQI as detailed above for Data Subscriber KQI. However, they are calculated at
network level and therefore can be used to determine if the individual subscriber’s experience is
below or above average for the network.

3.1.7 Used Handsets


This chart shows the handsets used by the customer and the scores associated with each. It shows
whether the subscriber was using just one or multiple handsets during the time range and in the case
of multiple handsets, how the experience compared across handsets. A significantly different score
across handsets might be an indication that the experience is handset dependent.

CEI User Guide 13


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.2 The CEI Voice Tab


The CEI Voice tab provides a more focused view of the experience of the VoLTE service. It
automatically identifies voice service threshold breaches, for example, Dropped Calls, and when and
where they occurred.

The following image shows the CEI Voice tab.

The view comprises:

l Overall Voice Score


l Subscriber KQIs
l Network KQIs
l Threshold Breaches
l Call History
l Top Issue Responses
l Top Call Drop Locations

Use the Global Filter to select time range and enter the IMSI of the subscriber of being investigated.

3.2.1 Overall Voice Score


This chart provides a high level, red/amber/green indication of the overall performance of the VoLTE
service for the selected Global Filter. The score uses the metrics detailed in Appendix A – CEI Metrics.

CEI User Guide 14


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.2.2 Subscriber KQIs


The following Key Quality Indicators (KQI) are displayed for the selected Global Filter:

l Voice Accessibility: Indicates whether the subscriber experienced of setting up a call was
acceptable or not. Not being able to make a call or long call setup times would negatively
impact this score, for example.
l Voice Retainability: Indicates whether the subscriber experienced of completing the call was
acceptable or not. Dropped calls would negatively impact this score, for example.
l Voice Integrity: Indicates how the subscriber perceived the voice quality during the call,
whether they had any gaps in the audio, quality degradation etc.

The KQI are detailed in Appendix A – CEI Metrics.

3.2.3 Network KQIs


These are the same KQI detailed for Voice Subscriber KQI. However, they are calculated at network
level and therefore can be used to determine if the individual subscriber’s experience is below or
above average for the network.

3.2.4 Threshold Breaches


This chart displays how many times the acceptable experience threshold has been breached for the
following conditions:

l Call Drop
l Call Gap
l Call Setup Success Rate
l Call Setup Time
l Handover Gap
l Poor MOS
l Registration Success Rate
l Short Calls

The breaches are detailed in Appendix A – CEI Metrics.

3.2.5 Call Attempts


This chart displays a history of Call Setup attempts and Failures for the selected Global Filter.

3.2.6 Top Responses


This chart displays the quantity of each error experienced by the customer.

CEI User Guide 15


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.2.7 Top Call Drop Locations


This chart displays the quantity of Call Setup attempts and the Drop Call Rate for each cell visited by
the customer.

3.3 The CEI Data Tab


The CEI Data tab provides a more focused view of the experience of the Data service. It
automatically identifies data service threshold breaches, for example, low throughput, and when and
where they occurred.

The following image shows the CEI Data tab.

The view comprises:

l Overall Data Score


l Subscriber KQIs
l Network KQIs
l Threshold Breaches
l Data Usage History
l Top Data Locations

Use the Global Filter to select time range and enter the IMSI of the subscriber of being investigated.

3.3.1 Overall Data Score


This chart provides a high level, red/amber/green indication of the overall performance of the data
service for the selected global filter. The score uses the metrics detailed in Appendix A – CEI Metrics.

CEI User Guide 16


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.3.2 Subscriber KQIs


The following Key Quality Indicators (KQI) are displayed for the selected Global Filter:

l Data Accessibility: this tells you whether the subscriber experienced of creating data
connections was acceptable or not. Not being able to connect to data would negatively impact
this score, for example.
l Data QoE: this tells you how the subscriber perceived the quality of the data service. High
latency or low throughput should negatively impact this score, for example.
l Overall Data Score. This is the same as the Overall Data Score shown in the ‘gauge’ chart.

The KQI are detailed in Appendix A – CEI Metrics.

3.3.3 Network KQIs


These are the same KQI as detailed above for Data Subscriber KQI but calculated at network level
and therefore can be used to determine if the individual subscriber’s experience is below or above
average for the network.

3.3.4 Threshold Breaches


This chart displays how many times the acceptable experience threshold has been breached for the
following conditions:

l App Specific DL Throughput


l App Specific UL Throughput
l Attach Average Duration
l Attach Success Rate
l Dedicated Bearer Activation Success Rate
l Default Bearer Activation Success Rate
l Focused DL Throughput
l Focused UL Throughput
l Latency
l Retransmissions

The breaches are detailed inSection A Appendix A – CEI Metrics

Note: The purpose of the Application Specific Metrics is to allow throughput benchmarking of a
given service, for example, YouTube or SpeedTest.net, where the network may be tuned to provide
an optimal experience. The minimum payload and active time profile can be configured to ensure
measurements are only made against traffic that is fully exercising the bandwidth permitted for that
Service. This excludes shorter bursts, which may be transferred at a lower bit rate.

The Focused Throughput Metrics are similar but are provided to measure the experience of generic
traffic, for example, HTTP/HTTPS, which may be experienced at lower throughput rates.

CEI User Guide 17


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 3  Using the CEI Application
992-0695-08 Rev. 001

3.3.5 Data Usage


This chart displays a history of Data Usage and Thoughput for the selected Global Filter.

3.3.6 Top Locations


This chart displays the quantity of Data and the Data QoE for each cell visited by the customer.

3.4 Creating Custom Views


The user may wish to create custom views in order to apply a different Global Filter, for example,
Company Name for VIP reporting, reorganize the views according to a required layout, or add
additional charts and data.

The behavior of the dashboards and their configuration is the same as the Explorer application.

A user with the nBA – Allow access to Explorer Dashboard Edit privilege is able to make a private copy
of a dashboard, add additional charts or configure different metrics. It can only be shared with other
users by using the Export function.

Note: Refer to the Explorer User Guide for details on configuring dashboards.

CEI User Guide 18


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 A  Appendix A – CEI Metrics
992-0695-08 Rev. 001

A Appendix A – CEI Metrics


This section describes the default metrics delivered as part of the CEI Module.

There are four types of metrics:

l KPI, for example, Avg Call Setup Time, which is an actual measurement of the subscriber
experience.
l Adaptive KPI: Although not used directly in dashboards, these represent a mapping of the KPI,
projected to a linear scale of 0-100 between two points representing the transition from
acceptable to unacceptable values (see example below).
l Breaches, for example, Call Setup Time Breach, which is a flag raised when the KPI trigger point
has been reached and the associated Adaptive KPI is 0. Breach counts are per subscriber, per
5-minutes.
l Scores and KQI, for example, Voice Accessibility KQI, which is a combination of several Adaptive
KPI and weighting factors (see example below).

Figure A.1 - Example: Avg Call Setup Time Adaptive KPI

Example:

Voice Accessibility KQI=

(30% x Registration Success Rate*)+(40% x Call Setup Success Rate*)+(30% x Call Setup Time*) *
Adaptive KPI

CEI User Guide 19


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 A  Appendix A – CEI Metrics
992-0695-08 Rev. 001

A.1 CEI Voice Metrics


The CEI Voice Metrics describe the subscriber experience of VoLTE calls. The table below describes each of the CEI Voice Metrics used in the default CEI
dashboards. Refer to the second table for the variable values.

Metric Label Definition


Call Drop Breach Call drop rate trigger point (v1 x v2) exceeded (default >1.0%).
Call Drop Rate Call drop count/total completed calls.
Call Gap Breach Call gap rate trigger point (v3 x v4) exceeded (default >6%).
Call Setup Attempts Call setup attempt count.
Call Setup Fail Call setup attempt fail count.
Call Setup SR Breach Call setup success rate trigger point (v5 x v6) exceeded (default <89.55%).
Call Setup Time Breach Call setup time trigger point (v7 x v8) exceeded (default >2250 msec).
Handover Gap Breach Handover gap rate trigger point (v9 v 10) exceeded (default >60%).
MOS Breach MOS trigger point (v11 x v12) exceeded (default < 2.1).
Registration SR Breach Registration success rate trigger point (v15 x v16) exceeded (default <90%).
Short Calls Breach Short call count trigger point (v17 x v18) exceeded (default 3 calls of < 1000 ms or v19).
Voice Accessibility A ‘score’ representing the subscriber’s experience of accessing the voice service, based on a
combination of the Adaptive KPI for Registration Success Rate, Call Setup Success Rate and Call Setup
Time.
Voice Integrity A ‘score’ representing the subscriber’s experience of using the voice service, based on a combination
of the Adaptive KPI for MOS, Call Gap Ratio and Handover Gap Ratio.
Voice Retainability A ‘score’ representing the subscriber’s experience of retaining the voice service based on the Adaptive
KPI for Drop Call Rate.
Overall Voice Score ((40 x Voice Accessibility)+(20 x Voice Retainability)+(40 x Voice Integrity))/100.

CEI User Guide 20


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 A  Appendix A – CEI Metrics
992-0695-08 Rev. 001

The table below lists the configuration properties used to set the thresholds and trigger points used in voice breaches.

Note: The trigger point is the threshold value multiplied by the ‘start percent’ value, so, for example, if the Call Setup Success Rate
threshold is 99.5% and the ‘start percent’ is 90%, then the trigger point will be 89.55%.

Ref Property Name Default Value


v1 cei_voice_call_drop_start_percent 110
v2 cei_voice_call_drop_threshold_percent .9
v3 cei_voice_call_gap_rate_start_percent 200
v4 cei_voice_call_gap_rate_threshold_percent 3
v5 cei_voice_call_setup_start_percent 90
v6 cei_voice_call_setup_threshold_percent 99.5
v7 cei_voice_call_setup_time_start_percent 150
v8 cei_voice_call_setup_time_threshold_millis 1500
v9 cei_voice_handover_gap_rate_start_percent 200
v10 cei_voice_handover_gap_rate_threshold_percent 30
v11 cei_voice_mos_start_percent 60
v12 cei_voice_mos_threshold_score 3.5
v13 cei_voice_rab_teardown_start_percent 150
v14 cei_voice_rab_teardown_threshold_count 4
v15 cei_voice_registration_success_start_percent 90
v16 cei_voice_registration_success_threshold_percent 100
v17 cei_voice_sip_duration_short_calls_count_start_percent 150
v18 cei_voice_sip_duration_short_calls_count_threshold_count 2
v19 cei_voice_sip_duration_short_calls_time_threshold_msec 1000

CEI User Guide 21


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 A  Appendix A – CEI Metrics
992-0695-08 Rev. 001

A.2 CEI Data Metrics


The CEI data metrics describe the subscriber experience of data usage. The table below describes each of the CEI data metrics used in the default CEI
dashboards. Refer to the second table for the variable values.

The ‘App Specific DL/UP Throughput Breach’ metrics require a specific data service to be configured. By default, it is YouTube.

Metric Label Definition

App Specific DL Downlink throughput threshold (d24 x d25) exceeded for specified application (d23) volume (d22) and active time
Throughput Breach (d21). (default <5kbps for YouTube transfers >50kB and >20ms active time).
App Specific UL Uplink throughput threshold (d26 x d27) exceeded for specified application (d23) volume (d22) and active time (d21).
Throughput Breach (Default <1.25kbps for YouTube transfers >50kB and >20ms active time).
Attach Avg Duration Attach avg duration threshold (d3 x d4) exceeded (default 750ms).
Breach
Attach SR Breach Attach success rate threshold (d1 x d2) exceeded (default 90%).
Data Accessibility A ‘score’ representing the subscriber’s experience of accessing the data service, based on a combination of the
Adaptive KPI for attach success rate, default bearer activation success rate, dedicated bearer activation success rate
and attach avg duration.
Data QoE A ‘score’ representing the subscriber’s experience of data quality, based on a combination of the Adaptive KPI for
focused DL/UL throughput, app specific DL/UL throughput, avg latency and retransmission rate.
Dedicated Bearer Act SR Dedicated bearer activation success rate threshold (d7 x d8) exceeded (default 90%).
Breach
Default Bearer Act SR Default bearer activation success rate threshold (d9 x d10) exceeded (default 90%).
Breach
Focused DL Throughput Downlink throughput threshold (d15 x d16) exceeded for specified application (d13) volume (d12) and active time
Breach (d11). (Default <2kbps for HTTP/HTTPS transfers >1MB and 20ms active time).
Focused UL Throughput Uplink throughput threshold (d17 x d18) exceeded for specified application (d13) volume (d12) and active time (d11).
Breach (Default <1kbps for HTTP/HTTPS transfers >1MB and 20ms active time).
Latency Breach Latency threshold (d5 x d6) exceeded (default 75ms).
Overall Data Score ((50 x data accessibility) +(50 x Data QoE))/100.
Retransmission Breach Retransmission rate threshold (d19 x d20) exceeded (default 3%).

CEI User Guide 22


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 A  Appendix A – CEI Metrics
992-0695-08 Rev. 001

The table below lists the configuration properties used to set the thresholds and trigger points used in data breaches. Note: The trigger
point is the threshold value multiplied by the ‘start percent’ value, so, for example, if the attach success rate threshold is 100% and the
‘start percent’ is 90%, then the trigger point will be 90%.

Ref Property Name Default Value


d1 cei_uplane_attach_success_start_percent 90
d2 cei_uplane_attach_success_threshold_percent 100
d3 cei_uplane_average_attach_duration_start_percent 150
d4 cei_uplane_average_attach_duration_threshold_millis 500
d5 cei_uplane_average_latency_start_percent 150
d6 cei_uplane_average_latency_threshold_millis 50
d7 cei_uplane_dedicated_bearer_start_percent 90
d8 cei_uplane_dedicated_bearer_threshold_percent 100
d9 cei_uplane_default_bearer_start_percent 90
d10 cei_uplane_default_bearer_threshold_percent 100
d11 cei_uplane_focused_app_active_time_ms_min 20
d12 cei_uplane_focused_app_bytes_min 1048576
d13 cei_uplane_focused_app_ptcode HTTP,HTTPS
d14 cei_uplane_focused_appgroup_code WEB
d15 cei_uplane_focused_dl_app_start_percent 50
d16 cei_uplane_focused_dl_app_threshold_kbps 4000
d17 cei_uplane_focused_ul_app_start_percent 50
d18 cei_uplane_focused_ul_app_threshold_kbps 2000
d19 cei_uplane_retransmission_rate_start_percent 150
d20 cei_uplane_retransmission_rate_threshold_percent 2
d21 cei_uplane_specified_app_active_time_ms_min 20
d22 cei_uplane_specified_app_bytes_min 50000

CEI User Guide 23


© NETSCOUT CONFIDENTIAL & PROPRIETARY
Ver. 6.3 | April 2020 A  Appendix A – CEI Metrics
992-0695-08 Rev. 001

Ref Property Name Default Value


d23 cei_uplane_specified_app_ptcode YOUTUBE
d24 cei_uplane_specified_dl_app_start_percent 50
d25 cei_uplane_specified_dl_app_threshold_kbps 10000
d26 cei_uplane_specified_ul_app_start_percent 50
d27 cei_uplane_specified_ul_app_threshold_kbps 2500

CEI User Guide 24


© NETSCOUT CONFIDENTIAL & PROPRIETARY

You might also like