You are on page 1of 136

TEMS Discovery – BSNL

Training
April 2018

Orchestrating network performance | www.infovista.com


Orchestrating network performance |
CONTENT / AGENDA
• Introduction to TEMS Discovery
• Getting familiar with Tems Discovery .
• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 2


WHAT IS TEMS™ DISCOVERY?

• Wireless network reporting and analysis


tool within the InfoVista TEMS portfolio
• Designed for network analysis,
troubleshooting, optimization, reporting,
benchmarking and
QoS verification
• Highly configurable, flexible and
user-friendly tool
• Support for all major technologies
and data formats
• Full decoding of metrics and events
• Automatic data processing

Orchestrating network performance | 3


DATA ORGANIZATION AND MANAGEMENT

• Handles large volumes of data with low memory demand


• Multi-thread, background data processing
• Analyzing in parallel with data processing, no ”lock-up time”
• Options for selective data import
• Incremental merging of new data with existing data
• Unlimited number of composite data sets
• Data can be shared across the organization
(Standard and Professional) or accessed
from the server (Enterprise)

Orchestrating network performance | 4


RICH DATA PRESENTATION

Comprehensive views with extensive customization capabilities:


• Data explorer
• Map view
• Time series chart
• Message view
• Table view
• Histogram (bar/pie chart)
• Correlation view
• Point detail

Orchestrating network performance | 5


PROBLEM AND ANALYSIS SET CAPABILITY
 Set of pre-defined rules used for filtering
out specific log files that contain problems

 Built-in problem sets available for the


different technologies

 Problem sets can be customized for the


analysis of a particular type of problem

 An analysis set is a group of view layouts (map, time chart, message


view, etc.) suitable for analysis certain problems

Orchestrating network performance | 6


SCRIPT BUILDER*
• Advanced function to extract data
from messages and apply customized
algorithms to generate new metrics
and events

• Generation of any metrics, events or


filtering criteria

• Simple drag-n-drop access to


• All metrics

• All IEs in layer 3 messages

• Generated metrics and events are


accessible from all tools and reports

• C# syntax used for coding


Enterprise packages only

Orchestrating network performance | 7


REPORT BUILDER*
• Exceptionally powerful and flexible

• All TD events and metrics supported


• Full array of statistical attributes

• User-defined metrics supported

• Drag and drop into any desired cell

• Support for MS Excel functions

• Comprehensive data filtering options

• Repetition in report

• Integrated maps

• MS Excel, Word and Power Point output format

Enterprise packages only

Orchestrating network performance | 8


AUTOMATED DATA PROCESSING*
• Monitoring and processing of incoming data
• Automatic creation of multiple projects and datasets
according to user’s configuration
• Automatic creation of KPI plots and reports
• Automatic e-mail notifications to multiple recipients
• Multiple tasks can be configured
• Easy and flexible configuration

Enterprise packages only


Orchestrating network performance | 9
CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 10


USER INTERFACE & TERMINOLOGY Display Panels

Project list – a placeholder for


projects

Document list – a placeholder


for documents

GIS/Coverage Map – a
placeholder for GIS and
coverage map data

Task Window – background


tasks status

Message Log – Messages


related to the current operation

Orchestrating network performance | 11


USER INTERFACE & TERMINOLOGY
Tools and Analysis Views Shortcuts

 Show/hide display  Map View  Multi-dimension  Log file replay


panels  Time-series Chart Statistic View functionality
 Save project data  Message View  Synchronization by
 Walk-U-Through  Table View Mouse Clicking
 Data Import  Instant Chart View  Synchronize Views
 Automatic Data  Point Detail By Mouse Moving
Processing  Histogram
 Script Builder  Correlation View
 Report Template/  Problem Summary
Problem Set Builder View
 Plot Band Editor

Orchestrating network performance | 12


USER INTERFACE & TERMINOLOGY
Views

Orchestrating network performance | 13


USER INTERFACE & TERMINOLOGY
Tools

Orchestrating network performance | 14


USER INTERFACE & TERMINOLOGY
Configuration

Orchestrating network performance | 15


USER INTERFACE & TERMINOLOGY
Data Explorer tab
 Dataset tab displays drive test data in logical
groups – Archived, Composite and DataSets
 Except for the archived dataset, each group is
given with a tree view layout that can be drilled
down to the metric level
 Project data can be filtered by sector group,
condition expression, event set, user defined
region or by date of data collection or
processing

Orchestrating network performance | 17


USER INTERFACE & TERMINOLOGY
Data Explorer tab
 Cells tab has the account of imported network
configurations, sector groups, and sector filter
expressions

Orchestrating network performance | 18


USER INTERFACE & TERMINOLOGY
Data Explorer tab
 ‘GIS/Coverage Map’ tab lists all GIS data
associated with the current project
 GIS data can be displayed in Map View by
dragging and dropping, or by choosing “Send
To Map View” option from the context menu

Orchestrating network performance | 19


USER INTERFACE & TERMINOLOGY
Legend tab
 Legend tab displays plot band information of
metrics that are included in the Map View and
Time Chart
 Any particular metric can be added or
removed from display by selecting or
de-selecting corresponding metric title

Orchestrating network performance | 20


USER INTERFACE & TERMINOLOGY
Point Details tab
 Point Details tab provides a convenient way to
overview detailed measurement information
for a particular time and location
 Point Details information is refreshed by
moving the cursor in the Map View or Time
Chart, or by changing the row selection in the
Message View and Table View
 User can select pre-defined Point Details
configurations or create a new one

Orchestrating network performance | 21


USER INTERFACE & TERMINOLOGY
Project Properties tab
 Project Properties tab displays general
information regarding the current project’s
GIS, UDR (User Defined Region) and cell
configuration data
 User can select default GIS map, UDR and
cell configuration
 User can defined UDR cluster indexes and
select an UDR as a default print area to be
used for reporting

Orchestrating network performance | 22


DATA ORGANIZATION AND MANAGEMENT
 Projects organized in private and public folders
 Each project may contain datasets, composite
datasets, and archives (archived datasets)
 A dataset is created when importing one or more raw
measurement data files
 Each dataset contains logfile data easily organized
by certain attributes (operator, device, IMSI,
processing date, etc.)
 Data processed from one for more datasets of
a project can be logically combined into a composite
dataset
 A document defines the configuration settings of the
specific data sources, displayed metrics, and view
layouts

Orchestrating network performance | 23


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 24


WALK-U-THROUGH CONCEPT
 Walk-U-Through is a TEMS Discovery wizard that walks a user through
some of the most common tasks including:
 GIS map data import
 New project creation
 Drive test data (log files) import
 Network configuration import
 Composite dataset creation
 Analysis set creation and editing
 Report generation

Orchestrating network performance | 25


IMPORT GIS MAP DATA
 Import GIS map data is the first step of Walk-U-Through wizard
 Alternatively ‘Data Import’ toolbar button can be used

Data Import
Walk-U-Through

Orchestrating network performance | 26


IMPORT GIS MAP DATA

Click to add files

Orchestrating network performance | 27


IMPORT GIS MAP DATA

Browse GIS files


and click on Open
Orchestrating network performance | 28
IMPORT GIS MAP DATA

Use existing or create a


new geo area GIS data
will be added to

Click to import
GIS data

Orchestrating network performance | 29


IMPORT GIS MAP DATA

The imported GIS data file (map) appears in the GIS data can be displayed in Map
‘GIS/Coverage Map’ tab under GIS Data and View by dragging and dropping, or
the corresponding geo area, among other by choosing ‘Send To Map View’
imported GIS data files option from the context menu

Orchestrating network performance | 30


CREATE NEW PROJECT
 Create project is the next step in Walk-U-Through wizard
 Alternatively ‘Create New Project’ button of Project List display panel can
be used

Orchestrating network performance | 31


CREATE NEW PROJECT
Name the new project
Save the new project

Select the geo area


used to import GIS data

Use imported GIS data


as a default map

Orchestrating network performance | 32


CREATE NEW PROJECT

The new project appears in the Project List


display panel among the other projects,
however it doesn’t contain any drive test
data at this point. Right click context menu
can be used to rename, delete or open a
project among other procedures.

Orchestrating network performance | 33


IMPORT DRIVE TEST DATA
 Import drive test data is the next step of Walk-U-Through wizard
 Alternatively ‘Data Import’ toolbar button can be used

Data Import
Walk-U-Through

Orchestrating network performance | 34


IMPORT DRIVE TEST DATA

Click to add files

Orchestrating network performance | 35


IMPORT DRIVE TEST DATA

Browse drive test files


and click on Open

Orchestrating network performance | 36


IMPORT DRIVE TEST DATA

Select the target


project and dataset
for data import

Click to import
Select the frame import drive test data
configuration or create/edit the
configuration by clicking Edit/View

Orchestrating network performance | 37


IMPORT DRIVE TEST DATA

The imported drive test data appears in


the Project List display panel under the
specified project and dataset.
The data can be organized and
grouped by device, file name, etc.

Orchestrating network performance | 38


IMPORT DRIVE TEST DATA

File/Device dataset information


can be grouped by any of pre or
user defined attributes such as
file name, time, device, ESN,
IMEI, IMSI, Mobile ID, operator,
UDR, etc.

Orchestrating network performance | 39


IMPORT NETWORK CONFIGURATION
 Import network configuration is the next step of Walk-U-Through wizard
 Alternatively ‘Data Import’ toolbar button can be used

Walk-U-Through

Data Import

Orchestrating network performance | 40


IMPORT NETWORK CONFIGURATION
Rename
Select target project for
network
network configuration
configuration
import

Select the format of cell


configuration file. Supported
formats include TEMS .cel or
.xml, ACTIX cellref, ASSET
.xml, ATOLL .xml, Ericsson
Bulk CM and custom
delimited .txt

Browse for
the network
configuration
file

Click to import
network
configuration data

Orchestrating network performance | 41


CREATE COMPOSITE DATASET

Drag-and-drop files to
Use file/device grouping to filter the be included in
log files to be included in composite composite dataset,
data set (e.g. measurement files alternatively files can
collected before network changes be selected by Click on ‘Save As’ button
were implemented – group by spreadsheet filtering and define a name for
Notes attribute) the new composite
dataset

Orchestrating network performance | 42


CREATE COMPOSITE DATASET

Newly created composite


dataset is showing up in
Data Explorer

Orchestrating network performance | 43


OPEN PROJECT WITH ANALYSIS SET
 Open Project With Analysis Set is the next step of Walk-U-Through wizard
 Alternatively use right click context menu on the mobile device

Select Open
analysis project
set

Select file and


mobile device

Orchestrating network performance | 44


OPEN PROJECT WITH ANALYSIS SET

Use selected
analysis set to
troubleshoot
dropped call

Orchestrating network performance | 45


GENERATE REPORT
 Generate report is the last step of Walk-U-Through wizard
 Alternatively use right click context menu on the dataset, file or mobile device

Generate report for


selected dataset, file
or mobile device

Orchestrating network performance | 46


GENERATE REPORT

Optionally filter
measurement data
by date/time, sector
group, condition
expression or UDR
Select pre-defined or
custom report
template

Orchestrating network performance | 47


GENERATE REPORT

Generated
report

Orchestrating network performance | 48


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 49


DATA VIEWS FEATURES
Synchronizable Views

Map View, Time-series Chart, Message


View, Table View and Wave View are
fully synchronized

Orchestrating network performance | 50


DATA VIEWS FEATURES
Summary Data Views
 Summary data views are used to
present statistic data in various
formats and those include Metric
Correlation, Histogram, Sector
Statistic, Problem Summary and
Report

Orchestrating network performance | 51


DATA VIEWS FEATURES
Views Rearrangement

Rearrange views by
dragging-and-dropping

Orchestrating network performance | 52


DATA VIEWS FEATURES
Split Views

Split into sub-views

Orchestrating network performance | 53


DATA VIEWS FEATURES
View Toolbars

Each data view has its own individual


toolbar with functions related to that
specific view

Orchestrating network performance | 54


MAP VIEW
Display GIS Data / Online Map Use ‘OnlineMap’ drop
down menu to display
online map

Drag-and-drop GIS data from


‘GIS/Coverage Map’ tab of Data
Explorer to the map view or use
right click context menu

Orchestrating network performance | 55


MAP VIEW
Map View Options
Terrain Coverage Controls Modify color of
map map the display ‘Spider Move’ tool
display display of vector ray lines when Map layer
options options data phone data is used control

Modify sector pie


shape, site, sector
and carrier labeling
options, neighbor
display options,
co/adj channel
display, and
channel search
radius.

Orchestrating network performance | 56


MAP VIEW
Display Sites
Drag-and-drop sites from Cells ..or use ‘Send to Map
tan of Data Explorer to display View’ option of right
them on the map.. click context menu

Orchestrating network performance | 57


MAP VIEW
Site View Options
Modify sector pie radius Define site, sector or carrier
and width to differentiate label parameter and color using
between network any of network configuration
technology layers parameters

Use ‘Edit View Options’ right


click context menu to modify
network configuration view
options including sector icon
size, center circle color, pie
and pie tip color, and site,
sector and carrier label

Define pie or pie tip color using


Color code center circle using
any network configuration sector
any network configuration site
or carrier parameter or calculated
parameter with discrete and
network statistic parameter; Use
continuous band creation
discrete/continuous band or pre-
assistance
defined plotband

Orchestrating network performance | 58


MAP VIEW
Site View Options
Center circle color
linked to the LAC
parameter

Pie color and sector


label linked to PSC
parameter

Orchestrating network performance | 59


MAP VIEW
Site View Options
Center circle color
linked to the LAC
parameter

Pie color and sector


label linked to PSC
parameter

Orchestrating network performance | 60


MAP VIEW
Sector Grouping

The cell sites listed in Cells tab of


Data Explorer can be grouped with
user-defined grouping logic for
better data organization.
Use ‘Edit Grouping Option’ from
right click context menu to define
grouping logic.

Orchestrating network performance | 61


MAP VIEW
Sector Grouping

Use ‘Apply Grouping Option’


from right click context menu
to regroup the cell sites (e.g.
by LAC)

Orchestrating network performance | 62


MAP VIEW
Filter Expression Builder

Use ‘Filter Expression Builder’ to


create condition that can be used to
flag or filter cells on the map

Filter expression can be based on


any of site, sector or carrier
information elements of selected
network configuration

Orchestrating network performance | 63


MAP VIEW
Filter Expression Builder
Use ‘Flag Filter Expression in
Map View’ to highlight selected
cells in the map view

Orchestrating network performance | 64


MAP VIEW
Filter Expression Builder

Select filter expression in ‘Cell


Configuration Editor’ and save it as a
sector group used later to filter cell
information on the map

Orchestrating network performance | 65


MAP VIEW
Filter Expression Builder

Sector group is added to the Cells tab of Data


Explorer and can be toggled in the map view
(multiple sector groups can be toggled at the
same time).

Orchestrating network performance | 66


MAP VIEW
Display Metric

Drag-and-drop metric to
the map or use ‘Send to
Map View’ option of right
click context menu

Orchestrating network performance | 67


MAP VIEW
Data Route Offset
Use Data Route Offset option
to differentiate between
Modify root distance metrics on the map
Modify root position
Modify data point size

Categorized
Ec/Io A2
Categorized (offset)
Ec/Io A1

Orchestrating network performance | 68


TOP 1 SECTOR COVERAGE

Use ‘Top 1 Sector Coverage Intellisense’


button to display a particular sector’s
strongest server coverage; Ray lines (as
shown) or color data points are available
as display options.

Orchestrating network performance | 69


MAP VIEW
User Defined Region (UDR)

UDR drawing option can be


used to draw custom regions
that can be used in map view,
reports, geo binning, batch
printing, statistical analysis, etc.

Orchestrating network performance | 70


MAP VIEW
UDR Properties

Use UDR selector button to


edit UDR properties (e.g.
whether UDR is considered
for binning or is deemed as
a hole, i.e. area excluded
when binning or filtering)

Orchestrating network performance | 71


MAP VIEW
UDR Filtering

Filter measurement
data in map view by
UDR

Orchestrating network performance | 72


TOP 1 SECTOR COVERAGE

Use ‘Top 1 Sector Coverage Intellisense’


button to display a particular sector’s
strongest server coverage; Ray lines (as
shown) or color data points are available
as display options.

Orchestrating network performance | 73


TOP 1 COVERAGE

Use ‘Top 1 Sector Coverage’ button to


display strongest server coverage; Ray
lines (as shown) or color data points
are available as display options.

Orchestrating network performance | 74


SEARCH FOR INTERFERENCE

PSC 275

Display co/adjacent
channels on the map
using the ‘Search for
Co./Adj.’ button

PSC 275

Orchestrating network performance | 75


PIN-POINT SECTOR

Pinpoint sector
logical display in
the tree view of
Data Explorer
Cells tab

Orchestrating network performance | 76


DISPLAY CELL SITE PROPERTIES

Display site, sector,


technology layer and
neighbor information for a
selected site

Orchestrating network performance | 77


DISPLAY NEIGHBORS

Use ‘Neighbor IntelliSense’ functionality to


display sector neighbors – Moving the
mouse over a sector will show ray lines that
link to neighboring sectors

Orchestrating network performance | 78


FREEZE NEIGHBOR DISPLAY

Use ‘Network Configuration’


context menu to freeze neighbor
display and remove it from the
map view

Orchestrating network performance | 79


NEIGHBOR LIST EDIT

Use ‘NL Serving Sector


Selector’ functionality to
select a sector for manual
neighbor list edit

Use ‘Edit Neighbor List’


functionality to add (left
click) or remove (right click) Neighbors can be
neighbors added/removed as
2-way or 1-way Orange flag indicates
outward or inward selected site and current
number of neighbors

Orchestrating network performance | 80


Save Configuration
Save Configuration As
TIME SERIES CHART VIEW Delete Selected Configuration
Cleanup
View Option Shortcuts
Zoom to Window Size
Window Size
Previous Time Window
Next Time Window

Table size
Pointer
View Option
Data Point Icon Size
Show/Hide Legend
Zoom Out X Axis
Reset X Axis
Pan X Axis
Zoom Out Y Axis
Reset Y Axis
Pan Y Axis
Unzoom
Help

Orchestrating network performance | 81


MESSAGES VIEW
Create New Message View Copy Selected Summary
Detail/Diagram View Copy All Summary
Layer 3/RRC IE Browser Export Summary to Text File
KeyInfo Settings Search Text
Layer 3 Message Coloring Search Forward
Show/Hide Extra Options Search Backward
Zoom Spreadsheet Filter
Enable/Disable Auto Adjustment of Column Height Filtering per Selected Layer 3 Message Type
Group Messages by File/Device Remove Filter
Message Header Column Selector Help
Clean Spreadsheet

Search
Search Next
Expand/Collapse tree view
Copy All Detail
Export Detail to Text File
Close Detail/Diagram View

Orchestrating network performance | 82


TABLE VIEW
Create New Table View Refresh
Device info Export to MapInfo MIF/MID
Configuration Save to Excel
Save Configuration Export to Text Delimited Files in Zip Package
Save Configuration As Add Sheet
Delete Configuration Remove Current Sheet
Cleanup Table View Remove Columns
Zoom Spreadsheet Help
Enable/Disable Auto Adjustment of Column Height

Select existing
configuration or
drag-and-drop
metrics into the
table

Orchestrating network performance | 83


HISTOGRAM VIEW
Table size Show/Hide Floating Legends
Device info Pointer
Configuration Merge Cells
Save Configuration Split Merged Cell in Horizontal Direction
Save Configuration As Split Merged Cell in Vertical Direction
Delete Selected Configuration Refresh Display to Apply Current Data Filters
Export Statistic Data to Text File Cleanup
View Option Help

Orchestrating network performance | 84


HISTOGRAM VIEW
Toggle Chart Type

Orchestrating network performance | 85


MULTI-DIMENSION STATISTIC VIEW
Use Multi-dimension Statistic Drag-and-drop metrics into the grid
View to generate on-demand view and specify aggregation
statistic data of multiple method (Average, Count, Max, Min,
metrics in multiple user- Stdev, Sum, etc.)
selected dimensions

Generate ad-hoc
charts for data
Select pre-defined selected in the grid
dimensions (e.g. view
device, sector, IMSI,
UDR, etc.) or..

..drag-and-drop
custom dimensions
to the ‘Specific
Dimension’ box

Orchestrating network performance | 86


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 87


PROBLEM SUMMARY VIEW
Generate Problem Summary Problem Summary
View button

The Problem Summary


View gives the summary of
problems per file/device for
selected problem set

Drag-and-drop dataset or files into the


Problem Summary View to list the problems
or use ‘Send to Problem Summary View’
option of right click context menu

Orchestrating network performance | 88


PROBLEM SUMMARY VIEW
Run Analysis Set
Create New Problem Summary View Save Problem Details to the Text File
Cleanup Group the Listed Files to the Composite Dataset
Back to List Generate Report
List Only the File/Device With Problems Help
Analyze the Selected Problem

Click on the Analysis button to


troubleshoot the problem with
corresponding Analysis Set

Orchestrating network performance | 89


PROBLEM SUMMARY VIEW
Troubleshoot Problems

Analyze the problem


identified in Problem
Summary

Orchestrating network performance | 90


CONTENT / AGENDA

• Introduction to TEMS Discovery


• Getting familiar with Tems Discovery .
• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Tips to do things faster and easier.
• Analysis set
• Scripts
• REPORT TEMPLATE BUILDER
• Q&A

Orchestrating network performance | 91


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 92


SCRIPT BUILDER
Basics
 Advanced function to extract data from
messages and apply customized
algorithms to generate new metrics
and events
 Generate new metrics, events or
filtering criteria accessible from all
system tools and reports
 Simple drag-n-drop access to
 All metrics
 All IEs in layer 3 messages
 Scripts written in C# language

Orchestrating network performance | 93


How to extract certain layer 3 message information element

• We can created new user defined IE or event using signaling like layer 3 messages, predefined IEs and events or even other user
defined information elements using Script Builder

• Most common type is Advanced Metric and events ( user defined)

Orchestrating network performance | 94


How to extract certain layer 3 message information element

Orchestrating network performance | 95


How to extract certain layer 3 message information element

Orchestrating network performance | 96


How to extract certain layer 3 message information element

Orchestrating network performance | 97


SCRIPT BUILDER
Condition Expression Script

Step 1: Drag-and-drop data


objects into the Source Data
column of the Alias tab,
define Alias and Data Type

Orchestrating network performance | 98


SCRIPT BUILDER
Condition Expression Script

Step 2: Write script


code in C# to define
condition expression

Orchestrating network performance | 99


SCRIPT BUILDER
Condition Expression Script

Step 3: Validate values of


any user defined threshold
included in the script

Orchestrating network performance | 100


SCRIPT BUILDER
Condition Expression Script
Step 4: Apply new condition
to the dataset when
displaying measurements

Agg. Ec/Io plot Agg. Ec/Io


without the plot with the
new condition new condition
applied applied

Orchestrating network performance | 101


SCRIPT BUILDER
Condition Expression Script

Step 4: Generate
report with the new
condition applied

Orchestrating network performance | 102


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 103


REPORT TEMPLATE BUILDER
Basics
 Report template based on MS Office Excel format
 Measurement or statistic data used as a data
source for reports
 Data objects dragged-and-dropped to the Report
Editor from the Metric List window
 Any TEMS Discovery supported or user-defined
events and metrics can be added to the report
template
 Final report template formatting done in Excel
 MS Office Word and Power Point report templates
can be paired with an existing Excel template

Orchestrating network performance | 104


REPORT TEMPLATE BUILDER
Report Type Tab
Additional filtering options Once an information
element is dropped
into the Report
Select the report type and Editor, the Report
Select measurement descriptives; Optionally apply Self Type window will
or statistic data as the restriction or apply Geo-binning pop up
source of the report

Self restriction applies a threshold


or a range to filter data points; Up
to two logical expressions can be
applied to the selected metric.

Drag-and-drop any IE
from the Metric List tab
into the Report Editor

Orchestrating network performance | 105


REPORT TEMPLATE BUILDER
Report Types

 Chart (single and multi series chart over metric plot band)
 Correlation Chart (correlation chart between 2 or more metrics)
 Correlation Key (chart with correlated metric used for X-axis)
 Map View (Metric plot on the GIS source or online map)
 Multi-dimension Statistic View (selected statistic over multiple
attribute dimensions)
 Name (metric name)
 Single Value (selected statistic over entire set of data)
 SetGlobal (global value that can be retrieved by GetGlobal flag)
 Statistic Data (selected statistic over metric plot band)
 Tabular (list all distinct metric values)
 Trend Chart (hourly, daily, weekly and monthly resolution supported)

Orchestrating network performance | 106


REPORT TEMPLATE BUILDER
Additional Options Data filtering based
on one or more
device attributes Optionally, generate
the delta between the
data of two different
Select one or more condition filters attribute sets
based on condition expression
defined under Script Builder;
Condition filters can be applied at
the time of report generation too.

Enable UDR filtering and optionally


use UDR index and attribute based
filtering

Orchestrating network performance | 107


REPORT TEMPLATE BUILDER
Chart Report
 By default, the X-values of the chart will be the
plot band of the metric (default plot band will be
used unless ‘Define plot bands’ option is
selected)
 In case CorrelationKey is defined, the X values
will be the plot bands of the correlated metric
 The Descriptive determines the operation
applied to the metric in each of plot bands (e.g.
Count, % of Total, Mean, etc.)
 ‘% Meeting Cond’ descriptive requires self
restriction condition(s) to be set
 Geo-binned data can be used as an option
 Optionally apply condition filters, device
attributes or UDR filtering on the ‘Additional
Options’ tab

Orchestrating network performance | 108


REPORT TEMPLATE BUILDER
Chart Report
 Define the chart size by left-clicking at the
bottom-right corner of the desired chart area
once report type, descriptive and additional
conditions are selected
 Excluding ‘Definition’ row, all remaining chart
definitions can be manually updated (e.g. chart,
series or axis titles, chart type, etc.)
 ‘Display’ options include Value, PDF and CDF
 ‘Chart Type’ can select any chart type available
in MS Office Excel
 ‘Plot By’ options include Column and Row
 ‘# of Bands’ limits the number of bands to be
included on the chart
 ‘Sort Order’ defines the order for sorting the
Y-axis values and it can be set to Ascending,
Descending or None

Orchestrating network performance | 109


REPORT TEMPLATE BUILDER
Chart Report
 Multiple series can be added to the chart by
dragging-and-dropping another IE into the
column immediately after the previous series
 The chart type for different series can be set to
different types however mixed type chart can
only be defined for 2D chart types

Orchestrating network performance | 110


REPORT TEMPLATE BUILDER
Chart Report
 In case when correlated metric is defined, a
chart will have one IE’s descriptive calculated
over another IE’s plot band
 Correlated metric is defined after original chart
area is created by dragging-and-dropping
another IE into the correlation cell with
CorrelationKey selected as a report type

Orchestrating network performance | 111


REPORT TEMPLATE BUILDER
Map View Report
 Map view may include one or multiple metrics
 Customize map view by selections made in
‘Option #1’ and ‘Option #2’ tabs including:
 Cell site inclusion, specify icon size and position
with respect to the dataset route
 GIS map source inclusion and type (both user GIS
data and online maps supported)
 GIS map grayscale option
 Legend inclusion, specify legend title and its
placement with respect to the map
 Metric offset options
 Print area selection
 Data label inclusion and size
 Data point icon size
 Map resolution multiplier

Orchestrating network performance | 112


REPORT TEMPLATE BUILDER
Statistic Data Report
 Statistic data calculated for the selected metric
plot band ranges
 The metric cannot be dropped into the left most
column of the report editor spreadsheet as one
column space is required for the range column
 The descriptives include ‘% Meeting Cond’,
‘% of Total’, Count, Duration, First, ‘Linear
Average’, Max, Mean, Min, Sum and ‘Unique
Count’
 ‘% Meeting Cond’ descriptive requires self
restriction condition(s) to be set

Orchestrating network performance | 113


REPORT TEMPLATE BUILDER
Statistic Data Report
 Drag-and-drop another metric with
CorrelationKey as a report type for correlation
report between two metrics
 CorrelationKey metric should be dropped to the
cell between the range placement reference
and sorting reference cells (B5, C5, etc. in the
given example)

Orchestrating network performance | 114


REPORT TEMPLATE BUILDER
Multi-dimension Statistic Report
 Multi-dimension statistic report calculates
measurements statistics for all available
combinations of dimensions
 The report can include multiple dimensions and
measurements
 Any TD pre-defined or user-defined metric can
be added to the list of dimensions in addition to
device attributes and date/time dimensions
 Any TD supported or user-defined metric can
be added to the list of measurements
 Each of the measurements can be included
with multiple descriptives (e.g. Average, Count,
Max, Min, Sum, Stdev, etc.)

Orchestrating network performance | 115


REPORT TEMPLATE BUILDER
Tabular Report
 Tabular report lists all distinct values for the
selected metric
 Timestamp and location can be included in the
report in which case extra column space left of
the metric column should be reserved (1 extra
column for timestamp and 2 for location)

Orchestrating network performance | 116


REPORT TEMPLATE BUILDER
Name and Single Value Report
 Name report provides the name of the selected
metric
 Single Value report provides singular statistical
output calculated for all data samples the
selected descriptive
 The descriptives include %-ile, ‘% Meeting
Cond’, Count, Duration, First, ‘Linear Average’,
Max, Mean, Min, ‘Standard Deviation’, Sum,
‘Unique Count’ and Variance
 %-ile descriptive requires percentile value to be
set
 ‘% Meeting Cond’ descriptive requires self
restriction condition(s) to be set

Orchestrating network performance | 117


REPORT TEMPLATE BUILDER
Repetition in Report
 Repetition in Report feature is used to generate Standard Map View
a report with repetitive information (e.g., for report template element

each cell id, device attribute, cluster UDR, etc.)


 Step 1 – Define reporting block using standard
available report types and descriptives (e.g.
map view, chart, single value, etc.)
 Step 2 – Define ‘Repetition in Report’ option
(accessed from the right click context menu on
the spreadsheet) in the first cell immediately
below of left of the selected reporting block
including the following:
 Name ‘Repetition Flag’
 Select ‘Repetition Key’
 Define repetition block size and direction
 Add UDR filtering (optional)
 Step 3 – Add ‘Repetition Flag’ placeholder
(accessed from the right click context menu on
the spreadsheet) to be replaced by the value of
‘Repetition Key’ during report generation
Step 2: Define ‘Repetition
in Report’ option
Orchestrating network performance | 118
REPORT TEMPLATE BUILDER ‘Repetition Flag’ replaced
Repetition in Report by actual ‘Repetition Key’
EARFCN_Cell_Identity
value

‘Repetition Flag’ PCI added to the


row above the map and it is part of
the repetition block

Standard Map View report template


element using [!Mid].[&LTE Cell Scan - All
Map generated for
EARFCNs].[EARFCN_Cell_Identity].[Spec
each distinct LTE
ific: EARFCN_Cell_Identity].[<real value>]
scanner EARFCN
metric
– PCI combo

LTE scanner EARFCN_Cell_Identity


defined as a ‘Repetition Key’ PCI,
repetition block includes 20 rows above

Orchestrating network performance | 119


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 120


AUTOMATIC DATA PROCESSING
Basics

 Advanced function to automatically Create


new task
import measurement data, generate
Delete Save
reports, deposit reports to a specified task As task

location or share them via email


 ADP accessed from the Tools menu or Activate/ Edit/view
deactivate task
using the main window toolbar button task

 ADP tasks can be configured to support:


 File monitoring task only
 Report generation task only
 File moniroring and report generation task

Orchestrating network performance | 121


AUTOMATIC DATA PROCESSING
Step 1: File Monitor
Step 1 can be
skipped for purely
reporting tasks

Add/remove file
folders to be
monitored

Recommended
Select/unselect Indicates local Root folder of Measurement Frame configuration; Use monitored
folder to be or remote (FTP the project data type ‘Frame Config’ button to folder/file
monitored server) folders data, can edit existing or create new structure
include frame configurations
multiple
projects and
datasets

Orchestrating network performance | 122


AUTOMATIC DATA PROCESSING
Step 1: File Monitor

Select data metrics to be


processed and define binning
resolution for each frame; Metric
import configuration can be
accessed from the main toolbar
Configuration menu too

Orchestrating network performance | 123


AUTOMATIC DATA PROCESSING
Step 1: File Monitor

Project/dataset names
are automatically created
by the ADP unless they
are explicitly defined

Orchestrating network performance | 124


AUTOMATIC DATA PROCESSING
Step 1: File Monitor

Populate FTP settings when FTP host type


is selected including FTP server address,
port number, authentication parameters,
project root and backup folder, monitoring
interval, and remote and local file handling

Orchestrating network performance | 125


AUTOMATIC DATA PROCESSING
Step 1: File Monitor

Edit existing or define new


email template for delivery of
reports or status notifications

Orchestrating network performance | 126


AUTOMATIC DATA PROCESSING
Step 2: Output Data Source

Specific data source can


be selected in the left side
tree view for ADP output
generation

Selecting or deselecting a tree node


in one tree view will automatically
select or unselect the corresponding
node in the other tree view providing
Select to download FTP a node is already defined
server root project folder,
project and dataset folder
names

Orchestrating network performance | 127


AUTOMATIC DATA PROCESSING
Step 3: Output Scheduler
Specify the time of the day when
to check for new data to
generate the output, either fixed Data selection and filtering
time or a certain period after options – select date range
importing a batch of log files and time reference to
determine the data to be
considered for output
generation

Time data grouping options – ADP


Device grouping options – ADP output can be generated daily (or every
output can be generated per X days, or for weekdays only), weekly
device or for all devices (or for every X weeks), for user defined
combined discrete date ranges or per import batch

Orchestrating network performance | 128


AUTOMATIC DATA PROCESSING
Step 4: Output Type

Select Report, Problem


Summary or Batch PDF
output for measurement
data or Statistic Report
for statistic data
Output data can
be filetered per
geo region (UDR)

Specify the output folder


and optionally select email
distribution template

Orchestrating network performance | 129


CONTENT / AGENDA
• Introduction to TEMS Discovery

• Getting familiar with Tems Discovery .


• Getting Started
• Walk-U-Through Wizard ( how to create new project and import my data)
• Data Views
• Analysis set
• Scripts

• REPORT TEMPLATE BUILDER

• AUTOMATIC DATA PROCESSING

• Statistic Cubes

• Q&A

Orchestrating network performance | 130


OLAP CUBES BASICS
 OLAP is an acronym for OnLine Analytical
Processing
 Cube is a multi-dimension dataset designed to
facilitate and simplify data analysis
 The elements of a dimension can be organized
as a hierarchy
 Standard data navigation operations include
slice and dice, drill down, roll up, and pivot

Orchestrating network performance | 131


CUBE HANDLING

 Define data scopes by defining any subset of:


 Projects
 Data collection date or data processing
date
 The user can enable cube-processing on any data
scope/cube definition combination

 The user can define an OLAP cube process interval


(periodic cube processing essential for up to date
dashboard information)

Orchestrating network performance | 132


CUBE MANAGEMENT
 Create new, edit or delete existing cubes
 Activate/de-activate cube processing
 Check activation progress

Orchestrating network performance | 133


CUBE CREATOR

 Add any pre-defined or user-defined metric to


the list of cube measurements (Measurement
Group tab)
 Add any pre-defined or user-defined metric or
device attributes to the cube dimensions
 UDR attribute can be defined as an additional
cube dimension
 Select one or many condition expressions to
apply condition filtering on selected dataset

Orchestrating network performance | 134


CUBE DATA SCOPE CONFIGURATIONS

 Select the data source for a cube


 Restrict data processing time frame
 Define cube processing scheduler
 Define geo center for calculating geo area bins

Orchestrating network performance | 135


CONTENT / AGENDA

Q&A
Orchestrating network performance | 136
Thank you!
www.infovista.com

Orchestrating network performance |

You might also like