Professional Documents
Culture Documents
BI Guidebook
Analytics Design & Framework
subtitle
(Raqi, book, 35pts)
INTERNAL USE
Classification: Mobily INTERNAL USE
Document History
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
Current BI Landscape
BI Technology Stack:
INTERNAL USE
Classification: Mobily INTERNAL USE
Ensure that
visuals do not
Data should be
add
conveyed clearly
unnecessary
& accurately
visual noise
Use of clear
New Feature
labels & titles
Practice correct
Use of legends
color usage
INTERNAL USE
Classification: Mobily INTERNAL USE
1 2 3
4 5 6
Neutral
Emphasized
Neutral De-Emphasized
INTERNAL USE
Classification: Mobily INTERNAL USE
Dashboard:
It should contain visual display
of the most important and
high-level information about
the business function.
Analysis:
Reporting: The analysis pages
This page provides should allow the
actionable information. users to explore the
data further based on
the dashboard.
INTERNAL USE
Classification: Mobily INTERNAL USE
BI Operating Model
Figure 1: Proposed analytics services operating model of the futures
Strategic services
Functional services
Service delivery and support services
INTERNAL USE
Classification: Mobily INTERNAL USE
Data
Governance
Council
Works with CoE for development of processes,
leading practices, and standards.
Policies, Analytics
standards, and Center of
delivery Consists of cross-functional analytics experts that are
Excellence responsible for execution of the analytics strategy
oversight (CoE) and demand management (leading technologies,
processes, standards, and oversight of analytics
initiatives).
Architecture
review board
(ARB) Works with CoE for focus on larger technical
decisions, including tools, technology, and cross-
platform architecture.
Operational
Execution Formed within business and IT to work collaboratively
teams
to deliver on the data and analytics agenda. These
teams would be composed of both business (data
stewards, data scientists) and technical roles
(solution architects, data engineers, data architects)
INTERNAL USE
Classification: Mobily INTERNAL USE
‘Northeast’
and
‘Southeast’
region filters
are applied
on the page
INTERNAL USE
Classification: Mobily INTERNAL USE
3. Values selected in one visualization (source) can affect the data displayed in another visualization
(target).
Example: If nothing is selected in the source visual, all the data in the target visual will be visible.
Revenue
shown for all
categories
Once a value, say ‘IP’, is selected in the source visual, the rows containing ‘IP’ will be highlighted in
the source visual and the values in the target visual will be filtered as shown below.
Source Target
Region Category Profit Revenue Region Revenue
North IP $123 $234 North $234 Revenue
North Voice $342 $4335 South $543 shown for ‘IP’
North Optical $3420 $4532 category
South IP $234 $543
South Voice $4523 $5221
South Optical $789 $4523
In the below example, sales are shown by ‘Product Line,’ which gives a summarized view.
INTERNAL USE
Classification: Mobily INTERNAL USE
Only
‘Product
Line’
selected in
row
hierarchy
To drill-down and see the sales bifurcation for each Product Line, add ‘Category’ in Rows, which will
give the detailed view shown below.
‘Category’
added in
row
hierarchy
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
Format/ Layout
A uniform and consistent theme makes the report coherent and helps the user focus on the story
being conveyed. To format a dashboard and create a consistent layout, the color theme, fonts, and
colors of the dashboard’s objects can be selected.
1. Display theme for dashboard: MicroStrategy provides options to choose between light and dark
display themes to change the look of the dashboard.
INTERNAL USE
Classification: Mobily INTERNAL USE
2. Creating color palettes to customize display themes: Each display theme contains a built-in
color palette. A color palette applies to the individual objects, such as a graph’s bar risers, shown
throughout the visualizations in the dashboard. If the same attribute is used to color the objects in
different visualizations, the values for that attribute will use the same color in the visualizations.
This color palette can be overridden to accommodate customized color palettes to suit one’s
requirements.
INTERNAL USE
Classification: Mobily INTERNAL USE
Graphs/ Charts
Here’s a quick look at what types of graphics should be used for certain scenarios:
INTERNAL USE
Classification: Mobily INTERNAL USE
Color Scheme
The elements and structure of the report can be enhanced visually by adding colors. There are
different color groupings that help serve a specific purpose.
A good rule to follow is to avoid high levels of color saturation and brightness to reduce eye strain and
to allow room to highlight elements with the brand color. Below are some pointers:
1. Binary: Nominal differences can be divided into two (binary) categories: yes-no, agree-disagree
2. Sequential (Single Color): As a rule, colors are assigned to information values in a continuum
based on hue, lightness, or both. Typically, lower values are associated with lighter colors and
higher values with darker colors.
3. Divergent (Two-Hue): Values larger than the center are assigned to colors on one side of the
center, while smaller values get assigned to colors on the opposing side. Usually, a distinctive hue
is used for each of the component sequential palettes to make it easier to distinguish between
positive and negative values relative to the center.
4. Categorical: Separate colors are used to represent nominal differences, such as different races or
gender groups.
5. Highlighting: This is a special case of the categorical color scheme. These color schemes
highlight a certain value or group within the visualization. For example, we could use this palette to
emphasize a single or small group of points in a scatterplot.
Avoid rainbow: When choosing a color palette, avoid rainbow colors for the following reasons:
1. While a color ramp from light blue (small data values) to dark blue (large data values) makes
logical sense, the same logic cannot be used for two unrelated colors. For example, if purple and
orange are used, it cannot be said that purple means more than orange.
2. The rainbow color palette does not map to a number system. For example, the green color area is
wider than the light blue area, which means unit changes cannot be shown here.
INTERNAL USE
Classification: Mobily INTERNAL USE
Branding
Use the approved company logo for all dashboards and reports. The logo should be consistent in
terms of design, color, sizing, and positioning. The color themes used for the reports should
complement the logo.
Performance
For the dashboard to respond quickly to business users’ queries, consider the below steps:
Optimizing filters
Change the selectors from "slice" to "filters" to reduce the initial loading time
3 of the dashboard. Try to use the search box selector if there are too many
elements.
Data Types
The bedrock of any data visualization is the data. There are two major groupings of data types:
quantitative and qualitative. These can be further broken down into subcategories as below:
QUALITATIVE
INTERNAL USE
Classification: Mobily INTERNAL USE
QUANTITATIVE
DISCRETE CONTINUOUS
Ordered and exact values, but no Ordered and exact values, and a no
true zero. true zero.
e.g., degrees Fahrenheit e.g., height, weight
INTERNAL USE
Classification: Mobily INTERNAL USE
Signature
Name
Designation
INTERNAL USE
Classification: Mobily INTERNAL USE
Summary details
Request PF*
Business username*
Department Name*
Team Name*
Request Type *
Frequency details
Frequency Details *
Scheduling time *
Delivery Method *
What is the business purpose of the KPI/ Report? (What questions does it answer?) *
INTERNAL USE
Classification: Mobily INTERNAL USE
<To be filed by the Business User, <To be filled by the Business User, mention KPI definition,
mention KPI/ Report Name> formula/ logic, and business rules>
<To be filed by the Business User, <To be filled by the Business User, mention KPI definition,
mention KPI/ Report Name> formula/ logic, and business rules>
… …
.. ..
Data/Report layout*
<To be filled by the Business User, specify relevant comments about request>
Attachments
<To be filed by the Business User, <To be filled by the Business User, put attachment file
mention KPI Name> here>
<To be filed by the Business User, <To be filled by the Business User, put attachment file
mention KPI Name> here>
.. ..
.. ..
Data_Automation_R
equest_Form.docx
INTERNAL USE
Classification: Mobily INTERNAL USE
Control Framework
Objective is to provide industry best practices on Job schedules, exception handling and usage
tracking.
Alerts
Scheduling
Usage Tracking
Daily alerts can be configured to report the previous day’s sales. Below are some templates:
Template:
INTERNAL USE
Classification: Mobily INTERNAL USE
Users can also get email notification updates regarding job failure or technical system failures. Below
is a template of an email notification:
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
Average Execution Time: This KPI Number of Users: This KPI provides the
provides the average elapsed time to number of users that have logged in and
execute a report on the warehouse data accessed the dashboard. It can be used to
source. evaluate the extent of user adoption.
Administrators can use this KPI to confirm
the time frame of the data being loaded and
that it does not unnecessarily slow down the
server.
Total Executions: This KPI provides the Error Rate: This KPI gives the percentage
total number of times the dashboard has of reports that don't run to completion due to
been executed. Administrators can use this some error.
KPI to evaluate how frequently a dashboard
By using this KPI, appropriate actions can
is accessed.
be taken in case of a high error rate.
INTERNAL USE
Classification: Mobily INTERNAL USE
Advanced Analytics
Why do we Need BI Guidebook for Advanced Analytics?
The BI Guidebook for Advanced Analytics is a reference guide for analytics standards and industry
best practices. It also has practical steps to develop and implement advanced analytics initiatives at
Mobily.
This document explains the following topics in detail:
1. Framework for identifying and prioritizing analytics use cases for development
2. Framework to select analytics approach: segmentation or machine learning
3. Segmentation: best practices and key steps involved
4. Machine learning: best practices and key steps involved
Framework for Identifying and Prioritizing Analytics Use Cases for Development
The advanced analytics journey starts with identifying the right use cases that can be solved through
data and analytics. Since not all problems or opportunities can be solved through data analysis or
machine learning, we must identify the right set of business use cases for development.
INTERNAL USE
Classification: Mobily INTERNAL USE
The below table captures the list of questions that must be filled for each business use case.
To select analytics, use cases for development, Mobily needs to rank all use cases against 3 metrics:
1. Need of the organization
2. Overall business impact
3. Ease of implementation
The composite score of these metrics will be used to prioritize the analytics use cases (see below
format).
B. Overall
S. Analytical A. Need for C. Ease of Composite
business
No. use cases organization deployment rank
impact
1 Use Case 1
2 Use Case 2
3 Use Case 3
4 Use Case 4
5 Use Case 5
INTERNAL USE
Classification: Mobily INTERNAL USE
Business Data
understanding assessment
and Initial data Machine
availability Yes
analysis to Prediction learning
check define KPIs and required? Model
target development
Convert business definition.
problem to data Feasibility to do
science problem the analysis or
through issue tree prediction
approach
It is equally important to select the right use case for machine learning modeling. According to
research company Gartner, 85% of Machine Learning (ML) projects fail and that trend is predicted to
continue through 2022 because of how machine learning is applied to projects and solve business
problems.
The key reasons for machine learning model development failure are:
1 2 3 4
Using data that’s Thinking ML can Failing to Lack of
not “clean” solve any collaborate with infrastructure for
problem the operations ML model
team deployment
INTERNAL USE
Classification: Mobily INTERNAL USE
Can you
Do you need formulate your Refine your
Start Can you create
automation and problem problem
prediction? the rules? N N
Y clearly?
N Y
Y
N
N
N
There are primarily 3 types of segmentations being developed in the industry basis business use
cases:
1. Behavioral segmentation
2. Value segmentation
3. Needs-based segmentation
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
Segmentation Sophistication /
Pros Cons
Model Complexity
► Segmentation
► Easy to understand driven by things you
Behaviors
► Easy to attribute want to change in
your base
► Requires Primary
► Insightful about
Research
customers’ and
Needs ► Can be difficult to
prospects’
attribute to the
motivators
customer base
► Same as Model #1,
Needs
► Like Model #1, but in that it is a
segments are also segmentation
Behaviors
described by driven by the
average needs WHAT, not by the
WHY
► Combines the
► More complex to
PROs of Model #1
execute
Needs Behaviors and Model #2
► Attribution of the
► Creates an
Needs-Based side
actionable
can still be difficult
Opportunity Map
Given the importance of the actionable segment for client-centricity, the design of a common
methodology based on best practices will act as the foundation for Mobily.
The nine-step approach will build an effective segmentation for identified use cases. The nine-step
approach includes several sublevel tasks which will vary depending on segmentation type: Behavioral,
Needs, or Value. The generalized task-level model is presented below:
INTERNAL USE
Classification: Mobily INTERNAL USE
3 Source Data For 3.1 Identify data sources List the relevant data sources
Segmentation and the type of data to be
3.2 Append external third-party
identified.
data
For example, demographic,
3.3 Extract data & design
transactional data, third-party
analytics record
data, billing data, complaints
3.4 Create integrated view of data, etc..
customer
4 Data Treatments & 4.1 Analyze data quality 4.1.1. Data profiling (missing
Transformations data, null value, cardinality
4.2. Apply data treatments
check, data type check,
4.3 Apply data transformations duplication check)
4.2.1 Imputation of missing
values (fill in zeros, fill in
average, fill in max, fill in mode)
4.2.2 Conversion of data types
4.2.3 Removing duplicate
entries
4.3.1 Normalize (standardizing
the data by taking z value)
4.3.2 Taking logarithms of data
4.3.3 Moving averages
4.3.4 One hot encoding
4.3.5 Feature embedding
4.3.6 Principal component
analysis
INTERNAL USE
Classification: Mobily INTERNAL USE
6 Segment Profiling & 6.1 Profiling and reporting 6.1.1 RFM technique,
Identifying demographic, and life stage
6.2 Prioritize actionable
Actionable
segments 6.2.1 Prioritization matrix
Segments
8 Define Segment 8.1 Initiate segment strategy and Based on customer profiling,
Strategy & treatment identify the customer
Treatment segmentation strategy and
8.2 Design customer segment
upselling and design the
roadmap
roadmap accordingly.
INTERNAL USE
Classification: Mobily INTERNAL USE
Neural
Networks
Regression
Generalized
Linear Models
Supervised
Random
Forest
Tree Based
Gradient
Boosted
Networks
Classification
Logistic
Machine Regression
Learning
Support
Vector
Machine
Clustering
Unsupervised PCA
Dimension
Reduction
Factor
Reinforcement Analysis
Learning
Certain steps must be followed when applying a machine learning technique. Below is the generalized
list:
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
Unsupervised learning
► K-means
► K-modes
► Hierarchical clustering
► t-SNE cluster analysis
► Self-organizing maps
Reinforcement Learning
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
In case of a defect, the below approach can be followed to resolve the issue:
Root Cause
Issue root cause, cost of fix, impact to business
Analysis
Governance
RCA evaluated and prioritized for fix
Team
Integration
Code fix is tested by integrating with the entire code base
Test
User
End-user testing the fix for desired results
Verification
Monitor the fix for two weeks to ensure the issue does
Sustain
not come again
INTERNAL USE
Classification: Mobily INTERNAL USE
Incident Navigation
1. Incident priority and corresponding resolution time to be discussed with business and followed
through.
2. Industry leading incident management tool to be used for managing incident queue.
3. Incident log to be reviewed for prioritization, SLA adherence, etc.
INTERNAL USE
Classification: Mobily INTERNAL USE
3- Click on request and submit the request after filling the required.
If user is not been sync with LDAP Group, kindly raise below request
https://intranet/tech/Accessmanagement/One%20Identity%20User%20Guide/MIM%20-
%20AD%20Group%20Ad-hoc%20request%20Guide%20V1.0.pdf
INTERNAL USE
Classification: Mobily INTERNAL USE
4. Business Managers will have option to choose recipients of access from their reportees.
INTERNAL USE
Classification: Mobily INTERNAL USE
7. Select the desired group and click on “Submit request now” button on the bottom right side of the
screen:
INTERNAL USE
Classification: Mobily INTERNAL USE
9. Below screen indicates that your request has been submitted and routed to appropriate approver.
To view your request history, please click on “View the request History” as shown below:
10. Below page will show you your request history with newly requested item on top of the page.
INTERNAL USE
Classification: Mobily INTERNAL USE
12. Below page will show number of approvers and their details:
Remedy Access:
Please access the ‘bmc’ Remedy (Digital Workplace) by using the below URL:
https://remedysmart.prod.mobily.lan/dwp/app/#/catalog
Please enter your valid credentials in the below logon window.
INTERNAL USE
Classification: Mobily INTERNAL USE
Upon the approval of your credentials, ‘bmc’ Digital Workplace navigates you on the main page of
Remedy (as mentioned below).
To create a new request (CRQ) you need to follow the below steps:
Click on the “Browse categories” a drop-down list on left hand side of the main window.
INTERNAL USE
Classification: Mobily INTERNAL USE
You will be brought on the “IT Service Request” now search for Teradata in search bar (as mentioned
in below snapshot)
By clicking the “Teradata Change Request” a detailed form will pop-up with several empty fields, which
you need to fill from upside down. Please select the following fields as mentioned in below snapshot
as it is.
INTERNAL USE
Classification: Mobily INTERNAL USE
Remedy Access:
Please access the ‘bmc’ Remedy (Digital Workplace) by using the below URL:
https://remedysmart.prod.mobily.lan/smartit/app/#/ticket-console
Please enter your valid credentials in the below logon window.
Upon the successful logon, ‘bcm’ Digital Workplace navigates you on the main page of Remedy (as
mentioned below).
1. Click on Create New button.
2. Select Change Request option from the list.
4. Once Teradata DB Request option is selected. Check the radio button and move on by
clicking on the *Continue* button at the footer on the page:
INTERNAL USE
Classification: Mobily INTERNAL USE
It will take you to the main page of Change Request creation page.
7. *Change Coordinator* & *Coordinator Groups* are important fields to select, it will decide your
request/CRQ will be assigned to which Remedy assignment group?
8. Click the edit buttons (highlighted red) in the above snap, to correctly select the Change
Coordinator & Coordinator Group.
9. Uncheck the by-default selected check “Assign to me” (see the below snapshot).
10. Keep *Support Company* to All (default setting)
11. Select *Support Organization* to ‘IT Operation AOA’
12. Select *Support Organization* to ‘Teradata Database Team’
13. Select appropriate *Associate Name*.
INTERNAL USE
Classification: Mobily INTERNAL USE
After selecting the *Change Coordinator* & *Coordinator Groups*, next step is to select the *Change
Manager* and *Manager Support Group*.
14. Click on the edit button of * Manager Support Group*.
15. Select Support Organization as “IT Operation-AOA” (as shown in below snap)
16. Select “Teradata Database Team” as “Support Group”.
17. Click on “Azfar Rashid”, it will automatically select as a “Change Manager” (as per above
snapshot).
18. Click the “Submit” button to end the Request Change Form
INTERNAL USE
Classification: Mobily INTERNAL USE
Once Change Request form will submit, it will bring you the page which will be showing a summary of
submitted form (as shown below)
19. Click on the left side of the panel to assign the CRQ to Teradata Database Team’s queue.
20. Select “Request For Authorization” and click the “Save” button.
INTERNAL USE
Classification: Mobily INTERNAL USE
To check the submitted CRQ, put the CRQ number in the search field and click on the magnifying
glass to start the search.
Make sure CRQ status should be “Planning in Progress” (not draft) before contacting with Teradata
Ops team.
INTERNAL USE
Classification: Mobily INTERNAL USE
IT Incident
Operations Management Raised By:
Team IT Operations Priority 1
Tool
Description: Report
rendering is slow
Priority 2
Priority 3
Incident logged
Support Team
Incident allocation
Data Application
BI Engg DB
Reason identification Reporting Layer
Support hours
INTERNAL USE
Classification: Mobily INTERNAL USE
References
1. BI Operating Model
2. Data Types: Schwabish, Jonathan. Better Data Visualizations: A Guide for Scholars, Researchers,
and Wonks. Columbia University Press, 2021.
3. When to schedule alerts
4. How to Promote BI Culture – Track Usage
MicroStrategy Recommendations on Best Practices
1. Best practices while creating reports and documents
2. Best practices for enhancing performance on a mobile device
3. Best practices while planning reports and documents
MicroStrategy Success Stories
1. MicroStrategy for telecommunications
2. Genesys: Modernizing with Embedded Analytics
3. Retail banking credit card application by nice
4. Electric Vehicles in Europe and Washington State
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
INTERNAL USE
Classification: Mobily INTERNAL USE
Batch Processing can be used to process Real Time Processing is for fast and quick
large volumes of data, where a group of responsive processing that supplies an
transactions is collected over a period. The data immediate response. It is best suited in an
is collected, entered, and processed to produce environment where many events must be
batch results. accepted and processed in a short time.
Examples of where batch processing is used: Examples of where real time processing is used:
credit card transactions, bill generation, etc. bank ATM transactions, customer services,
radar system, weather forecasts, temperature
measurement, etc.
In real-time processing, the system remains active throughout and responds as and when new data is
received. In batch processing, the frequency is lower and based on decisive intervals.
Data Integration Challenges
Data integration offers an invaluable amount of information that lets a business implement new
innovative services. However, it also has its challenges.
The data is available, but it’s not centralized and there’s no plan for how to combine these disparate
sources into one unified source. Expecting human power to perform this level of data integration is a
waste of time and precious human resources.
This leads to the second problem: the existence of data silos, where groups of data are inaccessible
to all but one department.
Organization-wide information silos happen when there’s no alignment on how, who, and where to
enter and update data. Every team possesses a different, but equally valuable, facet of data that can
provide insights not available to others. For example, a marketing team’s targeted email campaign to
INTERNAL USE
Classification: Mobily INTERNAL USE
existing customers will be much more effective if they have access to customer data collected by the
customer support team. Without it, they would lose out on time, resources, and opportunities.
There are some instances where real-time or near real-time data collection is necessary. For
example, a retailer with an e-commerce site may want to display targeted ads to individuals based on
search history. In order for this to work, data would need to be collected in a certain time span.
Manually collecting this kind of data would be a monumental task that would be near impossible, not
to mention highly inefficient.
A business can collect data through a number of applications, from accounting and billing software to
lead generation tools to CRM. However, each of these tools is likely used and maintained by different
teams, which means that each has their own process for inputting and updating data, including its
format. Even with the same exact type of data such as phone numbers, one team could enter it as
(00) 555-5555, while another team formats it as +00 555 5555.
To minimize the amount of bad data entering the system, and the consequences such as lost revenue
and missed insights, it’s imperative to validate data early on in the process. It’s also useful to monitor
the data pipelines on a regular basis so that outliers can be identified before they become bigger
problems.
Data quality management is an essential part of the process that drives innovation and results in more
accurate business decisions.
One of the biggest issues is data duplication, which is when there are multiple copies of the same data
source across an organization. This occurs across a large majority of businesses (92% are aware of
this issue) and is often the result of not having a centralized source and the silo mentality mentioned
above.
Duplicates may seem harmless but when left unchecked, they can cause unexplainable variations and
negatively impact the quality of your data and the processes surrounding them.
Open communication across an organization and data sharing are the first steps towards successful
data integration. But it doesn’t stop there. It’s equally important to establish a common understanding
of data definitions and permissions.
By ensuring that there is a roadmap and clear ownership of data, it will help eliminate issues that arise
from misinformation and misalignment.
Overcoming the data integration challenge
Given how quickly and how much data is being created today, managing that data is becoming
increasingly critical to an organization’s success. It’s important to take a step back, review the
business goals, and identify which of these challenges could be blocking progress. By understanding
the cause and how to overcome or avoid these issues, you can accelerate business transformation
and ensure that you get the most value from the applications, functions, and processes being used.
INTERNAL USE