You are on page 1of 46

Gartner Data & Analytics Summit

10 – 11 September 2019 / Mexico City

The Future of Data and


Analytics: How Augmented
Analytics Will Transform
Your Organization
Rita Sallam
@rsallam

© 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form
without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this
publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research
may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are
governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or
influence from any third party. For further information, see “Guiding Principles on Independence and Objectivity.”
10 years ago, we
struggled to find
10 ML-/AI-enabled
business applications ...

In 5 years, we will
struggle to find any
that aren’t.

1 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

1. Why is augmented analytics a key trend now?


2. What does augmented analytics enable? How is it different?
3. How can you leverage augmented analytics? What is the impact on
your existing investments, organization and skills?

2 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

1. Why is augmented analytics a key trend now?


2. What does augmented analytics enable? How is it different?
3. How can you leverage augmented analytics? What is the impact on
your existing investments, organization and skills?

3 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Digital business
means a more
complex,
continuously
changing business
environment.

Data and analytics is


central to success.

4 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
But this means …
more data,
more complex data,
more variables,
more complex
analysis to more
business people …

… beyond what can


be done manually.
5 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Residential Backed Security Litigation

Individual 1 Tranche A 5% Yield Investor 1

Tranche B 7% Yield
Individual 2 Investor 2
...

...
Tranche C 10% Yield

Individual N Investor N

6 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Today

Source: Tableau Software


7 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Analytics for the Few

35%
% of users using any BIA tool
Source: 2018 Gartner Magic Quadrant Reference Survey
8 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

1. Why is augmented analytics a key trend now?


2. What does augmented analytics enable? How is it different?
3. How can you leverage augmented analytics? What is the impact on
your existing investments, organization and skills?

9 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Augmented Analytics

Enables ML-/AI- Surfaces Most


Democratizes
Created Data and Important Actionable
Advanced Analytics
Analytics Insights in Context
Automates data With exploration and In a fraction of the time,
preparation, insight explanation in natural with less data science and
discovery and sharing language ML skill

Automated data science


and ML model Without prior knowledge
Embedded in applications
development, of the relationships in data
and prescriptive
management and to reduce bias
deployment

10 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Augmented Analytics Workflow
Augmented Data Preparation
Prepare Data
 Algorithms detect schemas, profile and catalog data, identify
data lineage and metadata, and recommend enrichment

Faster
Improved Accuracy
Augmented
Analytics
Reduced Bias
Share and Operationalize Find Patterns in
Findings Data and Building Models
 Natural language query
 Insights are narrated in natural language or visualizations  Algorithms find all relevant patterns in data
to focus user on what is important and actionable  Features are autoselected
 Embedded in apps or conversational UI  Models are autoselected
 Code is autogenerated
 Models management is augmented

Augmented Analytics in Analytics and BI Platforms


ID: 375087
Augmented Data Science and ML
11 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
How Augmentation Changes the Analytics and
BI Workflow

Users
Users
Users interpret Predict and
ID KPIs Build views explore
Data Data conduct results, prescribe
and and predefined Action
exploration preparation root cause share action to
questions dashboards dashboards
analysis findings users
and KPIs
and stories

Current Analytics and BI Workflow

Findings
Predictions
Users and
Serve best Root cause and
ID KPIs Augmented Augmented explore insights are
views and analysis is prescribed
and data data predefined narrated to Action
dashboards autogenera actions are
questions exploration preparation dashboards user in
to users ted for user served to
and KPIs natural
user
language

12 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Augmented Analytics in ABI Platforms Workflow
How Augmentation Changes the DS/ML Workflow

Hyper
Data Data Data Feature Model Model Deploy and
Parameter Infer
Acquisition Exploration Preparation Engineering Selection Training Manage
Tuning

Traditional Machine Learning Workflow

Hyper
Data Data Data Feature Model Model Deploy and
Parameter Infer
Acquisition Exploration Preparation Engineering Selection Training Manage
Tuning

13 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Augmented Machine Learning Workflow
With Augmented Analytics:
Here Is What Happened to Revenue

Source: Salesforce Einstein Analytics


14 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
With Augmented Analytics:
Automated Insight Generation of Key Findings

Source: Oracle Analytics Cloud


15 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
With Augmented Analytics: Conversational Interaction
via Natural Language Query and Generation

Sources: Sisense (left); ThoughtSpot (right)


16 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
With Augmented Analytics:
Natural Language Explanations of Findings

Source: Narrative Science and Tableau Software


17 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
With Augmented Analytics:
Embedded and Prescriptive

Source: Salesforce Einstein Analytics


18 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Auto Generate Insights on Order Value

Source: SAP Analytics Cloud


19 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Auto Generate Insights on Order Value

Source: SAP Analytics Cloud


20 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Auto Generate Insights on Order Value

Source: SAP Analytics Cloud


21 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Auto Generate Insights on Order Value

Source: SAP Analytics Cloud


22 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Exposing Hidden Cost Drivers Affecting
Patient Care

23 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
A Leading Visual-Based Data Discovery Vendor

Source: Tableau Software


24 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
What Drives Earning Power 10 Years
After College?

25 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Augmented Analytics Examples

Finance Marketing identified surprising Agriculture Domain specialist geneticists


wealth management segment. took over the process and
reduced process duration
Business people built models that to days.
reduced loan defaults in
microfinance by 5%. Identified a combination of
previously unknown factors that
changed physical asset planning.

Health Insurance Found previously unknown Retail Merchandisers improved


main cost driver for margin by 50% by automating
transportation costs. discount recommendations for
each product.
Found a previously unknown
life insurance purchasing driver
— time from a person’s birthday
— that changed upsell/
cross-sell rate.

26 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Disruption Points in the
Analytics and BI Market
 Machine-learning-led
High
 Pervasive, autodescriptive, diagnostic,
predictive, prescriptive
 Most significant insight for user to maximize
understanding and action
 Business-led descriptive/  Conversational analytics: NLP, NLQ and NLG
diagnostic
 Autovisualization of relevant patterns
 Free-form user interactivity
 Suggestions in user context — embedded
Pervasiveness of AI

 Best visualization in apps


 Tool-specific self-service data  Autodiscover new relevant data sources
 IT-led descriptive
preparation
 Predefined interactivity, KPIs  Open data and questions
 Structured, personal,
 IT-modeled, traditional data unmodeled data
integration Augmented Analytics
 Defined data and questions
 Summary data —
data warehouse Visual-Based Data
 Defined data and questions Discovery Platforms
Semantic Layer-
Based Platforms
Low
Months Days/Hours Instant/Near Real Time
Time to Advanced Insight

Today Two to Five Years


ID: 375087
30 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
 Big Squid

Disruption Points in the


 IBM Cognos Analytics

Augmented Analytics in
 Microsoft Power BI (Quick Insights)

Analytics and BI Market  Oracle Analytics Cloud

ABI Platforms
 Qlik
 Salesforce Einstein Discovery
 SAP Analytics Cloud
High  Sisense
 Tellius
 ThoughtSpot
 TIBCO Software’s Spotfire
 Yellowfin

Data Science
Augmented
 DataRobot
Pervasiveness of AI

 DataStories
 SparkBeyond
 IBM Cognos Analytics  H2O.ai
 Qlik
 Microsoft SSAS/SSRS
 Tableau Software
 MicroStrategy Augmented Analytics
 TIBCO Software’s Spotfire
 Oracle Business Intelligence
Enterprise Edition (OBIEE) Visual-Based Data
 SAP BusinessObjects Discovery Platforms
Semantic Layer-
Based Platforms
Low
Months Days/Hours Instant/Near Real Time
Time to Advanced Insight

SQL Server Analysis Services Today Two to Five Years


ID: 375087 SQL Server Reporting Services

31 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Perception of Augmented Analytics Impact

A. Low/No Impact 6% 9 Votes

B. Medium Impact 24% 39 Votes

C. High Impact 40% 64 Votes

D. Transformational 31% 50 Votes

0% 20% 40%
Percentage of Respondents

Q. How important do you think augmented analytics will be to scaling the value from analytics in your organization?
ID: 375087
32 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
How Are Next-Generation ABI Platforms and
Data Science and ML Platforms Different?

Augmented Analytics in Augmented Data Science


Analytics and BI Platforms and Machine Learning
 Citizen data scientists explore autogenerated models  Expert and citizen data scientists build and customize
models; focusing on where each adds most value
 End-user- or application-augmented

 Autogenerated models and insights  Embedded


 NLP/NLQ exploration  Assisted model building and customization, tuning, and
life cycle management
 NLG narration
 Best for proven algorithms

Collaboration Is Key; Convergence Will Increase Over Time

40 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Augmented Analytics Market Impact

By 2020, 50% of the analytic queries will be generated using search,


NLP, voice or autogenerated.
By 2020, 30% of today’s data scientist tasks will be automated.

By 2020, augmented analytics will be a dominant driver of new


purchases of analytics and BI as well as data science and machine
learning platforms, and of embedded analytics.

By 2021, conversational analytics and natural language processing


(NLP) will boost analytics and BI adoption from 35% of employees to
over 50% of an organization’s employees, to include new classes of
users particularly in front offices.
41 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

1. Why is augmented analytics a key trend now?


2. What does augmented analytics enable? How is it different?
3. How can you leverage augmented analytics? What is the impact on
your existing investments, organization and skills?

42 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Plan for Other Key Trends in Analytics and BI
Platforms
• Single platform for Mode 1 and Mode 2
• Conversational Analytics
• Complex models at scale
• Cloud adoption and innovation
– Multi Cloud
– Embedded augmented in applications
– Integrated data management options

• Embedded capabilities

43 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Align Your D&A Strategy to Support the Disruption —
Having Good Data Is Key — Augmented Analytics Is Also
Transforming EIM and Data Management
Raw Data Analytics
Tools and Apps

RDBMS Nonrelational
Stores Data
ABI Platforms
Data Data Catalogs for
Enterprise Enterprise
Cataloging Unification Data Curated
Metadata Data
IoT Data ERP/CRM for and Consoli- Preparation Data,
Mgmt. Integration
Raw Data dation Metrics and
Content DS/ML Platforms
Cloud Apps SaaS Data Data
Virtualization Quality

Open Data Device Analytics Apps

Traditional EIM Enterprise Master Data Management

Agile EIM Modern DataOps Platform — Supports Data Engineering

44 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Don’t Wait!
Start and Pilot With Small Data and
Align to Business Drivers to Prove Value

45 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Engage Business Stakeholders, Foster
Collaboration, Build Trust, Prove Value

Expert Data
Scientists
Business
App
People/
Developers
Leaders

Citizen Data
Data
Scientists/
Engineers
Analysts

DevOps

46 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Investing in Data Literacy Is
Even More Important as You
Make Advanced Insights Pervasive

47 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Develop Citizen Data Scientists, While Leveraging Augmented Data
Science and ML to Make Expert Data Scientist More Productive

Unique perspective
Contextualized vision
of individual
of the organization
business area

Proven application of
Curiosity to explore
analytic techniques to
and learn
business problems

Appetite for what


matters relative to Able to “go to bat” to
impact and business justify business value
priorities

Connections within IT Involved hands-on in


and the business at multiple analytic areas
multiple levels and activities

ID: 343732
48 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Where Citizen Data Scientists Fit?

The CDS Continuum

Business Business Data Application Citizen Citizen Data DevOps ML Ops


Analyst Intelligence Analyst/ Developer Developer Data Scientist (IT (Machine
Analyst/ Data Scientist Application Learning
Business Integrator/ Delivery) Model
Intelligence Citizen Delivery)
Developer Integrator/
Data
Engineer

ID: 343732
49 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Citizen Data Scientist Skills

Business
Intelligence Data Analyst/ ML Ops
Analyst/ Data Integrator/ (Machine
Business Citizen DevOps (IT Learning
Business Intelligence Integrator/ Application Citizen Citizen Data Data Application Model
Analyst Developer Data Engineer Developer Developer Scientist Scientist Delivery) Delivery)

Data
Knowledge 2 3 4 3 2 2 2 1 1

Data Skills 3 3 4 2 2 3 3 1 1

Business
Acumen 4 2 2 2 3 4 3 1 2

ML Modeling
Skills 2 2 1 1 2 3 4 1 1

Coding Skills 1 3 3 4 3 2 4 4 4

Soft Skills 4 3 2 2 4 4 2 1 1

Analytic  Data  Data  Data  Data  Data  Data  Data  Deploying  Deploying
Process Skills exploration exploration exploration exploration exploration exploration exploration  Monitoring/  Monitoring/
 Modeling  Modeling  Modeling  Modeling  Modeling Managing Managing
 Testing
 Deploying
 Monitoring/
None 1 2 3 4 Managing
Strong

ID: 343732
50 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Considerations When Evaluating Tools

• Embeddability, operationalization • Range of algorithms and data


• Openness of models types supported

• Accuracy • Number of variables supported

• Explanation of models • Upfront setup or


configuration/modeling required
• Identification of bias in models
• Data preparation

51 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
10 years ago, we
struggled to find
10 ML-/AI-enabled
business applications ...

In 5 years, we will
struggle to find any
that aren’t.

Augmented analytics is
transforming D&A
52 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Recommendations

Plan for augmented capabilities as part of your data and


analytics strategy.
Put vendors on notice! Ask those you already own as well as
innovative startups about what augmented analytics capabilities they
have today and planned for the future.
Pilot to demonstrate value and build trust; align with key business
drivers and stakeholders.
Plan for possible changes to roles, responsibilities and skills; invest in
data literacy.
Start small and backtest to prove value; foster collaboration with expert
data scientists.

53 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Recommended Gartner Research

 Augmented Analytics Is the Future of Data and Analytics


Rita Sallam, Cindi Howson and Carlie Idoine (G00326012)
 Rebalance Your Integration Effort With a Mix of Human and Artificial Intelligence
Eric Thoo and Ehtisham Zaidi (G00319151)
 Pursue Citizen Data Science to Expand Analytics Use Cases
Joao Tapadinhas and Carlie Idoine (G00316089)
 Hype Cycle for Analytics and Business Intelligence, 2017
Kurt Schlegel and Jim Hare (G00314848)
 Market Opportunity Map: Analytics and Business Intelligence, Worldwide
Alys Woodward, Jim Hare and Others (G00322846)
 Toolkit: Enabling Data Literacy and Information as a Second Language
Valerie Logan and Douglas Laney (G00332692)
For information, please contact your Gartner representative.
54 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Thank You!

55 © 2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.

You might also like