0% found this document useful (0 votes)
163 views33 pages

Gartner Data AI

Uploaded by

rabie sofany
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
163 views33 pages

Gartner Data AI

Uploaded by

rabie sofany
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Gartner

Webinars
Gartner delivers actionable, objective
insight, guidance and tools to enable
stronger performance on your
organization’s mission critical priorities
Enhance your webinar experience

Ask a Download Watch


Question Attachments Again

RESTRICTED DISTRIBUTION
2 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
Connect with Gartner
Ready Your Data for AI

Mark Beyer
Distinguished VP Analyst

RESTRICTED DISTRIBUTION
3 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
Algorithms Are “Off the Shelf,” Including GenAI —
Differentiation Is in the Data!
DNN or
GPT-4?

Reproduce a
Data in UTF-8 Null values as …
model on the
earlier data
Data in a PDF Unlicensed datasets

Python package
Dude who created data left the company conflicts

DNN = Deep neural network


4 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

What does AI-ready data mean?

What are the risks and challenges?

How should data management evolve to support


these requirements?

5 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

What does AI-ready data mean?

What are the risks and challenges?

How should data management evolve to support


these requirements?

6 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Common Misconceptions

AI initiatives require data. Not having AI-ready data


is a “showstopper.”
Data can be always AI-ready if built right.

My data management is not mature. My data can’t be AI-ready.

High data quality is a prerequisite to AI data readiness.

Master data is AI-ready because it is centrally governed.

7 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
We never
discussed
analytics-ready
data

Source: Narrative Science Launches New Collaboration With Microsoft, Built In Chicago
8 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Humans and AI Do Not See Data in the Same Way

AI builds up from details.

Humans fill in the missing details


with experience

9 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
There Are Different Optimization
AI Techniques
and Use Cases Rules/heuristics
AI does not revolve
around GenAI
Simulation AI is a broad
space with
many different
techniques
and practices
Nongenerative
machine learning

Graphs
Generative models
One out of many
AI practices
Source: Gartner
10 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Align
data

Making Your Data


AI-Ready AI-ready
data

Govern Qualify
contextually continuously

Source: Gartner
11 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

What does AI-ready data mean?

What are the risks and challenges?

How should data management evolve to support


these requirements?

12 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Data Is Not Ready for AI? Perception or Reality?
4%
4%
No response
Data is AI-ready

37%
Well-positioned to
55% have AI-ready data
Difficult to have
AI-ready data

n = 72 CIO and senior IT leaders from North America, the U.K. and Europe
Source: 2023 Gartner IT Symposium Research Super Focus Group (7 August 2023)
More than half of the respondents came from the C-suite and large enterprises.
Note: The data was collected through a live polling session as part of our research for the 2023 IT Symposium Opening Keynote.
13 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Formal data management
practices are not
what you need.

You need to know all the


formal and informal ways
data is managed.

14 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Common Data Management Practices Are Too
Slow, Too Structured and Too Rigid for AI Teams
Data lake
Organized by zones
General data flow
Ingestion Landing Processing Staging Consumption • Assumes the data is collected.
Reports &
Stream Stream Stream Stream operational
ingestion landing zone processing staging zone intelligence • Uses of data are not
Data warehouse Data
well documented.
Processing Staging zone warehouse
• Cross-architecture functions and
(optimization, Data science
quality, Data zone
Analytics tools practices are lagging behind.
Bulk/batch Bulk/batch
standardization,
ingestion landing zone
aggregation,
machine
Self-service
data zone
Self-service
tools
• Data is often siloed across
learning, artificial various repositories, multiple
intelligence, etc.) Customer
data zone
Marketing tools systems and platforms.

Archive zone

Cross-architecture functions
Governance, curation, metadata, catalog, data integration, pipelines, orchestration, quality, security

15 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
LLMs Use Data in a New Way:
It Is All About Semantics!
Response Validate, filter & summarize Fine-tuning

User Question LLMs

Semantics Contextually
engineered prompt
RAG
Instructions
+
Data repository Context
Integration Data Feeds Knowledge Service/chain/pipeline +
Question
management Base
Transform and cleanse to build your training corpus

Vector DB/index
Knowledge graphs
Data LLM/agent
Data sources

LLM = large language model; RAG = retrieval-augmented generation


16 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Having Data Ready for AI Drives Greater Business
Outcomes by 20%
Impact of AI on business outcomes by data-readiness for organization’s AI initiatives
Top 2 box (7 — extremely impactful, 6 — mostly impactful)

Data ready for AI (8-19) Data not ready for AI (0-7) Statistical significance differences
n = 151-155 n = 99-101 between groups

100%
81% 79% 76% 77%
73%
64% 61% 56% 54% 51%
50%

0%
Revenue growth Cost optimization Risk reduction Customer Employee
experience and productivity
retention improvement
n = varies, main sample who has deployed AI
Q: How impactful has AI been to each of the following business outcomes for your organization?
Q: How ready is your organization’s data for your AI initiatives?
Source: 2023 Gartner AI in the Enterprise Survey
17 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Key Issues

What does AI-ready data mean?

What are the risks and challenges?

How should data management evolve to support


these requirements?

18 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Data Management Must Evolve to Meet AI Needs
Connected

Data
innovations AI-specific
that also work data innovations
for AI
Traditional data
Continuous AI-ready data Curated AI-ready data
management
Evergreen data
management Data sharing
classics applies
to AI

Contextual

19 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Assess Your Common AI techniques

Data Needs
Nongenerative
Generative Rules/
Use-case families machine Optimization Simulation Graphs
models heuristics
learning

Depending Prediction/
L H L H M L

on the AI
forecasting

Planning L L H M M H

Technique Decision intelligence L M H H H M

Autonomous systems L M H M M L

AI techniques Segmentation/
M H L L H H
classification
heat map
Recommendation
M H M L M H
systems
AI techniques stability
Perception M H L L L L
Low (L)
Intelligent automation M H L L H M
Medium (M)
Anomaly detection/
M H L M M H
High (H) monitoring

Content generation H L L H L L

Conversational user
H H L L M H
interfaces

Knowledge discovery H M L L M H

Source: Gartner
20 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Data Management Must Expand to Meet AI Needs
AI-ready
Make your data ready for AI
Make your AI ready for data

Foundational Advanced data AI specific data


Data management management techniques
Data warehouses, marts Data fabric Data labelling
Data lakes, lakehouses Data observability Synthetic data
Traditional Data quality Active metadata Data enrichment
management AI-ready
data
data
management Data governance Knowledge graphs Data bias mitigation
Data preparation DataOps Chunking/
vector embedding
Data catalogs Data products Prompt engineering
Data lineage Data mesh Feature engineering

21 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
AI-Ready Data

Alignment Qualification Governance

• Quantification • Consistency • Data stewardship


Align assessment
data • Semantics • Inference
• Validation and derivation
• Quality
and verification
• Regulatory
• Trust and fairness
AI-ready • Operational SLAs and compliance
data • Diversity
• Versioning • AI standards
• Lineage support
• Continuous
Govern Qualify regression testing • Data sharing
contextually continuously
• Observability
metrics

23 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Making Your Metadata
Data AI-Ready management

Align
data

AI-ready
data

D&A Data
governance Govern Qualify observability
contextually continuously

D&A = data and analytics


24 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Start With “Some” Metadata —
You Don’t Need It All
Passive Accumulation of trust Active

Alignment

Alerts Orchestration

Usage and Content


utilization and design

Recommendations Preparation
Exception
System, data and Runtime log Compare design Send alerts when
interface designs information with runtime things change

When data starts to have design or quality issues, that is a signal that the business is
changing, which means changes to infrastructure and architecture might be needed.

25 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Staff Your AI Team With Data Product Managers

Data managers Data consumers


• Data engineers • Business analysts
• Data architects • Data scientists
• Prompt engineers • AI engineers
• Data stewards • AI developers

XOps experts:
• App engineers
Data product manager • Automation experts
• Test engineers

Business
Businessstakeholders
stakeholders
Business stakeholders

26 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Recommendations

Make data management an AI strategic priority.


Politely explain that the traditional “single version of the truth”
is biased. Especially true with AI — which learns bias
and discernment.
Develop metadata management, data observability
and D&A governance in support of AI.
Put in place cross-functional teams to support your
AI-ready data requirements.
Learn and expand AI uses of data by leveraging metadata
that comes out of AI processes continuously.
27 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates.
Ask the speaker

RESTRICTED DISTRIBUTION
28 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
Gartner Data &
Analytics Summit
3 – 5 March 2025 | Orlando, FL
At this year’s conference, you’ll learn to:
28 – 29 April 2025 | São Paulo, Brazil
12 – 14 May 2025 | London, U.K.
Implement strategies and innovations
20 – 22 May 2025 | Tokyo, Japan
backed by data and analytics to
2 – 3 June 2025 | Mumbai, India
navigate disruption.
17 – 18 June 2025 | Sydney, Australia

Gartner Data & Analytics Summit offers content for Harness the growing power of AI
every member of your data and analytics team — effectively and responsibly for decision
from technical- to senior-level strategy. Join data
augmentation, process optimization
and analytics leaders to gain the skills to build and
execute a world-class strategy. and even autonomous operations.

Learn more:
Scale your purpose beyond organizational
gartner.com/conferences/data
silos, across value chains and ecosystems to
Register with code GARTNERWEB foster societal perseverance.
for a discount on the standard price.

RESTRICTED DISTRIBUTION
29 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
AI-Ready Data
Essentials
Access your guide to key actions and
stakeholders on the roadmap to AI-ready
data.

Download the Research

© 2024 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. or its affiliates. This presentation, including all supporting materials,is proprietary to Gartner, Inc. and/or its
affiliates and is for the sole internal use of the intended recipients. Because this presentation may contain information that is confidential, proprietary or otherwise legally protected, it may not be further copied,
distributed or publicly displayed without the express written permission of Gartner, Inc. or its affiliates. All rights reserved.
Gartner for IT on
social media

Want to stay in-the-know? Connect


with us on LinkedIn and Twitter to
receive the latest Gartner IT insights
and updates across research, events
and more. It’s all curated specifically
for IT leaders and decision-makers.

Follow us on

Looking for insights delivered to


your inbox?
Subscribe to our bi-weekly newsletter.

RESTRICTED DISTRIBUTION
© 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
Become a Client
Clients receive 24/7 access to proven management
and technology research, expert advice,
benchmarks, diagnostics and more.

Fill out the form to connect with a representative


and learn more.

Learn More

Or give us a call: +441784614280 | +1 855 637 0291


8 a.m. – 7 p.m. ET
8 a.m. – 5 p.m. GMT
Monday through Friday

RESTRICTED DISTRIBUTION
32 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
Get more Gartner insights

Download the research slides

View upcoming and on-demand Gartner webinars


at gartner.com/webinars

Rate this session

RESTRICTED DISTRIBUTION
33 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.
Rate this session

RESTRICTED DISTRIBUTION
34 © 2024 Gartner, Inc. and/or its affiliates. All rights reserved.

You might also like