You are on page 1of 27

Data

Warehouse

Concepts
&
Architectur
e

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 1
Data Warehouse Concepts

Topics To Be Discussed:

• Why Do We Need A Data Warehouse ?

• The Goal Of A Data Warehouse ?

• What Exactly Is A Data Warehouse ?

• Comparison Of A Data Warehouse And


An Operational Data Store.

• Data Warehouse Trends.

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 2
Data Warehouse Concepts

Why Do We Need A Data Warehouse ?

We Can Only
See - What We
Can See !

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 3
Data Warehouse Concepts

Why Do We Need A Data Warehouse ?

BETTER !
FASTER ! FUNCTIONALLY COMP
CHEAPER !

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 4
Data Warehouse Concepts

Data Warehouse Development Perspect

Data Driven Vs. Function Driven

A/P
O/P
Order
Processing
Data
EIS
Data
DSS

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 5
Data Warehouse Concepts

What Do We Need To Do ?

Use Operational Legacy Systems’ Data:


To Build Operational Data Store,
That Integrate Into Corporate Data
Warehouse,
That Spin-off Data Marts.

Some May Tell You To Develop These In Reverse!

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 6
Data Warehouse Concepts

Our Goal for A Data Warehouse ?

• Collect Data-Scrub, Integrate & Make It Acc

• Provide Information - For Our Businesses

• Start Managing Knowledge

• So Our Business Partners Will Gain Wisdom

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 7
Data Warehouse Concepts

Data Warehouse Definition

A Data Warehouse Is A Structured Repos


of Historic Data.

It Is Developed in an Evolutionary Proces


By Integrating Data From Non-integrated
Legacy Systems.

It Is Usually:

• Subject
Oriented
• Integrated
• Time Variant
• Non-volatile

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 8
Data Warehouse Concepts

Subject Oriented

Data is Integrated and Loaded by Subject

Cust
1996

1996
Prod D/W
Data
1997

O/P
1998

A/R

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 9
Data Warehouse Concepts

Time Variant

Operational System Data Warehouse

• View of The • Designated Time


Business Today Frame (3 - 10
Years)
• Operational Time
Frame • One Snapshot Per
Cycle

• Key Need Not


Have Date • Key Includes Date

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 10
Data Warehouse Concepts

Integrated

Operational Systems

Order Processing Order ID = 10


D/W
Accounts Receivable Order ID = 12
Order ID = 16
Product Management Order ID = 8

HR System Sex = M/F


D/W
Payroll Sex = 1/2
Sex = M/F
Product Management Sex = 0/1

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 11
Data Warehouse Concepts

Non-Volatile

Operational System Data Warehouse

• “CRUD” Actions • No Data Update

Insert
Read
Load
Create
Read Read

Replace Read
Update

Delete Read

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 12
Data Warehouse Concepts

Data Warehouse Environment Architectu


Contains Integrated Data From Multiple Legacy Applic

Update
A/P
Insert
Data
Load Mart
O/P
Integration Read
ODS
Replace
Pay Criteria Data
Mart
Delete
All Or Part
Of System of
Mktg Record Data
ter ia
C ri
HR oad
e L
ous Data
areh Mart
W Loads
A/R ta D/W Load
Da

Best System of D/W


Record Data Read

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 13
Data Warehouse Concepts

Meta Data - Map of Integration


The Data That Provides the “Card Catalogue” Of
References For All Data Within The Data Warehou

System of Record
Data Source

D/W Structure
Source Data Structure

Definition

Allowable
Domains
Aliases

Data Relationships

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 14
Data Warehouse Concepts

ODS Vs. Data Warehouse

Operational Data Store Data Warehouse

Characteristics: Data Focused Integration Subject Oriented


From Transaction Processing Integrated
Focused Systems Non-Volatile
Time Variant
Age Of The Data: Current, Near Term Historic
(Today, Last Week’s) (Last Month, Qtrly, Five
Years)
Primary Use: Day-To-Day Decisions Long-Term Decisions
Tactical Reporting Strategic Reporting
Current Operational Results Trend Detection
Frequency Of Load: Twice Daily , Daily, Weekly Weekly, Monthly, Quarterly

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 15
Data Warehouse Concepts

Building The Data Warehouse

Tasks Deliverables

• Define Project • Scope Definition


Scope • Logical Data
• Define Business Model
Reqmts • Physical Database
• Define System of Data Model
Record Data • Operational Data
• Define Store Model
Operational Data • ODS Map
Store Reqmts
• Extract Tools and
• Map SOR to ODS Software
• Acquire / Develop • Populated ODS
Extract Tools
• Extract Data &
Load ODS

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 16
Data Warehouse Concepts

Building The Data Warehouse


(Continued)

Tasks Deliverables

• Define D/W Data • Transition Data


Reqmts Model
• Map ODS to D/W • D/W Data
• Document Integration Map
Missing Data • To Do Project List
• Develop D/W DB • D/W Database
Design Design
• Extract and • Integrated D/W
Integrate D/W Data Extracts
Data • Initial Data Load
• Load Data • On-going Data
Warehouse Access and
• Maintain Data Subsequent Loads
Warehouse

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 17
Data Warehouse Concepts

Relationship Among Data Warehouse Data Models

Business Business
Partner Business Requirements Requirements
Knowledge Logical
& Wisdom Model

Data
Warehouse Strategic
Validation Business
of Current
Physical RequirementsStructured
Model Requirements
Data

Operational
Data Store
Physical
Model Tactical Business
Data Reqmts & Structures
Load

Current Data Whse


Database Requirements
Current Structure
Physical Transition
Model Model

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 18
Data Warehouse Concepts

Sources of Data Warehouse Data

Archives
(Historic Data)

Current Systems
of Record
(Recent History)

Enterprise
Data Warehouse
Operational
Transactions
(Future Data Source)

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 19
Data Warehouse Concepts

Appropriate Uses of Data Warehouse D

• Produce Reports For Long Term Trend Analy

• Produce Reports Aggregating Enterprise Da

• Produce Reports of Multiple Dimensions


(Earned revenue by month by product by br

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 20
Data Warehouse
Concepts

Inappropriate Uses of Data Warehouse

• Replace Operational Systems

• Replace Operational Systems’ Rep

• Analyze Current Operational Resu

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 21
Data Warehouse Concepts

Levels of Granularity of Data Warehouse

•Atomic (Transaction)

•Lightly Summarized

•Highly Summarized

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 22
Data Warehouse Concepts

Options for Viewing Data

• Text

90
80
70
60

• 50
40
30
20
10
0
1s t 2nd 3rd 4th
Qtr Qtr Qtr Qtr

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 23
Data Warehouse Concepts

Next Steps In Data Warehouse Evolutio

• Use It - Analyze Data


Warehouse Data

• Determine Additional Data


Requirements

• Define Sources For Additional


Data

• Add New Data (Subject Areas)


to
Data Warehouse

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 24
Data Warehouse Concepts

Future Trends In Data Warehouse

• Increased Data Mining


Exploration
Prove Hypothesis

• Increase Competitive Advantage


(i.e., Identify Cross-selling
Opportunities)

• Integration into Supply Chain & e-


Business

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 25
Data Warehouse Concepts

Summary

A Data Warehouse Is A Structured Repos


of Historic Data.

It Is:
• Subject
Oriented
• Integrated
• Time Variant
• Non-volatile

It
Contains:
• Business Specified Data,
To Answer Business Questions

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 26
Data Warehouse Concepts

Questions and Answers

PP I
© Principle Partners, Inc.
Info@PrinciplePartners.Com Page 27

You might also like