Data Warehouse Concepts & Architecture

© Principle Partners, Inc.

Page 1


Data Warehouse Concepts Topics To Be Discussed:

Why Do We Need A Data Warehouse ?
The Goal Of A Data Warehouse ?

• •

What Exactly Is A Data Warehouse ?
Comparison Of A Data Warehouse And An Operational Data Store. Data Warehouse Trends.
Page 2

© Principle Partners, Inc.


What We Can See ! © Principle Partners. Inc.Data Warehouse Concepts Why Do We Need A Data Warehouse ? We Can Only See . Info@PrinciplePartners.Com Page 3 PP I .

Data Warehouse Concepts Why Do We Need A Data Warehouse ? BETTER ! FASTER ! CHEAPER ! FUNCTIONALLY COMPLETE ! © Principle Partners. Info@PrinciplePartners. Inc.Com Page 4 PP I .

Com Page 5 PP I .Data Warehouse Concepts Data Warehouse Development Perspective Data Driven Vs. Inc. Function Driven O/P Data A/P Order Processing EIS Data DSS © Principle Partners. Info@PrinciplePartners.

Inc.Data Warehouse Concepts What Do We Need To Do ? Use Operational Legacy Systems’ Data: To Build Operational Data Store. Some May Tell You To Develop These In Reverse! © Principle Partners.Com Page 6 PP I . That Spin-off Data Marts. Info@PrinciplePartners. That Integrate Into Corporate Data Warehouse.

For Our Businesses • Start Managing Knowledge • So Our Business Partners Will Gain Wisdom ! © Principle Partners.Data Warehouse Concepts Our Goal for A Data Warehouse ? • Collect Data-Scrub. Inc. Integrate & Make It Accessible • Provide Information . Info@PrinciplePartners.Com Page 7 PP I .

Com PP I .Data Warehouse Concepts Data Warehouse Definition A Data Warehouse Is A Structured Repository of Historic Data. It Is Developed in an Evolutionary Process By Integrating Data From Non-integrated Legacy Systems. It Is Usually: • • • • Subject Oriented Integrated Time Variant Non-volatile Page 8 © Principle Partners. Info@PrinciplePartners. Inc.

Com Page 9 PP I .Data Warehouse Concepts Subject Oriented Data is Integrated and Loaded by Subject Cust 1996 1996 1997 D/W Data Prod O/P 1998 A/R © Principle Partners. Inc. Info@PrinciplePartners.

Com Page 10 PP I .Data Warehouse Concepts Time Variant Operational System Data Warehouse • View of The Business Today • Designated Time Frame (3 .10 Years) • Operational Time Frame • One Snapshot Per Cycle • Key Need Not Have Date • Key Includes Date © Principle Partners. Inc. Info@PrinciplePartners.

Info@PrinciplePartners.Data Warehouse Concepts Integrated Operational Systems Order Processing Order ID = 10 D/W Accounts Receivable Order ID = 12 Order ID = 16 Product Management Order ID = 8 HR System Payroll Sex = M/F D/W Sex = 1/2 Sex = M/F Product Management Sex = 0/1 © Principle Partners.Com Page 11 PP I . Inc.

Inc.Com Page 12 PP I . Info@PrinciplePartners.Data Warehouse Concepts Non-Volatile Operational System Data Warehouse • “CRUD” Actions • No Data Update Insert Load Read Read Read Read Create Update Read Replace Delete © Principle Partners.

Info@PrinciplePartners.Data Warehouse Concepts Data Warehouse Environment Architecture Contains Integrated Data From Multiple Legacy Applications A/P O/P Pay Criteria Load Update Insert Data Mart Integration ODS All Or Part Of System of Record Data Read Replace Delete Data Mart Mktg HR A/R Best System of Record Data © Principle Partners. Inc.Com D/W Load Read Data Mart Loads D/W Page 13 PP I .

Com Page 14 PP I . Inc.Map of Integration The Data That Provides the “Card Catalogue” Of References For All Data Within The Data Warehouse Data Source Source Data Structure System of Record D/W Structure Definition Allowable Domains Data Relationships Aliases © Principle Partners.Data Warehouse Concepts Meta Data . Info@PrinciplePartners.

Last W eek’s) (Last M onth. Daily. Inc. Qtrly. Five Years) Day-To-Day Decisions Long-Term Decisions Tactical Reporting Strategic Reporting Current Operational Results Trend Detection Twice Daily . W eekly W eekly. Info@PrinciplePartners.Data Warehouse Concepts ODS Vs. M onthly. Quarterly © Principle Partners.Com Page 15 PP I . Data Warehouse Operational Data Store Characteristics: Data W arehouse Age Of The Data: Primary Use: Frequency Of Load: Data Focused Integration Subject Oriented From Transaction Processing Integrated Focused Systems Non-Volatile Time Variant Current. Near Term H istoric (Today.

Inc.Com Page 16 PP I . Info@PrinciplePartners.Data Warehouse Concepts Building The Data Warehouse Tasks Deliverables • Define Project Scope • Define Business Reqmts • Define System of Record Data • Define Operational Data Store Reqmts • Map SOR to ODS • Acquire / Develop Extract Tools • Extract Data & Load ODS • Scope Definition • Logical Data Model • Physical Database Data Model • Operational Data Store Model • ODS Map • Extract Tools and Software • Populated ODS © Principle Partners.

Data Warehouse Concepts Building The Data Warehouse (Continued) Tasks Deliverables • • • • • Define D/W Data Reqmts Map ODS to D/W Document Missing Data Develop D/W DB Design Extract and Integrate D/W Data • Load Data Warehouse • Maintain Data Warehouse • • • • • Transition Data Model D/W Data Integration Map To Do Project List D/W Database Design Integrated D/W Data Extracts • Initial Data Load • On-going Data Access and Subsequent Loads © Principle Partners. Inc.Com Page 17 PP I . Info@PrinciplePartners.

Com Page 18 PP I .Data Warehouse Concepts Relationship Among Data Warehouse Data Models Business Partner Knowledge & Wisdom Business Requirements Data Warehouse Physical Model Business Requirements Logical Model Validation of Current Data Strategic Business Requirements Structured Requirements Operational Data Store Data Load Current Database Physical Model Physical Model Tactical Business Reqmts & Structures Current Structure Data Whse Requirements Transition Model © Principle Partners. Inc. Info@PrinciplePartners.

Data Warehouse Concepts Sources of Data Warehouse Data Archives (Historic Data) Current Systems of Record (Recent History) Enterprise Data Warehouse Operational Transactions (Future Data Source) © Principle Partners. Info@PrinciplePartners.Com Page 19 PP I . Inc.

Com Page 20 PP I . Inc. Info@PrinciplePartners.Data Warehouse Concepts Appropriate Uses of Data Warehouse Data • • Produce Reports For Long Term Trend Analysis Produce Reports Aggregating Enterprise Data • Produce Reports of Multiple Dimensions (Earned revenue by month by product by branch) © Principle Partners.

Data Warehouse Concepts Inappropriate Uses of Data Warehouse Data • Replace Operational Systems Replace Operational Systems’ Reports Analyze Current Operational Results • • © Principle Partners.Com Page 21 PP I . Inc. Info@PrinciplePartners.

Com Page 22 PP I .Data Warehouse Concepts Levels of Granularity of Data Warehouse Data •Atomic (Transaction) •Lightly Summarized •Highly Summarized © Principle Partners. Inc. Info@PrinciplePartners.

Inc. Info@PrinciplePartners.Data Warehouse Concepts Options for Viewing Data • • 9 8 7 6 5 4 3 2 1 0 0 0 0 0 0 0 0 0 0 Text 1 s t Q tr 2 n d Q tr 3 rd Q tr 4 th Q tr • © Principle Partners.Com Page 23 PP I .

Analyze Data Warehouse Data • Determine Additional Data Requirements • Define Sources For Additional Data • Add New Data (Subject Areas) to Data Warehouse © Principle Partners.Com Page 24 PP I .Data Warehouse Concepts Next Steps In Data Warehouse Evolution • Use It . Inc. Info@PrinciplePartners.

Inc. Info@PrinciplePartners.e. Identify Cross-selling Opportunities) • Integration into Supply Chain & e-Business © Principle Partners.Data Warehouse Concepts Future Trends In Data Warehouse • Increased Data Mining Exploration Prove Hypothesis • Increase Competitive Advantage (i.Com Page 25 PP I ..

Info@PrinciplePartners.Data Warehouse Concepts Summary A Data Warehouse Is A Structured Repository of Historic Data. It Is: • • • • It Contains: • Subject Oriented Integrated Time Variant Non-volatile Business Specified Data. To Answer Business Questions Page 26 © Principle Partners. Inc.Com PP I .

Com Page 27 PP I . Info@PrinciplePartners. Inc.Data Warehouse Concepts Questions and Answers © Principle Partners.

Sign up to vote on this title
UsefulNot useful