Data Warehouse Concepts & Architecture

© Principle Partners, Inc.
Info@PrinciplePartners.Com

Page 1

PP I

Data Warehouse Concepts Topics To Be Discussed: • • • • Why Do We Need A Data Warehouse ? The Goal Of A Data Warehouse ? What Exactly Is A Data Warehouse ? Comparison Of A Data Warehouse And An Operational Data Store.

• Data Warehouse Trends.
© Principle Partners, Inc.
Info@PrinciplePartners.Com

Page 2

PP I

What We Can See ! © Principle Partners.Data Warehouse Concepts Why Do We Need A Data Warehouse ? We Can Only See . Info@PrinciplePartners.Com Page 3 PP I . Inc.

Data Warehouse Concepts Why Do We Need A Data Warehouse ? BETTER ! FASTER ! CHEAPER ! FUNCTIONALLY COMPLETE ! © Principle Partners. Inc.Com Page 4 PP I . Info@PrinciplePartners.

Com Page 5 PP I .Data Warehouse Concepts Data Warehouse Development Perspective Data Driven Vs. Function Driven O/P Data DSS A/P Order Processing EIS Data © Principle Partners. Inc. Info@PrinciplePartners.

Info@PrinciplePartners. Inc. That Integrate Into Corporate Data Warehouse.Com Page 6 PP I . Some May Tell You To Develop These In Reverse! © Principle Partners. That Spin-off Data Marts.Data Warehouse Concepts What Do We Need To Do ? Use Operational Legacy Systems’ Data: To Build Operational Data Store.

Com Page 7 PP I .For Our Businesses • Start Managing Knowledge • So Our Business Partners Will Gain Wisdom ! © Principle Partners. Inc. Integrate & Make It Accessible • Provide Information .Data Warehouse Concepts Our Goal for A Data Warehouse ? • Collect Data-Scrub. Info@PrinciplePartners.

Com Subject Oriented Integrated Time Variant Non-volatile Page 8 PP I . It Is Usually: • • • • © Principle Partners. Info@PrinciplePartners. It Is Developed in an Evolutionary Process By Integrating Data From Non-integrated Legacy Systems.Data Warehouse Concepts Data Warehouse Definition A Data Warehouse Is A Structured Repository of Historic Data. Inc.

Inc.Com Page 9 PP I .Data Warehouse Concepts Subject Oriented Data is Integrated and Loaded by Subject Cust 2001 2003 2002 D/W Data Prod O/P 2002 A/R © Principle Partners. Info@PrinciplePartners.

Info@PrinciplePartners. Inc.Data Warehouse Concepts Time Variant Operational System Data Warehouse • View of The Business Today • Operational Time Frame • Designated Time Frame (3 .10 Years) • One Snapshot Per Cycle • Key Need Not Have Date • Key Includes Date © Principle Partners.Com Page 10 PP I .

Com Page 11 PP I .Data Warehouse Concepts Integrated Operational Systems Order Processing Order ID = 10 D/W Accounts Receivable Order ID = 12 Order ID = 16 Product Management Order ID = 8 HR System Payroll Sex = M/F D/W Sex = 1/2 Sex = M/F Product Management Sex = 0/1 © Principle Partners. Info@PrinciplePartners. Inc.

Data Warehouse Concepts Non-Volatile Operational System Data Warehouse • “CRUD” Actions • No Data Update Insert Load Create Update Read Replace Read Read Read Read Delete © Principle Partners. Info@PrinciplePartners. Inc.Com Page 12 PP I .

Info@PrinciplePartners. Inc.Data Warehouse Concepts Data Warehouse Environment Architecture Contains Integrated Data From Multiple Legacy Applications A/P O/P Pay Criteria Load Update Insert Data Mart Integration ODS All Or Part Of System of Record Data Read Replace Delete Data Mart Mktg HR A/R Best System of Record Data © Principle Partners.Com D W ta a a o reh e us L d oa C rite ria Data Mart Loads D/W D/W Load Read Page 13 PP I .

Map of Integration The Data That Provides the “Card Catalogue” Of References For All Data Within The Data Warehouse Data Source Source Data Structure System of Record D/W Structure Definition Allowable Domains Data Relationships Aliases © Principle Partners. Info@PrinciplePartners.Data Warehouse Concepts Meta Data .Com Page 14 PP I . Inc.

Qtrly. Five Years) Prim Use: ary Day-To-Day Decisions Long-Term Decisions Tactical Reporting Strategic Reporting Current Operational Results Trend Detection Frequency Of Load: Twice Daily . Near Term H istoric (Today. W eekly W eekly.Com Page 15 PP I . Daily. Data Warehouse Operational Data Store Characteristics: Data W arehouse Data Focused Integration Subject Oriented From Transaction Processing Integrated Focused Systems Non-Volatile Tim Variant e Age Of The Data: Current.Data Warehouse Concepts ODS Vs. M onthly. Last W eek’s) (Last M onth. Inc. Quarterly © Principle Partners. Info@PrinciplePartners.

Com Page 16 PP I .Data Warehouse Concepts Building The Data Warehouse Tasks Deliverables • Define Project Scope • Define Business Reqmts • Define System of Record Data • Define Operational Data Store Reqmts • Map SOR to ODS • Acquire / Develop Extract Tools • Extract Data & Load ODS • Scope Definition • Logical Data Model • Physical Database Data Model • Operational Data Store Model • ODS Map • Extract Tools and Software • Populated ODS © Principle Partners. Info@PrinciplePartners. Inc.

Inc.Data Warehouse Concepts Building The Data Warehouse (Continued) Tasks Deliverables • • • • • Define D/W Data Reqmts Map ODS to D/W Document Missing Data Develop D/W DB Design Extract and Integrate D/W Data • Load Data Warehouse • Maintain Data Warehouse • • • • • Transition Data Model D/W Data Integration Map To Do Project List D/W Database Design Integrated D/W Data Extracts • Initial Data Load • On-going Data Access and Subsequent Loads © Principle Partners. Info@PrinciplePartners.Com Page 17 PP I .

Com Page 18 PP I . Inc.Data Warehouse Concepts Relationship Among Data Warehouse Data Models Business Partner Knowledge & Wisdom Business Requirements Business Requirements Logical Model Validation of Current Data Data Warehouse Physical Model Strategic Business Requirements Structured Requirements Operational Data Store Data Load Current Database Physical Model Physical Model Tactical Business Reqmts & Structures Current Structure Data Whse Requirements Transition Model © Principle Partners. Info@PrinciplePartners.

Inc.Com Page 19 PP I .Data Warehouse Concepts Sources of Data Warehouse Data Archives (Historic Data) Current Systems of Record (Recent History) Enterprise Data Warehouse Operational Transactions (Future Data Source) © Principle Partners. Info@PrinciplePartners.

Info@PrinciplePartners.Com Page 20 PP I .Data Warehouse Concepts Appropriate Uses of Data Warehouse Data • • • Produce Reports For Long Term Trend Analysis Produce Reports Aggregating Enterprise Data Produce Reports of Multiple Dimensions (Earned revenue by month by product by branch) © Principle Partners. Inc.

Com Page 21 PP I . Info@PrinciplePartners. Inc.Data Warehouse Concepts Inappropriate Uses of Data Warehouse Data • Replace Operational Systems Replace Operational Systems’ Reports Analyze Current Operational Results • • © Principle Partners.

Inc. Info@PrinciplePartners.Data Warehouse Concepts Levels of Granularity of Data Warehouse Data •Atomic (Transaction) •Lightly Summarized •Highly Summarized © Principle Partners.Com Page 22 PP I .

Inc. Info@PrinciplePartners.Data Warehouse Concepts Options for Viewing Data • • 9 8 7 6 5 4 3 2 1 0 0 0 0 0 0 0 0 0 0 Text 1 s t Q tr 2 n d Q tr 3 rd Q tr 4 th Q tr • © Principle Partners.Com Page 23 PP I .

Info@PrinciplePartners.Data Warehouse Concepts Next Steps In Data Warehouse Evolution • Use It .Com Page 24 PP I .Analyze Data Warehouse Data • Determine Additional Data Requirements • Define Sources For Additional Data • Add New Data (Subject Areas) to Data Warehouse © Principle Partners. Inc.

Data Warehouse Concepts Future Trends In Data Warehouse • Increased Data Mining Exploration Prove Hypothesis • Increase Competitive Advantage (i.. Inc. Identify Cross-selling Opportunities) • Integration into Supply Chain & e-Business © Principle Partners.Com Page 25 PP I . Info@PrinciplePartners.e.

Inc.Data Warehouse Concepts Summary A Data Warehouse Is A Structured Repository of Historic Data. To Answer Business Questions Page 26 © Principle Partners.Com PP I . It Is: • • • • It Contains: • Subject Oriented Integrated Time Variant Non-volatile Business Specified Data. Info@PrinciplePartners.

Info@PrinciplePartners.Com Page 27 PP I . Inc.Data Warehouse Concepts Questions and Answers © Principle Partners.

Sign up to vote on this title
UsefulNot useful