Professional Documents
Culture Documents
Data Warehousing - Concepts
Data Warehousing - Concepts
M R BRAHMAM
ETL Layer
Execution
Execution
Systems
Systems
Extract,
Extract,
Transformation,
Transformation,
and
andLoad
Load(ETL)
(ETL)
Layer
Layer
CRM
CRM
ERP
ERP
Legacy
Legacy
e-Commerce
e-Commerce
Cleanse
CleanseData
Data
Filter
FilterRecords
Records
Standardize
StandardizeValues
Values
Decode
DecodeValues
Values
Apply
ApplyBusiness
BusinessRules
Rules
Householding
Householding
Dedupe
DedupeRecords
Records
Merge
MergeRecords
Records
External
External
Data
Data
Purchased
Purchased
Market
MarketData
Data
Spreadsheets
Spreadsheets
Enterprise
Enterprise
Data
Data
Warehouse
Warehouse
Metadata
Metadata
Repository
Repository
ODS
ODS
ETL Tools:
Informatica PowerMart
ETI
Oracle Warehouse Builder
Custom programs
SQL scripts
Reporting
Reporting
Tools
Tools
Data
DataMart
Mart
OLAP
OLAP
Tools
Tools
Data
DataMart
Mart
Ad
AdHoc
Hoc
Query
Query
Tools
Tools
Data
DataMart
Mart
Data
Data
Mining
Mining
Tools
Tools
Sample Technologies:
PeopleSoft
SAP
Siebel
Oracle Applications
Manugistics
Custom Systems
Presentation
Layer
Oracle
SQL Server
Teradata
DB2
Custom Tools
HTML Reports
Cognos
Business Objects
MicroStrategy
Oracle Discoverer
Brio
Data Mining Tools
Portals
OLTP vs DW
OLTP
DW
Data dependencies (E-R) Dimensional model
model
Microscopic data
consistency
Millions of transactions
per day
Keeping history is
necessary
model
Symmetric
Divides data into many entities
Describes entities and relationships
Seeks to eliminate data redundancy
Good for high transaction performance
Dimensional
model
Asymmetric
Divides data into dimensions and facts
Describes dimensions and measures
Encourages data redundancy
Good for high query performance
Facts/Dimensions
Fact
Facts/Dimensions (contd.)
Dimensions
Star/Snowflake schema
Star
schema
schema
Star schema
Store Description
City
State
District ID
District Desc.
Region_ID
Region Desc.
Regional Mgr.
District_ID
Region_ID
District Desc.
Region_ID
Region Desc.
Regional Mgr.
DM , DW & ODS
DM
OLAP
Others
Additive,