Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more
Download
Standard view
Full view
of .
Look up keyword or section
Like this
3Activity
0 of .
Results for:
No results containing your search query
P. 1
White Paper - Process Neutral Data Modelling

White Paper - Process Neutral Data Modelling

Ratings:

4.0

(1)
|Views: 651 |Likes:
Published by davidmwalker
This paper describes in detail the process for creating an enterprise data warehouse physical data model that is less susceptible to change. Change is one of the largest on-going costs in a data warehouse and therefore reducing change reduces the total cost of ownership of the system. This is achieved by removing business process specific data and concentrating on core business information.

The white paper examines why data-modelling style is important and how issues arise when using a data model for reporting. It discusses a number of techniques and proposes a specific solution. The techniques should be considered when building a data warehouse solution even when an organisation decides against using the specific solution.

This paper is intended for a technical audience and project managers involved with the technical aspects of a data warehouse project.
This paper describes in detail the process for creating an enterprise data warehouse physical data model that is less susceptible to change. Change is one of the largest on-going costs in a data warehouse and therefore reducing change reduces the total cost of ownership of the system. This is achieved by removing business process specific data and concentrating on core business information.

The white paper examines why data-modelling style is important and how issues arise when using a data model for reporting. It discusses a number of techniques and proposes a specific solution. The techniques should be considered when building a data warehouse solution even when an organisation decides against using the specific solution.

This paper is intended for a technical audience and project managers involved with the technical aspects of a data warehouse project.

More info:

Published by: davidmwalker on Jun 22, 2009
Copyright:Traditional Copyright: All rights reserved

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, TXT or read online from Scribd
See more
See less

02/04/2013

pdf

text

original

 
 
W
HITE
P
APER 
 
Process Neutral Data
Modelling
D
AVID
M
 
W
ALKER 
 
Version: 1.0Date: 10/02/2009
Data Management & Warehousing138 Finchampstead Road, Wokingham, Berkshire, RG41 2NU, United Kingdomhttp://www.datamgmt.com
Data Management & Warehousing
 
 
White Paper - Process Neutral Data Modelling© 2009 Data Management & WarehousingPage 2
 
Table of Contents
Table of Contents......................................................................................................................2
 
Synopsis....................................................................................................................................4
 
Intended Audience....................................................................................................................4
 
About Data Management & Warehousing.................................................................................4
 
Introduction................................................................................................................................5
 
The Problem..............................................................................................................................6
 
The Example Company.........................................................................................................6
 
The Real World.....................................................................................................................9
 
The Customer Paradigm.........................................................................................................10
 
Requirements of a Data Warehouse Data Model....................................................................12
 
Assumptions........................................................................................................................12
 
Requirements......................................................................................................................12
 
The Data Model.......................................................................................................................14
 
Major Entities......................................................................................................................14
 
Type Tables........................................................................................................................17
 
Band Tables........................................................................................................................19
 
Property Tables...................................................................................................................20
 
Event Tables.......................................................................................................................22
 
Link Tables..........................................................................................................................23
 
Segment Tables..................................................................................................................24
 
The Sub-Model........................................................................................................................25
 
History Tables.....................................................................................................................26
 
Occurrences and Transactions...........................................................................................27
 
Implementation Issues............................................................................................................33
 
The ‘Party’ Special Case.....................................................................................................33
 
Partitioning..........................................................................................................................35
 
Data Cleansing....................................................................................................................36
 
Null Values..........................................................................................................................36
 
Indexing Strategy................................................................................................................36
 
Enforcing Referential Integrity.............................................................................................36
 
Data Insert versus Data Update..........................................................................................37
 
Row versus Set Based Loading in ETL...............................................................................37
 
Disk Space Utilisation.........................................................................................................38
 
Implementation Effort..........................................................................................................38
 
Data Commutativity.................................................................................................................39
 
Data Model Explosion and Compression................................................................................40
 
How big does the data model get?......................................................................................40
 
Can the data model be compressed?.................................................................................40
 
Which Results to Store?..........................................................................................................41
 
The Holistic Approach.............................................................................................................42
 
Summary.................................................................................................................................43
 
Appendix 1 – Data Modelling Standards.................................................................................44
 
General Conventions..........................................................................................................44
 
Table Conventions..............................................................................................................44
 
Column Conventions...........................................................................................................46
 
Index Conventions..............................................................................................................50
 
Standard Table Constructs.................................................................................................50
 
Sequence Numbers For Primary Keys................................................................................52
 
Appendix 2 – Understanding Hierarchies................................................................................53
 
Sales Regions.....................................................................................................................53
 
Internal Organisation Structure...........................................................................................53
 
Appendix 3 – Industry Standard Data Models.........................................................................55
 
Appendix 4 Information Sparsity..........................................................................................57
 
Appendix 5 – Set Processing Techniques...............................................................................59
 
Appendix 6 – Standing on the shoulders of giants..................................................................60
 
 
White Paper - Process Neutral Data Modelling© 2009 Data Management & WarehousingPage 3
 Further Reading......................................................................................................................61
 
Overview Architecture for Enterprise Data Warehouses.....................................................61
 
Data Warehouse Governance.............................................................................................61
 
Data Warehouse Project Management...............................................................................62
 
Data Warehouse Documentation Roadmap.......................................................................62
 
How Data Works.................................................................................................................63
 
List of Figures..........................................................................................................................64
 
Copyright.................................................................................................................................64
 

Activity (3)

You've already reviewed this. Edit your review.
1 hundred reads
1 thousand reads
JagWalia liked this

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->