High Quality
Open the downloaded document, and select print from the file menu (PDF reader required).
•
W
HITE
P
APER
Overview Architecture forEnterprise Data Warehouses
D
AVID
M
W
ALKER
Version: 1.0Date: 01/03/2006
Data Management & Warehousing138 Finchampstead Road, Wokingham, Berkshire, RG41 2NU, United Kingdomhttp://www.datamgmt.com
Data Management & Warehousing
White Paper - Overview Architecture for Enterprise Data Warehouses© 2006 Data Management & WarehousingPage 2
Table of Contents
Table of Contents......................................................................................................................2
Synopsis....................................................................................................................................3
Intended Audience....................................................................................................................3
About Data Management & Warehousing.................................................................................3
Introduction................................................................................................................................4
Objectives of this paper.............................................................................................................4
Scope of this paper...................................................................................................................4
Background...............................................................................................................................5
The Architecture Design Pattern...............................................................................................6
Architectural Overview..........................................................................................................6
Components of the Enterprise Data Warehouse..................................................................7
Architectural Review...........................................................................................................13
Tools & Technology.................................................................................................................14
Operating System...............................................................................................................14
Database.............................................................................................................................14
Backup and Recovery.........................................................................................................14
Extract - Transform - Load (ETL)........................................................................................15
Data Quality Profiling..........................................................................................................15
Data Quality Cleansing.......................................................................................................15
Scheduling..........................................................................................................................16
Analysis & Reporting...........................................................................................................16
Data Modelling....................................................................................................................16
Metadata Repository...........................................................................................................16
Source Code Control...........................................................................................................17
Issue Tracking.....................................................................................................................17
Web Based Solution Integration..........................................................................................17
Documentation Requirements.................................................................................................18
Requirements Gathering.....................................................................................................18
Key Design Decisions.........................................................................................................18
Data Model..........................................................................................................................19
Analysis...............................................................................................................................19
Operations Guide................................................................................................................20
Security Model....................................................................................................................20
Issue log..............................................................................................................................20
Metadata.............................................................................................................................21
Some additional high-level guidelines.....................................................................................23
Programme or project?.......................................................................................................23
The technology trap............................................................................................................23
Vendor Selection.................................................................................................................23
Development partners.........................................................................................................24
The development and implementation sequence...............................................................24
Homogeneous & Heterogeneous Environments.................................................................25
Centralised vs. Distributed solutions...................................................................................25
Converting Data from Application Centric to User Centric..................................................26
Analysis and Reporting Tool Usage....................................................................................27
Summary.................................................................................................................................28
References..............................................................................................................................29
Further Reading..................................................................................................................29
Web resources....................................................................................................................29
Literature.............................................................................................................................29
Glossary..................................................................................................................................30
List of Figures..........................................................................................................................32
Copyright.................................................................................................................................32
White Paper - Overview Architecture for Enterprise Data Warehouses© 2006 Data Management & WarehousingPage 3
Synopsis
This is the first of a series of papers published by Data Management & Warehousing to lookat the implementation of Enterprise Data Warehouse solutions in large organisations using adesign pattern approach. A design pattern provides a generic approach, rather than a specificsolution. It describes the steps that architecture, design and build teams will have to gothrough in order to implement a data warehouse successfully within their business.This particular document looks at what an organisation will need in order to build and operatean enterprise data warehouse in terms of the following:
•
The framework architecture
What components are needed to build a data warehouse, and how do they fittogether?
•
The toolsets
What types of products and skills will be used to develop a system?
•
The documentation
How do you capture requirements, perform analysis and track changes in scope of atypical data warehouse project?This document is, however, an overview and therefore subsequent white papers deal withspecific issues in detail.
Intended Audience
Reader Recommended Reading
Executive Synopsis through to BackgroundBusiness Users Synopsis through to BackgroundIT Management Entire DocumentIT Strategy Entire DocumentIT Data Warehousing Project Management Entire DocumentIT Data Warehousing Developers Entire Document
About Data Management & Warehousing
Data Management & Warehousing is a specialist consultancy in data warehousing based inWokingham, Berkshire in the United Kingdom. Founded in 1995 by David M Walker, our consultants have worked for major corporations around the world including the US, Europe,Africa and the Middle East. Our clients are invariably large organisations with a pressing needfor business intelligence. We have worked in many industry sectors but have specialists inTelco’s, manufacturing, retail, financial and transport as well as technical expertise in many of the leading technologies.For further information visit our website at: http://www.datamgmt.com
Add a Comment