Data Warehouse Concepts: Avinash Kanumuru Diya Jana Debyajit Majumder

Data Warehouse Concepts
Avinash Kanumuru Diya Jana Debyajit Majumder
2009 Wipro Ltd - Confidential
Content
1 An Overview of Data Warehouse 2 Data Warehouse Architecture 3 Data Modeling for Data Warehouse 4 Overview of Data Cleansing
5 Data Extraction, Transformation, Load
2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential
Content [contd]
6 Metadata Management 7 OLAP 8 Data Warehouse Testing
An Overview
Understanding What is a Data Warehouse
What is Data Warehouse?

Definitions of Data Warehouse A data warehouse is a subject-oriented, integrated, nonvolatile, time-variant collection of data in support of management's decisions. WH Inmon Data Warehouse is a repository of data summarized or aggregated in simplified form from operational systems. End user orientated data access and reporting tools let user get at the data for decision support Babcock A data warehouse is a relational database a copy of transaction data specifically structured for query and analysis Ralph Kimball In simple: Data warehousing is collection of data from different systems, which helps in Business Decisions, Analysis and Reporting.
Data Warehouse def. by WH Inmon

A common way of introducing data warehousing is to refer to the characteristics of a data warehouse as set forth by William Inmon: Subject Oriented Data that gives information about a particular subject instead of about a company's ongoing operations. Integrated Data that is gathered into the data warehouse from a variety of sources and merged into a coherent whole. Nonvolatile Data is stable in a data warehouse. More data is added but data is never removed. This enables management to gain a consistent picture of the business. Time Variant In order to discover trends in business, analysts need large amounts of data. This is very much in contrast to online transaction processing (OLTP) systems, where performance requirements demand that historical data be moved to an archive. All data in the data warehouse is identified with a particular time period.
Data Warehouse Architecture

What makes a Data Warehouse
Components of Warehouse
Source Tables: These are real-time, volatile data in relational databases for transaction processing (OLTP). These can be any relational databases or flat files. ETL Tools: To extract, cleansing, transform (aggregates, joins) and load the data from sources to target. Maintenance and Administration Tools: To authorize and monitor access to the data, set-up users. Scheduling jobs to run on offshore periods. Modeling Tools: Used for data warehouse design for high-performance using dimensional data modeling technique, mapping the source and target files. Databases: Target databases and data marts, which are part of data warehouse. These are structured for analysis and reporting purposes. End-user tools for analysis and reporting: get the reports and analyze the data from target tables. Different types of Querying, Data Mining, OLAP tools are used for this purpose.

This is a basic design, where there are source files, which are loaded to a warehouse and users query the data for different purposes.
This has a staging area, where the data after cleansing, transforming is loaded and tested here. Later is directly loaded to the target database/warehouse. Which is divided to data marts and can be accessed by different users for their reporting and analyzing purposes.
Data Modeling
Effective way of using a Data Warehouse
10
Data Modeling
Commonly E-R Data Model is used in OLTP, In OLAP Dimensional Data Model is used commonly. E-R (Entity-Relationship) Data Model
Entity: Object that can be observed and classified based on its properties and characteristics. Like employee, book, student Relationship: relating entities to other entities.
Different Perceptive of Data Modeling.

o Conceptual Data Model o Logical Data Model o Physical Data Model
Types of Dimensional Data Models most commonly used:

o Star Schema o Snowflake Schema
11
Terms used in Dimensional Data Model

To understand dimensional data modeling, let's define some of the terms commonly used in this type of modeling: Dimension: A category of information. For example, the time dimension. Attribute: A unique level within a dimension. For example, Month is an attribute in the Time Dimension. Hierarchy: The specification of levels that represents relationship between different attributes within a dimension. For example, one possible hierarchy in the Time dimension is Year Quarter Month Day. Fact Table: A table that contains the measures of interest. Lookup Table: It provides the detailed information about the attributes. For example, the lookup table for the Quarter attribute would include a list of all of the quarters available in the data warehouse. Surrogate Keys: To avoid the data integrity, surrogate keys are used. They are helpful for Slow Changing Dimensions and act as index/primary keys.
A dimensional model includes fact tables and lookup tables. Fact tables connect to one or more lookup tables, but fact tables do not have direct relationships to one another. Dimensions and hierarchies are represented by lookup tables. Attributes are the non-key columns in the lookup tables.
12
Star Schema
Dimension Table
product prodId p1 p2 name price bolt 10 nut 5
Dimension Table
store storeId c1 c2 c3 city nyc sfo la
Fact Table
sale oderId date o100 1/7/97 o102 2/7/97 105 3/8/97 custId 53 53 111 prodId p1 p2 p1 storeId c1 c1 c3 qty 1 2 5 amt 12 11 50
Dimension Table
customer custId 53 81 111 name joe fred sally address 10 main 12 main 80 willow city sfo sfo la
13
Snowflake Schema
Dimension Table Fact Table
store storeId s5 s7 s9 cityId sfo sfo la tId t1 t2 t1 mgr joe fred nancy
sType tId t1 t2 city size small large location downtown suburbs regId north south
Dimension Table
cityId pop sfo 1M la 5M
The star and snowflake schema are most commonly found in dimensional data warehouses and data marts where speed of data retrieval is more important than the efficiency of data manipulations. As such, the tables in these schema are not normalized much, and are frequently designed at a level of normalization short of third normal form.
region regId name north cold region south warm region
14
Overview of Data Cleansing
15
The Need For Data Quality

Difficulty in decision making Time delays in operation Organizational mistrust Data ownership conflicts Customer attrition Costs associated with error detection error rework customer service fixing customer problems
16
Six Steps To Data Quality

Understand Information Flow In Organization
Identify authoritative data sources Interview Employees & Customers
Identify Potential Problem Areas & Asses Impact
Data Entry Points

Cost of bad data
Measure Quality Of Data
Use business rule discovery tools to identify data with
inconsistent, missing, incomplete, duplicate or incorrect values

Use data cleansing tools to clean data at the source Load only clean data into the data warehouse
Clean & Load Data
Continuous Monitoring
Schedule Periodic Cleansing of Source Data
Identify Areas of Improvement
Identify & Correct Cause of Defects Refine data capture mechanisms at source Educate users on importance of DQ
17
Data Quality Solution

Customized Programs Strengths: Addresses specific needs No bulky one time investment Limitations Tons of Custom programs in different environments are difficult to manage Minor alterations demand coding efforts Data Quality Assessment tools Strength Provide automated assessment Limitation No measure of data accuracy
18

Business Rule Discovery tools Strengths Detect Correlation in data values Can detect Patterns of behavior that indicate fraud Limitations Not all variables can be discovered Some discovered rules might not be pertinent There may be performance problems with large files or with many fields. Data Reengineering & Cleansing tools Strengths Usually are integrated packages with cleansing features as Addon Limitations Error prevention at source is usually absent The ETL tools have limited cleansing facilities
19
Tools In The Market

Business Rule Discovery Tools Integrity Data Reengineering Tool from Vality Technology Trillium Software System from Harte -Hanks Data Technologies Migration Architect from DB Star Data Reengineering & Cleansing Tools Carlton Pureview from Oracle ETI-Extract from Evolutionary Technologies PowerMart from Informatica Corp Sagent Data Mart from Sagent Technology Data Quality Assessment Tools Migration Architect, Evoke Axio from Evoke Software Wizrule from Wizsoft Name & Address Cleansing Tools Centrus Suite from Sagent I.d.centric from First Logic
20
Data Extraction, Transformation, Load
21
ETL Architecture
Visitors
Web Browsers
The Internet
External Data Demographics, Household, Webographics, Income
Staging Area
Web Server Logs & E-comm Transaction Data Flat Files
Meta Data Repository
Scheduled Extraction
RDBMS
Clean Transform Match Merge
Scheduled Loading
Enterprise Data Warehouse
Other OLTP Systems
Data Collection
Data Extraction
Data Transformation
Data Loading
Data Storage & Integration
22
ETL Architecture
Data Extraction:
Rummages through a file or database Uses some criteria for selection Identifies qualified data and Transports the data over onto another file or database
Data transformation
Integrating dissimilar data types Changing codes Adding a time attribute Summarizing data Calculating derived values Renormalizing data
Data Extraction Cleanup

Restructuring of records or fields Removal of Operational-only data Supply of missing field values Data Integrity checks Data Consistency and Range checks, etc...
Data loading
Initial and incremental loading Updation of metadata
23
Why ETL ?
Companies have valuable data lying around throughout their networks that needs to be moved from one place to another. The data lies in all sorts of heterogeneous systems,and therefore in all sorts of formats.
To solve the problem, companies use extract, transform and load (ETL) software.
The data used in ETL processes can come from any source: a mainframe application, an ERP application, a CRM tool, a flat file, and an Excel spreadsheet.
24
Major components involved in ETL Processing
25

Design manager Lets developers define source-to-target mappings, transformations, process flows, and jobs Meta data management Provides a repository to define, document, and manage information about the ETL design and runtime processes Extract The process of reading data from a database. Transform The process of converting the extracted data Load The process of writing the data into the target database. Transport services ETL tools use network and file protocols to move data between source and target systems and in-memory protocols to move data between ETL run-time components. Administration and operation ETL utilities let administrators schedule, run, monitor ETL jobs, log all events, manage errors, recover from failures, reconcile outputs with source systems
26
ETL Tools
Provides facility to specify a large number of transformation rules with a GUI Generate programs to transform data Handle multiple data sources Handle data redundancy Generate metadata as output Most tools exploit parallelism by running on multiple low-cost servers in multi-threaded environment ETL Tools - Second-Generation PowerCentre/Mart from Informatica Data Mart Solution from Sagent Technology DataStage from Ascential
27
Metadata Management
28
What Is Metadata?
Metadata is Information...
That describes the WHAT, WHEN, WHO, WHERE, HOW of the data warehouse About the data being captured and loaded into the Warehouse Documented in IT tools that improves both business and technical understanding of data and data-related processes
29
Importance Of Metadata
Locating Information Time spent in looking for information. How often information is found? What poor decisions were made based on the incomplete information?
How much money was lost or earned as a result? Interpreting information

How many times have businesses needed to rework or recall products? What impact does it have on the bottom line ? How many mistakes were due to misinterpretation of existing How much interpretation results form too much metadata? How much time is spent trying to determine if any of the metadata is accurate? Integrating information How various data perspectives connect together? How much time is spent trying to figure out that? How much does the inefficiency and lack of metadata affect decision making documentation?
30
Requirements for DW Metadata Management

Provide a simple catalogue of business metadata descriptions and views Document/manage metadata descriptions from an integrated development environment Enable DW users to identify and invoke pre-built queries against the data stores Design and enhance new data models and schemas for the data warehouse Capture data transformation rules between the operational and data warehousing databases Provide change impact analysis, and update across these technologies
31
Consumers of Metadata
Technical Users Warehouse administrator Application developer Business Users -Business metadata Meanings Definitions Business Rules Software Tools Used in DW life-cycle development Metadata requirements for each tool must be identified The tool-specific metadata should be analysed for inclusion in the enterprise metadata repository Previously captured metadata should be electronically transferred from the enterprise metadata repository to each individual tool
32
Trends in the Metadata Management Tools

Third Party Bridging Tools Oracle Exchange
Technology of choice for a long list of repository, enterprise and workgroup vendors
Reischmann-Informatik-Toolbus
Features include facilitation of selective bridging of metadata
Ardent Software/ Dovetail Software -Interplay

Hub and Spoke solution for enabling metadata interoperability Ardent focussing on own engagements, not selling it as independent product
Informix's Metadata Plug-ins

Available with Ardent Datastage version 3.6.2 free of cost for Erwin, Oracle Designer, Sybase Powerdesigner, Brio, Microstrategy
33

Metadata Repositories IBM, Oracle and Microsoft to offer free or near-free basic repository services Enable organisations to reuse metadata across technologies Integrate DB design, data transformation and BI tools from different vendors Multi-tool vendors taking a bridged or federated rather than integrated approach to sharing metadata Both IBM and Oracle have multiple repositories for different lines of products e.g., One for AD and one for DW, with bridges between them
34

Metadata Interchange Standards CDIF (CASE Data Interchange Format)
Most frequently used interchange standard Addresses only a limited subset of metadata artifacts
OMG (Object Management Group)-CWM

XML-addresses context and data meaning, not presentation Can enable exchange over the web employing industry standards for storing and sharing programming data Will allow sharing of UML and MOF objects b/w various development tools and repositories
MDC (Metadata Coalition)

Based on XML/UML standards Promoted by Microsoft Along With 20 partners including Object Management Group (OMG), Oracle Carleton Group, CA-PLATINUM Technology (Founding Member), Viasoft
35
OLAP
36
Agenda
OLAP Definition Distinction between OLTP and OLAP
MDDB Concepts
Implementation Techniques Architectures
Features
Representative Tools
5/16/2013
37
37
OLAP: On-Line Analytical Processing

OLAP can be defined as a technology which allows the users to view the aggregate data across measurements (like Maturity Amount, Interest Rate etc.) along with a set of related parameters called dimensions (like Product, Organization, Customer, etc.) Used interchangeably with BI Multidimensional view of data is the foundation of OLAP Users :Analysts, Decision makers
5/16/2013 38
38
Distinction between OLTP and OLAP

OLTP System Source of data Operational data; OLTPs are the original source of the data To control and run fundamental business tasks A snapshot of ongoing business processes Short and fast inserts and updates initiated by end users
OLAP System Consolidation data; OLAP data comes from the various OLTP databases Decision support
Purpose of data
What the data reveals Inserts and Updates

5/16/2013
Multi-dimensional views of various kinds of business activities Periodic long-running batch jobs refresh the data
39
39
MDDB Concepts
A multidimensional database is a computer software system designed to allow for efficient and convenient storage and retrieval of data that is intimately related and stored, viewed and analyzed from different perspectives (Dimensions). A hypercube represents a collection of multidimensional data. The edges of the cube are called dimensions Individual items within each dimensions are called members
40
RDBMS v/s MDDB: Increased Complexity...

Relational DBMS
MODEL MINI VAN MINI VAN MINI VAN MINI VAN MINI VAN MINI VAN MINI VAN MINI VAN MINI VAN SPORTS COUPE SPORTS COUPE SPORTS COUPE SPORTS COUPE SPORTS COUPE SPORTS COUPE SPORTS COUPE SPORTS COUPE SPORTS COUPE SEDAN SEDAN SEDAN ... COLOR BLUE BLUE BLUE RED RED RED WHITE WHITE WHITE BLUE BLUE BLUE RED RED RED WHITE WHITE WHITE BLUE BLUE BLUE DEALER Clyde Gleason Carr Clyde Gleason Carr Clyde Gleason Carr Clyde Gleason Carr Clyde Gleason Carr Clyde Gleason Carr Clyde Gleason Carr VOL. 6 3 2 5 3 1 3 1 4 3 3 3 4 3 6 2 3 5 4 3 2 ...
MDDB
Sales Volumes
M O D E L
Mini Van
Coupe Carr Gleason Clyde Blue Red White
Sedan
DEALERSHIP
COLOR
27 x 4 = 108 cells
41
3 x 3 x 3 = 27 cells
Benefits of MDDB over RDBMS

Ease of Data Presentation & Navigation A great deal of information is gleaned immediately upon direct inspection of the array User is able to view data along presorted dimensions with data arranged in an inherently more organized, and accessible fashion than the one offered by the relational table. Storage Space Very low Space Consumption compared to Relational DB Performance Gives much better performance. Relational DB may give comparable results only through database tuning (indexing, keys etc), which may not be possible for ad-hoc queries. Ease of Maintenance No overhead as data is stored in the same way it is viewed. In Relational DB, indexes, sophisticated joins etc. are used which require considerable storage and maintenance
5/16/2013
42
42
Issues with MDDB
Sparsity
- Input data in applications are typically sparse -Increases with increased dimensions
Data Explosion
-Due to Sparsity -Due to Summarization
Performance
-Doesnt perform better than RDBMS at high data volumes (>20-30 GB)
5/16/2013
43
43
Issues with MDDB - Sparsity Example

If dimension members of different dimensions do not interact , then blank cell is left behind.
Employee Age
21 19 63 31 27 56 45 41 19
31 41 23 01 14 54 03 12 33
LAST NAME EMP# AGE SMITH 01 21 REGAN 12 Sales Volumes 19 FOX 31 63 Miini Van WELD 14 6 5 31 4 M O KELLY 54 3 5 27 Coupe D 5 E L LINK 03 56 4 3 2 Sedan KRANZ 41 45 Blue Red White LUCUS 33 COLOR 41 WEISS 23 19
Smith
Regan
Fox
L A S T N A M E
Weld
Kelly
Link
Kranz
Lucas
Weiss
EMPLOYEE #
5/16/2013
44
44
OLAP Features
Calculations applied across dimensions, through hierarchies and/or across members Trend analysis over sequential time periods, What-if scenarios. Slicing / Dicing subsets for on-screen viewing Rotation to new dimensional comparisons in the viewing area Drill-down/up along the hierarchy Reach-through / Drill-through to underlying detail data
5/16/2013
45
45
Features of OLAP - Rotation
Complex Queries & Sorts in Relational environment translated to simple rotation.

Sales Volumes
M O D E L
Mini Van
6 3 4
Blue
5 5 3
Red
4 5 2
White
Coupe
C O L O R ( ROTATE 90 )
o
Blue
6 5 4
3 5 5
MODEL
4 3 2
Sedan
Red
Sedan
White
Mini Van Coupe
COLOR
View #1
View #2
2 dimensional array has 2 views.

5/16/2013
46
46

Sales Volumes
M O D E L
Mini Van Coupe Carr Gleason Clyde Blue Red White
Sedan
C O L O R
Blue
Red White Sedan Coupe Mini Van Carr Gleason Clyde
C O L O R
Blue
Red White Carr Gleason Clyde Mini Van Coupe Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
( ROTATE 90 )
DEALERSHIP
DEALERSHIP
MODEL
View #1
D E A L E R S H I P D E A L E R S H I P
View #2
View #3
Carr Gleason Mini Van Coupe Sedan White Red Blue
Carr Gleason Blue Red White
Mini Van
Clyde
Clyde Mini Van Coupe Sedan
M O D E L
Coupe Blue Red White Clyde Gleason Carr
Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
MODEL
COLOR
COLOR
View #4
View #5
View #6

5/16/2013
47
47
Features of OLAP - Slicing / Filtering

MDDB allows end user to quickly slice in on exact view of the data required.
Sales Volumes
M O D E L
Mini Van Mini Van
Coupe
Coupe Normal Metal Blue Blue
Carr Clyde
Carr Clyde
Normal Blue
Metal Blue
DEALERSHIP
COLOR
5/16/2013
48
48
Features of OLAP - Drill Down / Up
ORGANIZATION DIMENSION
REGION Midwest
DISTRICT
Chicago
St. Louis
Gary
DEALERSHIP
Clyde
Gleason
Carr
Levi
Lucas
Bolton
Sales at region/District/Dealership Level
Moving Up and moving down in a hierarchy is referred to as drill-up / roll-up and drill-down
5/16/2013
49
49
OLAP Reporting - Drill Down
Inflows ( Region , Year)

200 150 Inflows 100 ($M) 50 0 Year Year 1999 2000 Years
East West Central
5/16/2013
50
50
Inflows ( Region , Year - Year 1999)

90 80 70 60 50 Inflows ( $M) 40 30 20 10 0
East West Central
1st Qtr
2nd Qtr 3rd Qtr Year 1999
4th Qtr
Drill-down from Year to Quarter

5/16/2013
51
51
Inflows ( Region , Year - Year 1999 - 1st Qtr)

20 15 Inflows ( $M 10 ) 5
East West Central

January February March Year 1999
Drill-down from Quarter to Month
52
Implementation Techniques -OLAP Architectures
MOLAP - Multidimensional OLAP

Multidimensional Databases for database and application logic layer
ROLAP - Relational OLAP

Access Data stored in relational Data Warehouse for OLAP Analysis. Database and Application logic provided as separate layers
HOLAP - Hybrid OLAP

OLAP Server routes queries first to MDDB, then to RDBMS and result processed on-the-fly in Server
DOLAP - Desk OLAP

Personal MDDB Server and application on the desktop
5/16/2013
53
53
MOLAP - MDDB storage
OLAP
Cube
OLAP Calculation Engine
Web Browser
OLAP Tools
OLAP Appli cations

5/16/2013
54
54
MOLAP - Features
Powerful analytical capabilities (e.g., financial, forecasting, statistical) Aggregation and calculation capabilities Read/write analytic applications Specialized data structures for
Maximum query performance. Optimum space utilization.
5/16/2013
55
55
ROLAP - Standard SQL storage
MDDB - Relational Mapping
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
56
56
ROLAP - Features Three-tier hardware/software architecture:

GUI on client; multidimensional processing on midtier server; target database on database server Processing split between mid-tier & database servers
Ad hoc query capabilities to very large databases DW integration Data scalability
5/16/2013
57
57
HOLAP - Combination of RDBMS and MDDB

OLAP Cube
Any Client
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
58
58
HOLAP - Features
RDBMS used for detailed data stored in large databases MDDB used for fast, read/write OLAP analysis and calculations Scalability of RDBMS and MDDB performance Calculation engine provides full analysis features Source of data transparent to end user
5/16/2013
59
59
Architecture Comparison
MOLAP
Definition
ROLAP
HOLAP
Hybrid OLAP = ROLAP + summary in MDDB Sparsity exists only in MDDB part To the necessary extent
MDDB OLAP = Relational OLAP = Transaction level data + Transaction level data + summary in MDDB summary in RDBMS Good Design 3 10 times High (May go beyond control. Estimation is very important) Fast - (Depends upon the size of the MDDB) No Sparsity To the necessary extent
Data explosion due to Sparsity Data explosion due to Summarization Query Execution Speed
Slow
Optimum - If the data is fetched from RDBMS then its like ROLAP otherwise like MOLAP. High: RDBMS + disk space + MDDB Server cost Large transactional data + frequent summary analysis
Cost
Medium: MDDB Server + large disk space cost
Low: Only RDBMS + disk space cost
Where to apply?
Small transactional Very large transactional data + complex model + data & it needs to be frequent summary viewed / sorted analysis
5/16/2013
60
60
Representative OLAP Tools:
Oracle Express Products Hyperion Essbase Cognos -PowerPlay Seagate - Holos SAS
Micro Strategy - DSS Agent Informix MetaCube Brio Query Business Objects / Web Intelligence
5/16/2013
61
61
Sample OLAP Applications
Sales Analysis Financial Analysis Profitability Analysis Performance Analysis Risk Management Profiling & Segmentation Scorecard Application NPA Management Strategic Planning Customer Relationship Management (CRM)
5/16/2013
62
62
Data Warehouse Testing
63
Data Warehouse Testing Overview

There is an exponentially increasing cost associated with finding software defects later in the development lifecycle. In data warehousing, this is compounded because of the additional business costs of using incorrect data to make critical business decisions
The methodology required for testing a Data Warehouse is different from testing a typical transaction system
64
Difference In Testing Data warehouse and Transaction System

Data warehouse testing is different on the following counts: User-Triggered vs. System triggered Volume of Test Data Possible scenarios/ Test Cases Programming for testing challenge
65
Difference In Testing Data warehouse and Transaction System.

User-Triggered vs. System triggered
In data Warehouse, most of the testing is system triggered. Most of the production/Source system testing is the processing of individual transactions, which are driven by some input from the users (Application Form, Servicing Request.). There are very few test cycles, which cover the system-triggered scenarios (Like billing, Valuation.)
66

67

Volume of Test Data The test data in a transaction system is a very small sample of the overall production data. Data Warehouse has typically large test data as one does try to fill-up maximum possible combination of dimensions and facts. Possible scenarios/ Test Cases In case of Data Warehouse, the permutations and combinations one can possibly test is virtually unlimited due to the core objective of Data Warehouse is to allow all possible views of data.
68

Programming for testing challenge In case of transaction systems, users/business analysts typically test the output of the system. In case of data warehouse, most of the 'Data Warehouse data Quality testing' and ETL testing is done at backend by running separate stand-alone scripts. These scripts compare preTransformation to post Transformation of data.
69
Data Warehouse Testing Process

Data-Warehouse testing is basically divided into two parts : 'Back-end' testing where the source systems data is compared to the endresult data in Loaded area 'Front-end' testing where the user checks the data by comparing their MIS with the data displayed by the end-user tools like OLAP. Testing phases consists of : Requirements testing Unit testing Integration testing Performance testing Acceptance testing
70
Requirements testing
The main aim for doing Requirements testing is to check stated requirements for completeness. Requirements can be tested on following factors. Are the requirements Complete? Are the requirements Singular? Are the requirements Ambiguous? Are the requirements Developable? Are the requirements Testable?
71
Unit Testing
Unit testing for data warehouses is WHITEBOX. It should check the ETL procedures/mappings/jobs and the reports developed. Unit testing the ETL procedures: Whether ETLs are accessing and picking up right data from right source.
All the data transformations are correct according to the business rules and data warehouse is correctly populated with the transformed data.
Testing the rejected records that dont fulfil transformation rules.
72
Unit Testing
Unit Testing the Report data:
Verify Report data with source: Data present in a data warehouse will be stored at an aggregate level compare to source systems. QA team should verify the granular data stored in data warehouse against the source data available Field level data verification: QA team must understand the linkages for the fields displayed in the report and should trace back and compare that with the source systems Derivation formulae/calculation rules should be verified
73
Integration Testing
Integration testing will involve following:
Sequence of ETLs jobs in batch. Initial loading of records on data warehouse. Incremental loading of records at a later date to verify the newly inserted or updated data. Testing the rejected records that dont fulfil transformation rules. Error log generation
74
Performance Testing
Performance Testing should check for : ETL processes completing within time window.
Monitoring and measuring the data quality issues.

Refresh times for standard/complex reports.
75
Acceptance testing
Here the system is tested with full functionality and is expected to function as in production. At the end of UAT, the system should be acceptable to the client for use in terms of ETL process integrity and business functionality and reporting.
76
Questions
77
Thank You
78
Content
80
Content [contd]
81
An Overview
82

83

84

85
Content
87
Content [contd]
88
An Overview
89

90

91

92
Content
94
Content [contd]
95
An Overview
96

97

98

99
100

101
Data Modeling
102
Data Modeling


103

104
Star Schema
Dimension Table
Dimension Table
Fact Table
Dimension Table
105
Snowflake Schema
Dimension Table
106
107

108

Data Entry Points

Cost of bad data

Clean & Load Data
109

110

111
Tools In The Market

112
113
ETL Architecture
Visitors
Web Browsers
The Internet
Staging Area
RDBMS
Scheduled Loading
Other OLTP Systems
Data Collection
Data Extraction
Data Transformation
Data Loading
114
ETL Architecture
Data Extraction:
Data transformation

Data loading
115
Why ETL ?
116
117

118
ETL Tools
119
Metadata Management
120
What Is Metadata?
121

122

123
124



125

126



127
OLAP
128
Agenda
MDDB Concepts
Features
5/16/2013
129
129

5/16/2013 130
130

Purpose of data

5/16/2013
Multi-dimensional views of various kinds of business activities Periodic long-running batch jobs refresh the 131 data
131
MDDB Concepts
132

Relational DBMS
MDDB
Sales Volumes
M O D E L
Mini Van
Sedan
DEALERSHIP
COLOR
27 x 4 = 108 cells
133
3 x 3 x 3 = 27 cells

5/16/2013
134
134
Issues with MDDB
Sparsity
Data Explosion
Performance
5/16/2013
135
135

Employee Age
21 19 63 31 27 56 45 41 19
31 41 23 01 14 54 03 12 33
Smith
Regan
Fox
L A S T N A M E
Weld
Kelly
Link
Kranz
Lucas
Weiss
EMPLOYEE #
5/16/2013
136
136
OLAP Features
5/16/2013
137
137

Sales Volumes
M O D E L
Mini Van
6 3 4
Blue
5 5 3
Red
4 5 2
White
Coupe
o
Blue
6 5 4
3 5 5
MODEL
4 3 2
Sedan
Red
Sedan
White
Mini Van Coupe
COLOR
View #1
View #2

5/16/2013
138
138

Sales Volumes
M O D E L
Sedan
C O L O R
Blue
C O L O R
Blue
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
( ROTATE 90 )
DEALERSHIP
DEALERSHIP
MODEL
View #1
View #2
View #3
Mini Van
Clyde
M O D E L
Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
MODEL
COLOR
COLOR
View #4
View #5
View #6

5/16/2013
139
139

Sales Volumes
M O D E L
Mini Van Mini Van
Coupe
Carr Clyde
Carr Clyde
Normal Blue
Metal Blue
DEALERSHIP
COLOR
5/16/2013
140
140
REGION Midwest
DISTRICT
Chicago
St. Louis
Gary
DEALERSHIP
Clyde
Gleason
Carr
Levi
Lucas
Bolton
5/16/2013
141
141

East West Central
5/16/2013
142
142

90 80 70 60 50 Inflows ( $M) 40 30 20 10 0
East West Central
1st Qtr
4th Qtr

5/16/2013
143
143

20 15 Inflows ( $M 10 ) 5
East West Central

144


HOLAP - Hybrid OLAP

DOLAP - Desk OLAP

5/16/2013
145
145
OLAP
Cube
Web Browser
OLAP Tools
OLAP Appli cations

5/16/2013
146
146
MOLAP - Features
5/16/2013
147
147
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
148
148

5/16/2013
149
149

OLAP Cube
Any Client
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
150
150
HOLAP - Features
5/16/2013
151
151
MOLAP
Definition
ROLAP
HOLAP
Slow
Cost
Where to apply?
5/16/2013
152
152
5/16/2013
153
153
5/16/2013
154
154
155

156

157

158

159

160

161
162
Unit Testing
163
Unit Testing
164
Integration Testing
165
Performance Testing

166
Acceptance testing
167
Questions
168
Thank You
169
170

171
Data Modeling
172
Data Modeling


173

174
Star Schema
Dimension Table
Dimension Table
Fact Table
Dimension Table
175
Snowflake Schema
Dimension Table
176
177

178

Data Entry Points

Cost of bad data

Clean & Load Data
179

180

181
Tools In The Market

182
183
ETL Architecture
Visitors
Web Browsers
The Internet
Staging Area
RDBMS
Scheduled Loading
Other OLTP Systems
Data Collection
Data Extraction
Data Transformation
Data Loading
184
ETL Architecture
Data Extraction:
Data transformation

Data loading
185
Why ETL ?
186
187

188
ETL Tools
189
Metadata Management
190
What Is Metadata?
191

192

193
194



195

196
Content
198
Content
200
Content [contd]
201
An Overview
202

203

204

205
206

207
Data Modeling
208
Data Modeling


209

210
Star Schema
Dimension Table
Dimension Table
Fact Table
Dimension Table
211
Snowflake Schema
Dimension Table
212
213

214

Data Entry Points

Cost of bad data

Clean & Load Data
215

216

217
Tools In The Market

218
219
ETL Architecture
Visitors
Web Browsers
The Internet
Staging Area
RDBMS
Scheduled Loading
Other OLTP Systems
Data Collection
Data Extraction
Data Transformation
Data Loading
220
ETL Architecture
Data Extraction:
Data transformation

Data loading
221
Why ETL ?
222
223

224
ETL Tools
225
Metadata Management
226
What Is Metadata?
227

228

229
230



231

232



233
OLAP
234
Agenda
MDDB Concepts
Features
5/16/2013
235
235

5/16/2013 236
236

Purpose of data

5/16/2013
237
MDDB Concepts
238

Relational DBMS
MDDB
Sales Volumes
M O D E L
Mini Van
Sedan
DEALERSHIP
COLOR
27 x 4 = 108 cells
239
3 x 3 x 3 = 27 cells

5/16/2013
240
240
Issues with MDDB
Sparsity
Data Explosion
Performance
5/16/2013
241
241

Employee Age
21 19 63 31 27 56 45 41 19
31 41 23 01 14 54 03 12 33
Smith
Regan
Fox
L A S T N A M E
Weld
Kelly
Link
Kranz
Lucas
Weiss
EMPLOYEE #
5/16/2013
242
242
OLAP Features
5/16/2013
243
243

Sales Volumes
M O D E L
Mini Van
6 3 4
Blue
5 5 3
Red
4 5 2
White
Coupe
o
Blue
6 5 4
3 5 5
MODEL
4 3 2
Sedan
Red
Sedan
White
Mini Van Coupe
COLOR
View #1
View #2

5/16/2013
244
244

Sales Volumes
M O D E L
Sedan
C O L O R
Blue
C O L O R
Blue
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
( ROTATE 90 )
DEALERSHIP
DEALERSHIP
MODEL
View #1
View #2
View #3
Mini Van
Clyde
M O D E L
Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
MODEL
COLOR
COLOR
View #4
View #5
View #6

5/16/2013
245
245

Sales Volumes
M O D E L
Mini Van Mini Van
Coupe
Carr Clyde
Carr Clyde
Normal Blue
Metal Blue
DEALERSHIP
COLOR
5/16/2013
246
246
REGION Midwest
DISTRICT
Chicago
St. Louis
Gary
DEALERSHIP
Clyde
Gleason
Carr
Levi
Lucas
Bolton
5/16/2013
247
247

East West Central
5/16/2013
248
248

90 80 70 60 50 Inflows ( $M) 40 30 20 10 0
East West Central
1st Qtr
4th Qtr

5/16/2013
249
249

20 15 Inflows ( $M 10 ) 5
East West Central

250


HOLAP - Hybrid OLAP

DOLAP - Desk OLAP

5/16/2013
251
251
OLAP
Cube
Web Browser
OLAP Tools
OLAP Appli cations

5/16/2013
252
252
MOLAP - Features
5/16/2013
253
253
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
254
254

5/16/2013
255
255

OLAP Cube
Any Client
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
256
256
HOLAP - Features
5/16/2013
257
257
MOLAP
Definition
ROLAP
HOLAP
Slow
Cost
Where to apply?
5/16/2013
258
258
5/16/2013
259
259
5/16/2013
260
260
261

262

263

264

265

266

267
268
Unit Testing
269
Unit Testing
270
Integration Testing
271
Performance Testing

272
Acceptance testing
273
Questions
274
Thank You
275
Content [contd]
276
An Overview
277

278

279

280
281

282
Data Modeling
283
Data Modeling


284

285
Star Schema
Dimension Table
Dimension Table
Fact Table
Dimension Table
286
Snowflake Schema
Dimension Table
287
288

289

Data Entry Points

Cost of bad data

Clean & Load Data
290

291

292
Tools In The Market

293
294
ETL Architecture
Visitors
Web Browsers
The Internet
Staging Area
RDBMS
Scheduled Loading
Other OLTP Systems
Data Collection
Data Extraction
Data Transformation
Data Loading
295
ETL Architecture
Data Extraction:
Data transformation

Data loading
296
Why ETL ?
297
298

299
ETL Tools
300
Metadata Management
301
What Is Metadata?
302

303

304
305



306

307



308
OLAP
309
Agenda
MDDB Concepts
Features
5/16/2013
310
310

5/16/2013 311
311

Purpose of data

5/16/2013
312
MDDB Concepts
313

Relational DBMS
MDDB
Sales Volumes
M O D E L
Mini Van
Sedan
DEALERSHIP
COLOR
27 x 4 = 108 cells
314
3 x 3 x 3 = 27 cells

5/16/2013
315
315
Issues with MDDB
Sparsity
Data Explosion
Performance
5/16/2013
316
316

Employee Age
21 19 63 31 27 56 45 41 19
31 41 23 01 14 54 03 12 33
Smith
Regan
Fox
L A S T N A M E
Weld
Kelly
Link
Kranz
Lucas
Weiss
EMPLOYEE #
5/16/2013
317
317
OLAP Features
5/16/2013
318
318

Sales Volumes
M O D E L
Mini Van
6 3 4
Blue
5 5 3
Red
4 5 2
White
Coupe
o
Blue
6 5 4
3 5 5
MODEL
4 3 2
Sedan
Red
Sedan
White
Mini Van Coupe
COLOR
View #1
View #2

5/16/2013
319
319

Sales Volumes
M O D E L
Sedan
C O L O R
Blue
C O L O R
Blue
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
( ROTATE 90 )
DEALERSHIP
DEALERSHIP
MODEL
View #1
View #2
View #3
Mini Van
Clyde
M O D E L
Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
MODEL
COLOR
COLOR
View #4
View #5
View #6

5/16/2013
320
320

Sales Volumes
M O D E L
Mini Van Mini Van
Coupe
Carr Clyde
Carr Clyde
Normal Blue
Metal Blue
DEALERSHIP
COLOR
5/16/2013
321
321
REGION Midwest
DISTRICT
Chicago
St. Louis
Gary
DEALERSHIP
Clyde
Gleason
Carr
Levi
Lucas
Bolton
5/16/2013
322
322

East West Central
5/16/2013
323
323

90 80 70 60 50 Inflows ( $M) 40 30 20 10 0
East West Central
1st Qtr
4th Qtr

5/16/2013
324
324

20 15 Inflows ( $M 10 ) 5
East West Central

325


HOLAP - Hybrid OLAP

DOLAP - Desk OLAP

5/16/2013
326
326
OLAP
Cube
Web Browser
OLAP Tools
OLAP Appli cations

5/16/2013
327
327
MOLAP - Features
5/16/2013
328
328
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
329
329

5/16/2013
330
330

OLAP Cube
Any Client
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
331
331
HOLAP - Features
5/16/2013
332
332
MOLAP
Definition
ROLAP
HOLAP
Slow
Cost
Where to apply?
5/16/2013
333
333
5/16/2013
334
334
5/16/2013
335
335
336

337

338

339

340

341

342
343
Unit Testing
344
Unit Testing
345
Integration Testing
346
Performance Testing

347
Acceptance testing
348
Questions
349
Thank You
350



351
OLAP
352
Agenda
MDDB Concepts
Features
5/16/2013
353
353

5/16/2013 354
354

Purpose of data

5/16/2013
355
MDDB Concepts
356

Relational DBMS
MDDB
Sales Volumes
M O D E L
Mini Van
Sedan
DEALERSHIP
COLOR
27 x 4 = 108 cells
357
3 x 3 x 3 = 27 cells

5/16/2013
358
358
Issues with MDDB
Sparsity
Data Explosion
Performance
5/16/2013
359
359

Employee Age
21 19 63 31 27 56 45 41 19
31 41 23 01 14 54 03 12 33
Smith
Regan
Fox
L A S T N A M E
Weld
Kelly
Link
Kranz
Lucas
Weiss
EMPLOYEE #
5/16/2013
360
360
OLAP Features
5/16/2013
361
361

Sales Volumes
M O D E L
Mini Van
6 3 4
Blue
5 5 3
Red
4 5 2
White
Coupe
o
Blue
6 5 4
3 5 5
MODEL
4 3 2
Sedan
Red
Sedan
White
Mini Van Coupe
COLOR
View #1
View #2

5/16/2013
362
362

Sales Volumes
M O D E L
Sedan
C O L O R
Blue
C O L O R
Blue
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
( ROTATE 90 )
DEALERSHIP
DEALERSHIP
MODEL
View #1
View #2
View #3
Mini Van
Clyde
M O D E L
Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
MODEL
COLOR
COLOR
View #4
View #5
View #6

5/16/2013
363
363

Sales Volumes
M O D E L
Mini Van Mini Van
Coupe
Carr Clyde
Carr Clyde
Normal Blue
Metal Blue
DEALERSHIP
COLOR
5/16/2013
364
364
REGION Midwest
DISTRICT
Chicago
St. Louis
Gary
DEALERSHIP
Clyde
Gleason
Carr
Levi
Lucas
Bolton
5/16/2013
365
365

East West Central
5/16/2013
366
366

90 80 70 60 50 Inflows ( $M) 40 30 20 10 0
East West Central
1st Qtr
4th Qtr

5/16/2013
367
367

20 15 Inflows ( $M 10 ) 5
East West Central

368


HOLAP - Hybrid OLAP

DOLAP - Desk OLAP

5/16/2013
369
369
OLAP
Cube
Web Browser
OLAP Tools
OLAP Appli cations

5/16/2013
370
370
MOLAP - Features
5/16/2013
371
371
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
372
372

5/16/2013
373
373

OLAP Cube
Any Client
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
374
374
HOLAP - Features
5/16/2013
375
375
MOLAP
Definition
ROLAP
HOLAP
Slow
Cost
Where to apply?
5/16/2013
376
376
5/16/2013
377
377
5/16/2013
378
378
379

380

381

382

383

384

385
386
Unit Testing
387
Unit Testing
388
Integration Testing
389
Performance Testing

390
Acceptance testing
391
Questions
392
Thank You
393
394

395
Data Modeling
396
Data Modeling


397

398
Star Schema
Dimension Table
Dimension Table
Fact Table
Dimension Table
399
Snowflake Schema
Dimension Table
400
401

402

Data Entry Points

Cost of bad data

Clean & Load Data
403

404

405
Tools In The Market

406
407
ETL Architecture
Visitors
Web Browsers
The Internet
Staging Area
RDBMS
Scheduled Loading
Other OLTP Systems
Data Collection
Data Extraction
Data Transformation
Data Loading
408
ETL Architecture
Data Extraction:
Data transformation

Data loading
409
Why ETL ?
410
411

412
ETL Tools
413
Metadata Management
414
What Is Metadata?
415

416

417
418



419

420



421
OLAP
422
Agenda
MDDB Concepts
Features
5/16/2013
423
423

5/16/2013 424
424

Purpose of data

5/16/2013
425
MDDB Concepts
426

Relational DBMS
MDDB
Sales Volumes
M O D E L
Mini Van
Sedan
DEALERSHIP
COLOR
27 x 4 = 108 cells
427
3 x 3 x 3 = 27 cells

5/16/2013
428
428
Issues with MDDB
Sparsity
Data Explosion
Performance
5/16/2013
429
429

Employee Age
21 19 63 31 27 56 45 41 19
31 41 23 01 14 54 03 12 33
Smith
Regan
Fox
L A S T N A M E
Weld
Kelly
Link
Kranz
Lucas
Weiss
EMPLOYEE #
5/16/2013
430
430
OLAP Features
5/16/2013
431
431

Sales Volumes
M O D E L
Mini Van
6 3 4
Blue
5 5 3
Red
4 5 2
White
Coupe
o
Blue
6 5 4
3 5 5
MODEL
4 3 2
Sedan
Red
Sedan
White
Mini Van Coupe
COLOR
View #1
View #2

5/16/2013
432
432

Sales Volumes
M O D E L
Sedan
C O L O R
Blue
C O L O R
Blue
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
( ROTATE 90 )
DEALERSHIP
DEALERSHIP
MODEL
View #1
View #2
View #3
Mini Van
Clyde
M O D E L
Sedan
COLOR
( ROTATE 90 )
MODEL
( ROTATE 90 )
DEALERSHIP
MODEL
COLOR
COLOR
View #4
View #5
View #6

5/16/2013
433
433

Sales Volumes
M O D E L
Mini Van Mini Van
Coupe
Carr Clyde
Carr Clyde
Normal Blue
Metal Blue
DEALERSHIP
COLOR
5/16/2013
434
434
REGION Midwest
DISTRICT
Chicago
St. Louis
Gary
DEALERSHIP
Clyde
Gleason
Carr
Levi
Lucas
Bolton
5/16/2013
435
435

East West Central
5/16/2013
436
436

90 80 70 60 50 Inflows ( $M) 40 30 20 10 0
East West Central
1st Qtr
4th Qtr

5/16/2013
437
437

20 15 Inflows ( $M 10 ) 5
East West Central

438


HOLAP - Hybrid OLAP

DOLAP - Desk OLAP

5/16/2013
439
439
OLAP
Cube
Web Browser
OLAP Tools
OLAP Appli cations

5/16/2013
440
440
MOLAP - Features
5/16/2013
441
441
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
442
442

5/16/2013
443
443

OLAP Cube
Any Client
Relational DW
Web Browser
SQL
OLAP Tools
OLAP Applications
5/16/2013
444
444
HOLAP - Features
5/16/2013
445
445
MOLAP
Definition
ROLAP
HOLAP
Slow
Cost
Where to apply?
5/16/2013
446
446
5/16/2013
447
447
5/16/2013
448
448
449

450

451

452

453

454

455
456
Unit Testing
457
Unit Testing
458
Integration Testing
459
Performance Testing

460
Acceptance testing
461
Questions
462
Thank You
463
Content
465
Content [contd]
466
An Overview
467
Content
468

Data Warehouse Concepts: Avinash Kanumuru Diya Jana Debyajit Majumder

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Data Warehouse Concepts: Avinash Kanumuru Diya Jana Debyajit Majumder

Uploaded by

Copyright:

Available Formats

Data Warehouse Concepts

Avinash Kanumuru Diya Jana Debyajit Majumder

2009 Wipro Ltd - Confidential

5 Data Extraction, Transformation, Load

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

2009 Wipro Ltd - Confidential

What is Data Warehouse?

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Data Warehouse def. by WH Inmon

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Data Warehouse Architecture

2009 Wipro Ltd - Confidential

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Data Warehouse Architecture

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

2009 Wipro Ltd - Confidential

Different Perceptive of Data Modeling.

Types of Dimensional Data Models most commonly used:

Terms used in Dimensional Data Model

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

region regId name north cold region south warm region

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Overview of Data Cleansing

2009 Wipro Ltd - Confidential

The Need For Data Quality

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Six Steps To Data Quality

Identify Potential Problem Areas & Asses Impact

Data Entry Points

Measure Quality Of Data

Use business rule discovery tools to identify data with

inconsistent, missing, incomplete, duplicate or incorrect values

Clean & Load Data

Schedule Periodic Cleansing of Source Data

Identify Areas of Improvement

Data Quality Solution

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Data Quality Solution

Tools In The Market

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Data Extraction, Transformation, Load

2009 Wipro Ltd - Confidential

External Data Demographics, Household, Webographics, Income

Meta Data Repository

Clean Transform Match Merge

Enterprise Data Warehouse

Other OLTP Systems

Data Storage & Integration

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Data Extraction Cleanup

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Major components involved in ETL Processing

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Major components involved in ETL Processing

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

2009 Wipro Ltd - Confidential

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

How much money was lost or earned as a result? Interpreting information

2009 2009 Wipro Wipro Ltd Ltd - Confidential Confidential

Requirements for DW Metadata Management