Aquiring knowledge of

In Business Intelligence
 Objectives
Our Goal is to understand the Basic Concepts of
Data Warehousing and be able to create a different
models to create OLAP CUBES.

To understand the ETL Process (Extract Transform

and Load).

And to have the Ability to find Patterns Using Data Mining

Techniques.
 Data
Warehousing
 Data Warehousing

Data warehousing is a process and

technology that involves collecting,
storing, and managing data from
various sources within an
organization in a central repository.

This central repository is known as

a data warehouse, and it is
designed to facilitate data analysis,
reporting, and business intelligence
activities.
 Key aspects in Data Warehousing
Data Integration: Data
warehousing involves gathering
01
data from diverse sources, such
as operational databases,
spreadsheets, and external
Data Integration
systems. This data is integrated
into a unified format and
structure for analysis.
Query and Reporting: Data
04
stored in the data warehouse
can be easily queried and used
for generating reports and
Query and
performing data analysis. This
Reporting
supports business intelligence
and decision-making
processes.
Data Transformation: Data is
02
often transformed and cleansed
to ensure consistency and
accuracy within the data
warehouse.Data
This includes tasks
Transformation
like data validation, data
cleansing, and data enrichment.
05
Historical Data: Data
warehouses often maintain
historical data, allowing
organizations to analyze trends
Historical Data
and make informed decisions
based on historical
performance.
Data Storage: Data warehouses
03
are optimized for storage and
query performance. They
typically use a specific schema
design, like a star or snowflake
Data Storage
schema, to efficiently store and
organize data.
Decision Support: Data
06
warehousing supports
strategic decision-making by
providing a consolidated and
Decision Support
reliable source of data for
business analysts, managers,
and decision-makers.
 Where Data Warehouse is commonly used ?
Retail
Retailers use data warehousing
to store and analyze sales data,
customer information, inventory
levels, and more. This helps
them make informed decisions
about pricing, inventory
management, and customer
preferences.
Marketing
Marketing firms and departments use
data warehousing to consolidate data
from various marketing channels,
such as digital marketing campaigns,
social media, and customer surveys.
This data supports marketing
analytics, customer segmentation,
and campaign optimization.
Finance
Financial institutions, such as
banks and investment firms, use
data warehousing to store
transaction data, customer
accounts, and market data. This
enables risk analysis, fraud
detection, and regulatory
compliance.
Telecom
Telecommunication companies
use data warehousing to store
call records, network
performance data, and customer
usage data. This allows them to
monitor network health,
optimize service delivery, and
analyze customer behavior.
Healthcare
Healthcare organizations use
data warehousing to consolidate
patient records, medical
histories, billing information, and
clinical data. This supports
medical research, patient care,
and compliance with healthcare
regulations.
Education
In the field of education, data
warehousing is increasingly used to
gather and analyze data related to
student performance, enrollment
trends, faculty information, and
institutional operations. This data
aids in improving educational
outcomes, resource allocation, and
administrative decision-making.
 Data Mart
Master Data Management
 Data Mart

A data mart is a smaller, focused

subset of a data warehouse that
caters to the specific needs of a
particular department, team, or
group within an organization. Data
marts are often created to improve
performance and
simplify access to data.
Difference of Data Mart and Data Warehouse

FACTORS DATA MART DATA WAREHOUSE

Summarized historical (in traditional

TYPE OF DATA Summarized historical
DW’s).

DATA Fewer source systems which are Wide variety of source systems from
SOURCES operationally focused. all across the enterprise.

Analyzing smaller data sets

Analyzing large (typically 100+ GB),
(typically <100 GB) focused on a
USE CASE OR complex, enterprise-wide datasets to
particular subject to support
SCOPE analytics and business intelligence
support data mining, BI artificial
intelligence, and machine learning.
(BI).

DATA Easier because data is already Requires strict governance rules and
GOVERNANCE partitioned. systems to access data.
3 Types of Data mart
 Dependent

A data mart that relies on the central data warehouse for its data
source, ensuring consistency and reducing data duplication.
 Independent

A standalone data repository created for specific departmental

needs, separate from the central data warehouse.
 Hybrid

Combines elements of both independent and dependent data marts, using the central data
warehouse as the primary source while allowing for some local data storage and
processing.
Master Data Management
Master Data Management

Master Data Management is a comprehensive

method for managing an organization's critical
data assets, often referred to as master data.
This data includes information about customers,
products, employees, and other entities that
need to be consistent and accurate across the
organization.
Data Warehouse
Dimensions
 What is Dimension in Data Warehousing ?

In data warehousing, a dimension is a collection

of reference information that supports a
measurable event, such as a customer
transaction. In this context, events are referred
to as "facts." Dimensions provide the details
necessary to understand and analyze a set of
related facts.
3 Types of Data
Dimensions
 Conformed Dimension

Conformed Dimension: Think of

it as a dimension (like
"customer" or "product") that
multiple data reports or
analyses can use consistently
without any confusion. It's like
having a shared vocabulary.
 Junk Dimension

Junk Dimension: This is like a

drawer where you put things
that don't belong anywhere else.
It's for attributes like flags or
yes/no values that don't need
their own special category.
 Degenerate Dimension

Degenerate Dimension: Think of

it as information that's right
there in the data you're looking
at. For example, in a sales
report, you might see invoice or
order numbers without needing
a separate document to explain
them.
Data Vault Modelling
 What is Data Vault Modelling?
Data Vault modeling is a highly flexible and
scalable methodology used in data
warehousing. It is designed to address the
challenges posed by rapidly changing data
sources, evolving business requirements, and
the need for adaptability in the data
warehousing environment. Data Vault modeling
provides a structured approach to data
warehouse design that accommodates various
data types and allows for seamless data
integration.
Here are 3 Cores of Data Vault Modelling

Hubs Satelites Links

These represent the core Satellites contain
business entities, such as descriptive information
customers or products. about the hubs, capturing
Hubs act as a central attributes and historical
repository for unique changes over time. They are
identifiers and links to linked to hubs and can be
related satellite data. updated independently
without altering the hubs.
Links establish
relationships between hubs
and are used to connect
different business entities
or events within the data.
OLAP Cube
 What is OLAP Cube?
An OLAP cube is a multi-dimensional array of
data. Online analytical processing (OLAP) is a
computer-based technique of analyzing data to
look for insights. The term cube here refers to a
multi-dimensional dataset, which is also
sometimes called a hypercube if the number of
dimensions is greater than three.
Parallel Processing
 What is Parallel Processing?
The processing of large amounts of data is
typical for data warehouse environments.
Depending on the available hardware resources,
sooner or later the point is reached where a job
cannot be processed on a single processor
respectively cannot be represented by a single
process anymore.
3 Main reasons why data
warehouse jobs cannot be
processed on a single
processor
3 main reasons why data warehouse jobs
cannot be processed on a single processor

Time System Recurrent

Requirements Resources Errors
It demands the use of (memory, disk space, Requires the repetition of
multiple processors temporary tablespace, the process
rollback segments, and etc.)
are limited
Advantages or Pros of
Data Warehousing
 Advantages or Pros of Data
Warehousing
Data Data Warehouse
Warehouse Data Mart Dimensions
Departmental focus. Improved Data Analysis.
Centralized Data Repository.

Data Vault Parallel

Modelling Processing
Flexibility and Scalability. Enhanced Performance.