ISTM 637: Data Warehousing

ARUN SEN

W E B S I T E : E C A M P U S . TA M U . E D U

09/07/2020 COPYRIGHTED BY ARUN SEN 1

 Data Warehousing
• Background materials in Data Warehousing
• Design
• Tasks in Data Warehousing
• Data Warehousing Methodologies
• Metadata in a Data Warehouse
• Physical Data Warehouse Design
• End User View
• Implementation
• SQL Server 2016

09/07/2020 COPYRIGHTED BY ARUN SEN 2

 Remember …
• The course is NOT to make you “SQL proficient”
• This is NOT an “implementation course”
• It is an “analysis and design” course (in line with Systems
Analysis course)
• However, implementation is important as it rounds up the course
• My research area is DW Process design … I know SQL but I
am not an SQL geek

09/07/2020 COPYRIGHTED BY ARUN SEN 3

 By the way, we are touching 1ft of a 100-ft
iceberg called DW/BI and Data Analytics
….
Business analytics is a
practitioner movement uniting
several disciplines to drive
value-creating decisions from
data. Central disciplines
include IT / computer science,
statistics, data mgmt, decision
science, and scientific
research methods.
Descriptive, predictive, and
prescriptive approaches are
often used to categorize
particular methodological
approaches, themselves
derived from the fields of
business intelligence, financial
forecasting and econometrics,
and operations management,
respectively. Diagnostics,
dynamic visualization, and
semantic analytics are
particular supporting
techniques

https://sctr7.com/2014/07/09/twelve-emerging-trends-in-data-analytics-part-1-of-4/
 Remember …
• Ethics
• Aggie Honor Code

• One strike and an F in the course

09/07/2020 COPYRIGHTED BY ARUN SEN 5

 Why Study Data Warehousing?

09/07/2020 COPYRIGHTED BY ARUN SEN 6

 Why Study Data Warehouse?
1. Good jobs
• go to www.monster.com
• another good site to look at
http://www.informationweek.com/advisor/
• types of jobs –
• with a consulting firm working with many clients
• working for a company/government
• running your own show
• DW is now used manufacturing (auto, computer,
transportation, etc.) and service (financial, health-care, etc.)

09/07/2020 COPYRIGHTED BY ARUN SEN 7

Job Types
• BI DEVELOPER

• ETL DEVELOPER

• DATA ARCHITECT

• REPORTING ANALYST

• DATA QUALITY ANALYST

• DATA GOVERNANCE
Job Types
Job Types
Job Types
 Why Study Data Warehouse?
2. Good Salary

SOURCE: Big Data Widens Analytic Talent Gap, InformationWeek: reports, April 2012

09/07/2020 COPYRIGHTED BY ARUN SEN 12

 Why Study Data Warehouse?
2. Good Salary

SOURCE: Big Data Widens Analytic Talent Gap, InformationWeek: reports, April 2012

09/07/2020 COPYRIGHTED BY ARUN SEN 13

 Why Study Data Warehouse?
2. Good Salary

SOURCE: Big Data Widens Analytic Talent Gap, InformationWeek: reports, April 2012

09/07/2020 COPYRIGHTED BY ARUN SEN 14

 Why Study Data Warehouse?
2. Good Salary

SOURCE: Big Data Widens Analytic Talent Gap, InformationWeek: reports, April 2012

09/07/2020 COPYRIGHTED BY ARUN SEN 15

 Why Study Data Warehouse?

3. IT Comes of Age
• Centralized DBMS
• Multiple DBMSs (homogenous or heterogeneous)
• Distributed DBMSs
• Parallel Query Processing
• Parallel Processing

09/07/2020 COPYRIGHTED BY ARUN SEN 16

 Why Study Data Warehouse?
4. History of Decision Support
• Early stage -- Ad hoc Reports
• Next -- Special Extraction Programs when IT can anticipate the reports
• Next -- Small Applications … formalized the extraction process
• Early 70’s -- Information Centers
• 80’s – early 90’s -- Decision Support Systems
• Late 80’s -- Executive Information Systems
• 90’s onward -- Business Analytics/Web Analytics/Business
Intelligence/CRM

09/07/2020 COPYRIGHTED BY ARUN SEN 17

 Why Study Data Warehouse?
5. Operational Versus Decision Support
• Focus on Transaction processing
• Focus on Analytical processing
• New angle – focusing on “transaction processing” again

09/07/2020 COPYRIGHTED BY ARUN SEN 18

 New Killer Apps: BI and CRM
Business Intelligence
Display the name and address of
business customer TechCo.
List customers who visit one of the video
stores in our chain on a weekly basis
Display a list of customers who have
lodged a complaint within the last 30
days.
Analyze the top five most popular office
supplies and compare approved vendors’
prices to prices of other potential
suppliers.
List the e-mail addresses for registered
customers who abandoned their
shopping carts during their last Web
visit.
Reference: http://www.datawarehouse.com/article/?articleid=2963
09/07/2020
CRM CRM Rationale
Salespeople become aware of
Display TechCo’s most recent inbound contact on
existing issues before meeting
my PDA, along with their current corporate address
with the customer.
Once a month for the next six months, direct mail
customers most likely to rent next month’s new Convert casual visitors to
feature films who are not weekly visitors to the frequent visitors.
store.
Contact all high-value customers who have lodged
Focus on retaining high value
a complaint. Generate retention recommendations
customers.
for each customer.
Identify the top five purchased office supplies and Increase the likelihood of
trial- run a Web RFQ system for limited quantities price improvements on
to test price improvements. commodity purchases.
Send profitable registered customers a $5 online
Reward repeat customers who
discount if they fill in a form explaining why they
are profitable while gathering
abandoned their shopping carts. Send 10 percent
valuable prospect behavior
off to the unknown visitor if they complete the
data.
form.
COPYRIGHTED BY ARUN SEN 19