Statistics for

Data Science III

@shiftacademy.id
Correlation
Causation
Correlation vs Causation

https://www.decisionskills.com/blog/how-ice-cream-kills-understanding-cause-and-effect
Correlation and Causation
Correlation Measurement
Correlation Measurement
Correlation Measurement
A/B Testing
Experimental Design
Steps to do an Experiment

Define an Experiment Define Metrics Define Duration the

Experiment

Post-Analysis Stop the Analysis Do Interim Analysis

Define an
Experiment
● What’s the name of the experiment

Ex : AB Testing the New Design for Registration Webview

● Define Hypothesis

Ex : New design will increase the conversion rate (registration rate)

● Who is the participant

Ex : The user that visit registration webview

● What variable that will be tested

Ex : Existing Design & New Design

Define Metrics

Macroconversions
Metrics yang sangat bersentuhan dengan hipotesis

e.g. completed registration (registration rate)

Microconversions
Metrics yang mengukur aksi lain yang disebabkan dari perubahan variabel

e.g. watching a video

Vanity Metrics
Metrics pendukung
e.g. page views
Define the
Durations

● Sample Size

● Seasonal Effect
How to
Analyze?
Hypothesis Testing
T-test
Analyze
Frequently