Machine Learning Specialization

Welcome
Emily Fox & Carlos Guestrin
Machine Learning Specialization
University of Washington
1 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Machine learning is
changing the world

2 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

Old view of ML

My curve
ML is better Write a
Data Algorithm than your paper
curve

3 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

4 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Search Coupons
Retail

Movie
Distribution
Disruptive companies Networking

differentiated by
Music INTELLIGENT Campaigning

APPLICATIONS
Advertising
using Real Estate

Human
Machine Learning
Resources Legal
Advice
Dating Wearables

CRM
Taxis
5   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 The machine learning pipeline

ML
Data Intelligence
Method

6   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 ML case studies

7 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Case Study 1:
Predicting house prices

ML
Data Regression Intelligence
Method

$ = ??
price ($)

$ $
$
+ house house size
features

8   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Case Study 2:
Sentiment analysis

ML
Data Classification Intelligence
Method
Sushi was awesome,
the food was awesome,
but the service was awful.
Score(x) < 0
All reviews:
“awful”

Score(x) > 0

“awesome”
9   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Case Study 3:
Document retrieval

ML
Data Clustering Intelligence
Method

SPORTS WORLD NEWS

ENTERTAINMENT SCIENCE
10   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Case Study 4:
Product recommendation

ML
Data Intelligence
Method
Your past Recommended
purchases: items:
Customers

+ purchase Products
histories of
all
customers
11   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Case Study 4:
Product recommendation

ML
Matrix
Data Intelligence
Method
Factorization
Your past Customers Recommended
purchases: items:
features

features

features
Products
+ purchase features
histories of
all features
customers features
12   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Case Study 5:
Visual product recommender

ML
Deep
Data Intelligence
Method
Learning

Input images: Nearest neighbors:

Layer 1 Layer 2
1 1

x1 z1 y

x2 z
2

13   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 A unique ML specialization

14 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Not like other ML
courses out there…

From use cases to

models & algorithms

15   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

First course is about building, evaluating
and deploying intelligence in each case study…

ML
Data Intelligence
Method

Model & Optimization

Task Evaluation
parameters algorithm

Use pre-specified
(black box)
16   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization
 Subsequent courses provide depth in
models & algorithms, but still use case studies
2.  Regression
3.  Classification
4.  Clustering & Retrieval
5.  Matrix Factorization &
Dimensionality Reduction
6.  Capstone: Build an
Intelligent Application
with Deep Learning

17   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

2. Regression
Case study: Predicting house prices
•  Linear regression
Models •  Regularization:
Ridge (L2), Lasso (L1)

•  Gradient descent
Algorithms •  Coordinate descent

•  Loss functions, bias-variance

Concepts tradeoff, cross-validation, sparsity,
overfitting, model selection

18   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

3. Classification
Case study: Analyzing sentiment
•  Linear classifiers
(logistic regression, SVMs, perceptron)
Models •  Kernels
•  Decision trees

•  Stochastic gradient descent

Algorithms •  Boosting

•  Decision boundaries, MLE, ensemble

Concepts methods, random forests, CART,
online learning

19   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

4. Clustering & Retrieval
Case study: Finding documents
•  Nearest neighbors
Models •  Clustering, mixtures of Gaussians
•  Latent Dirichlet allocation (LDA)

•  KD-trees, locality-sensitive hashing (LSH)

Algorithms •  K-means
•  Expectation-maximization (EM)

•  Distance metrics, approximation

Concepts algorithms, hashing, sampling algorithms,
scaling up with map-reduce

20   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

5. Matrix Factorization & Dimensionality Reduction
Case study: Recommending Products

•  Collaborative filtering
Models •  Matrix factorization
•  PCA

•  Coordinate descent
Algorithms •  Eigen decomposition
•  SVD

•  Matrix completion, eigenvalues,

Concepts random projections, cold-start
problem, diversity, scaling up

21   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 6. Capstone:
An intelligent application using deep learning

Build & deploy

a recommender using
product images and
text sentiment

22   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 This specialization is for you if…

23 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Level of the specialization
Motto:
tough concepts made intuitive
and applicable

minimize prereq knowledge

maximize ability to develop and deploy
learn concepts through case studies

24   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Target audience

Software engineer

Scientist

Data enthusiast

25   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Math background
•  Basic calculus
- Concept of derivatives
•  Basic linear algebra
- Vectors
- Matrices
- Matrix multiply

26   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Programming experience
•  Basic Python used
- Can pick up along the way if
knowledge of other language

27   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Computing needs
•  Basic desktop or laptop
•  Access to internet
•  Ability to:
- Install and run Python
- Store a few GB of data

28   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 You’ll be able to do
amazing things…

29 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 Our journey together…

Courses 2-5: Course 6:

Course 1: formulate,
design & deploy
build intelligent implement &
an exciting
applications evaluate
application
ML methods

30   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 The Capstone Project:
Build and deploy an intelligent
application with deep learning

31 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

 An intelligent recommender
using images & text

32 ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization

We will do something even more exciting…

Text
sentiment Computer
vision
analysis
Capstone
project

Recommenders Deep
learning

Deploy
intelligent
web app
33   ©2015 Emily Fox & Carlos Guestrin Machine Learning Specialization