Welcome to IST 380 !

Data Science
Programming

We don't have strong enough words to describe this class.

- US News and Course Report

an advocate of When the course was over, I knew it was a good thing.
concrete computing –
and HMC's mascot - New York Times Review of Courses

We give this course two thumbs!

- Ebert and Roeper
 Welcome to IST 380 !

Data Science
Programming

an advocate of
concrete computing –
and HMC's mascot
 About myself

Who Zach Dodds

Where Harvey Mudd College

What Research includes robotics and computer vision

When Mondays 7-10pm here in ACB 119

dodds@cs.hmc.edu
Contact
Information 909-607-0867
Friday mornings, 9-11 am
Office Hours:
or set up a time...
HMC Beckman B111
 TMI?

fan of low-tech games

fan of low-level AI
 IST 380 ~ the big picture

What is it? Why me?

 IST 380 ~ the big picture

What is it?
Data Science
Venn Diagram

Hmmm… where am I
on this diagram?
• Neighbor's name
Data?!
• A place they consider home

• Are they working at a company now? Where?

• How many U.S. states have they visited?

• Their favorite unhealthy food… ?

• Do they have any "Data Science" background?

(statistics, machine learning, CS)
state reminders…
• Neighbor's name Zachary Dodds
Data!
• A place they consider home Pittsburgh, PA

• Are they working at a company now? Where? Harvey Mudd

• How many U.S. states have they visited? 44

• Their favorite unhealthy food… ? M&Ms

• Do they have any "Data Science" background?

(statistics, machine learning, CS)
mostly CS for me…
• Neighbor's name Zachary Dodds
Data!
• A place they consider home Pittsburgh, PA
u ly s em in a r-
c la s s i s tr
histhey working at a company
• TAre e , a s y o u ar e , now? Where? Harvey Mudd
sty le : I' m h e r
a i n in s ig h ts
• How rderU.S.
in omany to gstates have they visited? 44
n e w fi e ld … .
int o t h i s v e r y
• Their favorite unhealthy food… ? M&Ms

• Do they have any "Data Science" background?

(statistics, machine learning, CS)
mostly CS for me…

be sure to set up your login + profile for the submission site…

Data Science concerns

Hmmm…
the companies are expanding as fast as the data!
 There's certainly a lot of it!
Data, data everywhere…

1 Zettabyte 1.8 ZB 8.0 ZB

logarithmic scale
800 EB

Data produced each year

161 EB

5 EB
1 Exabyte

120 PB

100-years of HD video + audio

60 PB
Human brain's capacity
1 Petabyte 14 PB

1 Petabyte == 1000 TB 2002 2006 2009 2011 2015

1 TB = 1000 GB
References

(2015) 8 ZB: http://www.emc.com/collateral/analyst-reports/idc-extracting-value-from-chaos-ar.pdf (2002) 5 EB: http://www2.sims.berkeley.edu/research/projects/how-much-info-2003/execsum.htm

(2011) 1.8 ZB: http://www.emc.com/leadership/programs/digital-universe.htm (life in video) 60 PB: in 4320p resolution, extrapolated from 16MB for 1:21 of 640x480 video
(2009) 800 EB: http://www.emc.com/collateral/analyst-reports/idc-digital-universe-are-you-ready.pdf (w/sound) – almost certainly a gross overestimate, as sleep can be compressed significantly!

(2006) 161 EB: http://www.emc.com/collateral/analyst-reports/expanding-digital-idc-white-paper.pdf (brain) 14 PB: http://www.quora.com/Neuroscience-1/How-much-data-can-the-human-brain-store

I'd call it data,
not information

wisdom

knowledge

information

data
Big Data?

I agree with this…

Make data easier to use ~ by using it!

It may be true that

Data Science isn't a
science – but that
doesn't mean it's
not useful!
 IST 380 ~ the big picture

What? Why?
Data Science
Programming Data Rules

All of our insights – large and small, permanent and

ephemeral, natural and artificial – come about
through the integration of lots of data.

Data Science simply recognizes that the rules and

skills behind those insights are widely applicable…
 A few examples…

Make3d

Andrew Ng ~
Computers and
Thought award,
2009

How is this being done?

and how do we succeed?

… Data Science is at the heart of computer science

A few examples…

Learning to
Powerslide

Stanford's
Autonomous
Vehicles project
(Thrun et al.)

… Data Science is at the heart of computer science

A few examples…

Learning ground
from obstacles

"my summer was

finding that red line"

… Data Science is at the heart of computer science