Ciência de Dados

Um mundo de oportunidades

Ivanovitch Silva
Outubro, 2017
Motivação
Big Data

Data Science
2016/2017 - Especialização em Big Data

2017.1 - IMD0105 Introdução a Ciência dos dados

2017.2 - IMD0252 Análise da Aprendizagem

2017.2 - DCA0046 Ciência dos dados
2017.2 - EEC2006 Fundamentos da Ciência dos dados
2017.2 - ITE0021 Análise da Aprendizagem

BTI - Ciência de Dados I e II

Desafio Python Day

Big Data Day

https://github.com/ivanovitchm
Dados
 7

John Snow,
London, 1854

https://www.winshuttle.com/big-data-timeline/
 8

1854

https://en.wikipedia.org/wiki/John_Snow
 9

Neural Networks debuted

(1990)
Matan, Ofer, et al. Handwritten character
recognition using neural network
architectures. Proceeding of the 4th USPS
Advanced Technology Conference.
 10

06 de Agosto de 1991

Tim Berners-Lee

A World Wide Web torna-se disponível publicamente

Dados e informação são publicados pela primeira vez

90's

"Read"
Sistema de Busca
Google Atualização
00's
"Write"
Redes Sociais
Facebook Participação
10's
"Act"
App
Uber Ação
20's "Change"
IA
?
Transformação
17
 18

#IBMBigData (2011)

IBM introduced a Twitter hashtag, #IBMbigdata

which expanded on their Big Data themed
website that they built in 2008 in an effort to
integrate it into their marketing.
 19

Deep Learning experiment

at Google (2012)

After seeing 10 million images from

YouTube videos within three days, the
16,000-computer network, which had one
billion connections, began to recognize
cats, even though it had never been taught
what a cat looked like.
http://www.zdnet.com/article/google-brain-simula
tor-teaches-itself-to-recognize-cats/

http://www.nytimes.com/2012/02/19/magazine/shopping-habi
ts.html?pagewanted=1&_r=1&hp
20
How Companies Learn
Your Secrets (2012)
“My daughter got this in the mail!” he
said. “She’s still in high school, and
you’re sending her coupons for baby
clothes and cribs? Are you trying to
encourage her to get pregnant?”
 21

http://www.telegraph.co.uk/technology/news/10959864/Germanys-World-Cu
p-tactics-shaped-by-data.html

Germany’s 12th Man at the World Cup (2014)

 22

https://www.23andme.com/
23andMe has been selling a
product with both ancestry
and health-related
components in Canada
since October 2014
 23

https://datafloq.com/read/the-top-7-big-data-trends-for-2017/2493
https://www.youtube.com/watch?v=SOtm7vyIwxc
Big Data

http://www.showmetech.com.br/big-data-trump/
 68 likes
● user's race (96%)
● sexual orientation (89%)
● political affiliation (85%)

150 likes
● ++ family member

300 likes
● ++ spouse

Michal Kosinski - the father of the system, which deals with data processing.

https://goo.gl/OIWRcX
 29

IoT + Car Hacking + Big Data

https://www.kickstarter.com/projects/
1029808658/macchina-the-ultimate-t
ool-for-taking-control-of-y?token=e40
d156d

http://hackaday.com/2017/02/21/first-look-macchina-m2/ https://comma.ai/
Amazon's plan link
30

Conversational AI: Intelligent Applications Will

Revolutionise Interactions
quem lida
com essa
nova
realidade?
https://goo.gl/x9fxUp
32
Data Scientist: The Sexiest Job of the 21st Century
 Como se tornar
um cientista de dados
em 8 passos

http://blog.datacamp.com/wp-content/uploads/2014/08/How-to-become-a-data-scientist.jpg
35
36
37
38
 39

http://mariofilho.com/
 40

Desafios
 41

Variedade dos dados

Arquivos Banco de Dados

(XML, CSV, Excel, JSON, … ) (MySQL, Oracle, …)

API Sites

Textos e relatórios Mapas

Redes sociais
Imagem e video
 42

Key steps in a Data Science Analysis

http://www.pentaho.com/ https://www.tableau.com/
 https://www.google.com.br/analytics/
https://powerbi.microsoft.com
data-studio/
 45

https://goo.gl/Ndf38Q
Data Mining Fruitful and Fun

https://orange.biolab.si/
 47

Onde aprender?
 48

Curadoria (...)

http://www.andrewng.org/

http://mariofilho.com/
https://goo.gl/eecQ2V
https://goo.gl/Yy3EQ
q 51
https://goo.gl/2mQm2K 52

If you come from a C.S./developer

background, you'll probably feel more
comfortable with Python. On the other
hand, if you come from a
statistics/analyst background, R will
likely be more intuitive
 53

IEEE Spectrum - Jul 2016 https://goo.gl/BqrkDI

 54

IEEE Spectrum - Jul 2017 https://goo.gl/HSPLWe

 https://goo.gl/JdRL2a

Version 3.x (https://www.python.org/downloads/)

https://www.continuum.io/downloads
 57

Por que Anaconda?

 58

O que é um Notebook Jupyter?

Mistura de código e
elementos configuráveis
(textos, figuras, links,
equações, etc)

Além de JUlia, PYThon e R (JUPYTER) a tecnologia

notebook muitas outras linguagens
https://github.com/jupyter/jupyter/wiki/Jupyter-ker
nels

https://goo.gl/LfEx5r
 59

NetworkX

Folium

Beautiful Soap
 60

https://python-graph-gallery.com/