7 - 4. R

R,
30 Open Technet
-
2012.07.26
R,
Excellence in Application & Data Governance
What is R?
R is a language and environment for statistical computing and graphics.
l Data analysis software

l A programming language
-
l An environment
-
, , , ,

l An open-source software project

-
Free, open, and active
l A community
-
contributors, 2
R : Open source analytics for the enterprise
R
l ,

: Revolution Analytics
R
l ,
tool
R
l , Google Facebook R

Google's R Style Guide

Google uses R for data exploration
and model prototyping, it is not
typically used in production: in Bos
group, R is typically run in a desktop
environment.
- Bo Cowgill, Google
Itamar conveyed how Facebooks

Data Team used R in 2007 to
answer two questions about new
users: (i) which data points predict
whether a user will stay? and (ii) if
they stay, which data points predict
how active theyll be after three
months?
- Itamar Rosenn, Facebook
http://www.dataspora.com/2009/02/predictive-analytics-using-r/
Vendor R
l Oracle, IBM Netezza, SAP HANA, Teradata in-memory
in-database R
Vendor R
l SAS SPSS R

SAS/JMP
SAS understands why R

A key benefit of R is that it provides near
instant availability of new and experimental
methods created by its user base without
waiting for the development/release cycle of
commercial software. SAS recognizes the
value of R to our customer base
Michael Gilliland, Product Marketing
Manager SAS Institute, Inc.
10
SPSS with R
l SPSS R ?
-
- , R
, . ( )
l SPSS Statistics 17( 18 ) R

Win-Win
-
SPSS, R
SPSS , , TEST ,
,
Tobit SPSS
, , ,
. SPSS
!!!
: RUserConf2011 - SPSS R , , SPSS Korea, 2011.10.28
11
Big Data R
l
12
R
l In-Memory Computing
- , H/W
l Object-oriented programming
- , object
- (class) & (method)
l Package
-
- , Help Examples
l Visualization
-
- Chart, Plot, MotionChart, Map R
13
History of R
: (, 2011)
l R 1993 2(Ross Ihaka,

Robert Gentleman)
l 1976 Bell Lab John Chambers, Rick Becker, Allan Wilks
S Language
14
The R Foundation (http://www.r-project.org)
l R Development Core Team

l R R Development Core Team

15
CRAN (The Comprehensive R Archive Network)

http://cran.r-project.org/
Korea :
http://cran.nexr.com/
l R CRAN Site
l 39 87 Mirror
16
R Package
R Package (http://cran.r-project.org/web/packages/)
R
l CRAN Site 3,938

(2012 7 20 )
l
IT

l Software Vendor
Version Up

17
R Package
CRAN Task View (http://cran.r-project.org/web/views/)
18
R Package
Crantastic! (http://crantastic.org)
19
R Visualization
ggplot2
l ggplot2 is a flexible, colorful, and dynamic graphics package:
20
R Visualization
Word Cloud
l R text mining Word Cloud
21
R Visualization
2-D contour map of Maunga Whau volcano
22
R Visualization
3-D contour map of Maunga Whau volcano

Make it 3-d:
23
R Visualization
googleVis
l R API
MotionChart Gap Miner

googleVis R
Hans Rosling: No more boring data: TEDTalks
http://code.google.com/p/google-motion-charts-with-r/
24
R Visualization
RgoogleMaps
l

# ...
library(RgoogleMaps)
#
tollgate_info <- read.csv(".csv")
#
map.center.loc <- c(36, 128)
#
input.zoom <- 7
map_data <- tollgate_info
#
win.graph()
mymap <- GetMap(center = map.center.loc,
zoom = input.zoom, maptype = "road", format
= "roadmap", destfile = "mymap.png")
PlotOnStaticMap(mymap, lat =
map_data$Y, lon = map_data$X,
destfile = "mymap.point.png", cex = 1, pch
=20, col="blue)
: R ,
25
R Visualization
animation
l R Graph animation
# animation
saveHTML({
for(map.i in 1:length(unique.name)) {
mymap <- GetMap(center =
map.center.loc, zoom = input.zoom, maptype
= "road", format = "roadmap", destfile =
"mymap.png")
PlotOnStaticMap(mymap, lat =
map_data[map_data$ ==
unique.name[map.i], ]$Y, lon =
map_data[map_data$ ==
unique.name[map.i], ]$X, destfile =
"mymap.point.png", cex = 1, pch =20,
col="blue")
}
}, img.name = "unif_plot", imgdir = "unif_dir",
htmlfile = "random.html",
autobrowse = FALSE, title = "
",
description = c("RgoogleMaps
.\n\n"))
: R ,
26
Useful R IDE
RGUI
l RGui , ,
27
Useful R IDE
R Studio (http://www.rstudio.org/)
28
Useful R IDE
R Studio
29
Useful R IDE
Red-R (http://www.red-r.org/)
30
Useful R IDE
Red-R
31
Useful R IDE
Rattle (http://rattle.togaware.com/), (install.packages("rattle"))
32
Useful R IDE
Rattle (library(rattle); rattle())
33
Useful R IDE
RExcel (http://rcom.univie.ac.at/)
34
Useful R IDE
RExcel
35
Useful R IDE
R Commander (install.packages("Rcmdr"), library(Rcmdr))
36
Useful R IDE
R Commander
37
Useful R IDE
Revolution R (http://www.revolutionanalytics.com/)
38
Useful R IDE
Revolution R
39
Useful R IDE
StatET for R (http://www.walware.de/goto/statet)
40
Useful R IDE
StatET for R
41
R
l http://www.r-project.org
l http://www.r-project.kr ( R - KRUG)
l http://www.r-bloggers.com
l http://stackoverflow.com
l http://stats.stackexchange.com
l http://www.inside-r.org/
l http://www.r-statistics.com/
l http://support.rstudio.org/
l http://quora.com
42
43
Learning R
44
R,
45
Advanced Analytics
l (Advanced Analytics) ,
() ,

Optimization
Predictive Modeling
egatnavda evititepmoC
Forecasting/extrapolation
Statistical Analysis
Whats the best that can happen?

What will happen next?
What if these trends continue?
Analytics
Why is this happening?

What actions are needed?
Alerts
Query/drill down
Where exactly is the problem?
Ad hoc Reports
How many, how often, where?
Standard Reports
What happened?
Access and
Reporting
Degree of Intelligence
: Davenport and Harris, Competing on Analytics, Harvard Business School Press (2007)
46
What is Big Data Analysis?
: SAS and IDC

47
What makes a good data scientist?

l Technical expertise( ): the best data scientists
typically have deep expertise in some scientific discipline
l Curiosity(): a desire to go beneath the surface and discover
and distill a problem down into a very clear set of hypotheses that
can be tested.
l Storytelling(): the ability to use data to tell a story and to
be able to communicate it effectively.
l Cleverness(): the ability to look at a problem
in different, creative ways.
* Patil, DJ (2011-09-22). Building Data Science Teams. OReilly Media
48
R
l Single Core
- CPU 1
- R 2.14 parallel
l In-Memory
-
-
Open Source
l Snow, multicore, parallel, bigmemory Multi-core

l

49
RHIPE (http://www.datadr.org/index.html)
l RHIPE(R and Hadoop Integrated Programming Environment)
Purdue Univ. Saptarshi Guha
R
l R Hadoop MapReduce
l Revolution Analytics RHadoop .
l Divide & Recombine (D&R) , not parallel processing.
Facebook RHIPE Video (2010.03.09)

http://www.lecturemaker.com/2011/02/rhipe/
50
RHadoop (https://github.com/RevolutionAnalytics/RHadoop)
l Hadoop Map-Reduce R Code
Hadoop
51
RHadoop (Word Count Example)
: R ,
52
RHive Motivation of Rhive (NexR)
: R and RHive in Data Scientists toolbox, (2011)

53
RHive (https://github.com/nexr/RHive)
l R Hive , R
Hive Hadoop
: R and RHive in Data Scientists toolbox, (2011)

54
RHive Example
: http://www.nexr.co.kr/nexrcorp_en/products_and_services/rhive_useCase.php
55
RevoScaleR
l RevoScaleR Single Core
l HPC Clusters/Cloud R
RevoScaleR on Sing Computer
RevoScaleR on Multiple Computers

) HPC Clusters, IBM LSF Cluster ,
2012 Linux Clusters
56
High-Performance Computing
(http://cran.r-project.org/web/views/HighPerformanceComputing.html)
l Parallel computing: Explicit parallelism Rmpi, snow, snowfall, foreach, doMPI
l Parallel computing: Implicit parallelism fork, multicore
l Parallel computing: Grid computing
l Parallel computing: Hadoop
GridR, xgrid, biocep-distrib

RHIPE, Rhadoop, EMR(Elastic Map Reduce)
l Parallel computing: Random numbers doRNG, rprng

l Parallel computing: Resource managers and batch schedulers batch, BatchJobs
l Parallel computing: Applications
caret, maanova, tm, bcp
l Parallel computing: GPUs
gputools, cudaBayesreg, OpenCL, WideLM
l Large memory and out-of-memory data bigmemory, biglm, ff, HaddpStreaming

l Easier interfaces for Compiled code
inline, Rcpp, rJava
l Profiling tools
profr, proftools
57
RevoDeployR (Architecture)
l RevoDeployR R Application
58
RevoDeployR (Sample App)

l DeployR HTML5 plot library from JingCharts
59

l ?
:
RDBMS (Scale-up) ,
.
Scale-out
?
l ?
: , SAS SPSS
.
.

?
60
LCBEx (Low Cost But Excellent)

l (Low
Cost) (Excellent)
Analytic Platform( )
Efficiency

, ,

Scalability
Agility

Hadoop

,

: R ,
61

l .
l ?
( , ) .
Data Scientist ( ) .
Slow and Steady Wins the Race.

Study,
study,
study, study.
study
62
DG
Tel : 010-4801-6609
email : leewow@gtone.co.kr
63

7 - 4. R

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

7 - 4. R

Uploaded by

Copyright:

Available Formats

R,

Excellence in Application & Data Governance

l Data analysis software

l An open-source software project

Free, open, and active

Excellence in Application & Data Governance

R : Open source analytics for the enterprise

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Google's R Style Guide

Itamar conveyed how Facebooks

Excellence in Application & Data Governance

Excellence in Application & Data Governance

SAS understands why R

Excellence in Application & Data Governance

l SPSS Statistics 17( 18 ) R

Excellence in Application & Data Governance

l R 1993 2(Ross Ihaka,

The R Foundation (http://www.r-project.org)

l R Development Core Team

CRAN (The Comprehensive R Archive Network)

Excellence in Application & Data Governance

l CRAN Site 3,938

Excellence in Application & Data Governance

CRAN Task View (http://cran.r-project.org/web/views/)

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

2-D contour map of Maunga Whau volcano

Excellence in Application & Data Governance

3-D contour map of Maunga Whau volcano

Excellence in Application & Data Governance

MotionChart Gap Miner

Hans Rosling: No more boring data: TEDTalks

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Rattle (http://rattle.togaware.com/), (install.packages("rattle"))

Excellence in Application & Data Governance

Rattle (library(rattle); rattle())

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

R Commander (install.packages("Rcmdr"), library(Rcmdr))

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

StatET for R (http://www.walware.de/goto/statet)

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Excellence in Application & Data Governance

Whats the best that can happen?

Why is this happening?

Where exactly is the problem?

How many, how often, where?

What is Big Data Analysis?

: SAS and IDC

What makes a good data scientist?