Welcome to Scribd, the world's digital library. Read, publish, and share books and documents. See more ➡
Download
Standard view
Full view
of .
Add note
Save to My Library
Sync to mobile
Look up keyword
Like this
3Activity
×
0 of .
Results for:
No results containing your search query
P. 1
Data scientist par EMC

Data scientist par EMC

Ratings: (0)|Views: 1,762|Likes:
Published by L'Usine Nouvelle

More info:

categoriesBusiness/Law
Published by: L'Usine Nouvelle on Dec 05, 2011
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PDF, DOCX, TXT or read online from Scribd
See More
See less

08/23/2013

pdf

text

original

 
Profiling the Data Science Community
Introduction
Data science is an emerging field, with rapid changes, great uncertainty, and exciting opportunities.Our study attempts the first ever benchmark of the data science community, looking at how theyinteract with their data, the tools they use, their education, and how their organizations approachdata-driven problem solving. We also looked at a smaller group of business intelligenceprofessionals to identify areas of contrast between the emerging role of data scientists and themore mature field of BI. Our findings, summarized here, show an emerging talent gap betweenorganizational needs and current industry capabilities exemplified by the unique contributions datascientists can make to an organization, and the broad expectations of data science professionalsgenerally.
The Emerging Talent Gap
For the past two decades, business and political leaders have sounded a warning call about theshortage of trained computer scientists, programmers, and engineers necessary to continue toadvance a high tech economy. Less noticed has been the coming gap in analytics professionalsneeded to use all of the data created by these high tech systems. In 2009, Google Chief EconomistHal Varian predicted that the statisticians will be the next sexy job
i
, and in our own survey, 83% ofData Scientists felt that newtechnology would increase thedemand for data scientists, and 64%believe that it will outpace the supplyof available talent.This makes intuitive sense for a youngfield. Technological trends tend tofollow a cycle, where the initialopportunity leads to ever increasingdemand for a certain set of skills,while later demand wanes as many ofthose initial skills are automated byeven newer tools. Consider, forinstance, the way many data processing and network management jobs that used to requirelegions of computer operators are now handled by automated monitoring tools. Data science isstill in its early phase, with the amount of data exploding and the right tools to process them justbecoming available.
Increase thenumber of datascientistsrequired byopening up newpossibilities83%Decrease thenumber of datascientistsrequired byautomatingmuch of theanalytical work17%
New tools and technology will…
 
 
Although data science is generating newopportunities, our capacity to train new datascientists is not keeping up, and nearly two-thirds of respondents foresee a loomingshortfall in the number of data scientists overthe next five years. This aligns with otherresearch, including a recent McKinsey GlobalInstitute study that predicts a shortage of190,000 data scientists by the year 2019
ii
.And when our respondents were asked wherethe best source for talent was, few looked to
today’s business intelligence professional.
Instead, nearly two-
thirds looked for today’s
university students.
Who is the Data Scientist?
Although the term data science has been around for decades
indeed, most scientists use data ofsome form
the term data scientist in its current context is relatively new, frequently credited to DJPatil, who started the data science team at LinkedIn.
iii
But as a new term, the field is still verymuch in flux, and without evidence about th
e practitioners, we’re left to speculate abuot what it
may mean. In our survey, we allowed users to self-
identify as “data science professionals,” in order
to avoid conflicts over terminology in job titles. I
n this section we’ll attempt to define the dat
ascientist by comparing them with the previousbig player in the analytics space, businessintelligence professionals.Twenty years ago, business intelligence wasitself a new term, just emerging to take over thevarious database management and decisionssupport functions within an organization. As thefield grew rapidly in the 90s, it also coalescedaround a smaller number of tools, moreconsistent expectations for talent, bettertraining, and more rigorous organizationalstandards. As our data demonstrates, datascientists are currently going through thattransition,It may be helpful to think of data science andbusiness intelligence as being on two ends of the same spectrum, with business intelligencefocused on managing and reporting existing business data in order to monitor or manage variousconcerns within the enterprise. In contrast, data science applies advanced analytical tools and
Studentsstudyingstudyingcomputerscience34%Studentsstudyingfields otherthancomputerscience24%Professionalsin disciplinesother than ITor computerscience27%Today's BIprofessionals12%Other3%
The best source of new Data Science talentis:
John Smith
(Real Name Withheld) is a former intelligenceanalyst who dealt with massive data sets to inform him on the patterns of drug traffic across US borders and in and out of  ports. His team and he were able to dramatically increasenumber of seizures by using statistical analyses to isolate easy to reach and difficult to patrol locations - with success drivenby the establishment of new off-shore monitoring protocols.Coupled with the use of Open Source Intelligence (monitoring data from Twitter, Wikipedia updates, etc) used by IARPA - theIntelligence Advanced Research Projects Activity 
which seeks to identify events before they occur, based on tracking  sentiment 
we can see Government Agencies increasingly utilizing big data to both inform and guide their strategic andtactical decision making processes.
 
 
algorithms to generate predictive insights and new product innovations that are a direct result ofthe data.The need for rigorous scientific training was born out in our research on data scientists, and paintsa clear distinction between data scientists and BI professionals. The most popular undergraduatedegree for BI professionals was in business at 37% - more than the next three categoriescombined. In contrast, the most popular degree for data science professionals was computerscience (24%), followed closely by engineering (17%) and the hard sciences (11%). We also foundthat data science professionals were over 2.5 times more likely to have a
master’s
degree, andover 9 times more likely to have a doctoral degree as business intelligence professionals.The data science toolkit is more varied and more technically sophisticated than the BI toolkit.While most BI professionals do their analysis and data processing in Excel, data scienceprofessionals are using SQL, advanced statistical packages, and NoSQL databases. Further,although big-data tools like Hadoop, and advanced visualization tools like Tableau are just startingto emerge in the data science world, they are almost unseen in the business intelligence world.Open Source tools, like the R statistics package, Python, and Perl, are each used by one in five datascience professionals, but around one in twenty BI professionals.
Data Storage DataManagementData Analysis Data Visualization
An important facet of data science is the ability to run experiments on data, as evidenced by DJ
Patel’s description of how they built the “people you may know” function at LinkedIn:
 
It would have been easy to turn this into a high-ceremony development project that would take thousands of hours of developer time, plus thousands of hours of computing time to do massive correlations acrossLinkedIn's membership. But the process worked quite differently: it started out with a relatively small, simple program that looked at members' profiles and made recommendations accordingly. Asking things like, did you go to Cornell? Then you might like to join the Cornell Alumni group. It then branched out incrementally. Inaddition to looking at profiles, LinkedIn's data scientists started looking at events that members attended. Then
51%42%39%15%7%10%11%12%46%35%21%13%13%0%4%2%
Microsoft SQLServerIBMOracleOther SQLdatabaseOther NoSQLdatabaseNetezzaGreenplumHadoop
68%52%22%20%16%14%77%22%5%7%2%3%
ExcelSQLPythonPerlBASHAWK
43%37%29%19%20%37%27%13%7%5%
SASSTATASPSSGreenplumR
44%35%32%22%21%18%15%15%9%51%25%24%17%11%4%4%5%5%
Microsoft BusinessIntelligence ToolsOracle BusinessIntellience ToolsIBM/Cognos BusinessIntelligence ToolsSAP/BusinessObjects BusinessIntelligenceMicroStrategyBusiness IntelligenceToolsTableauQlikViewDatameerKarmasphere

You're Reading a Free Preview

Download
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->