March 27, 2012

CLOUD AND BI
BI-ETL Brown Bag Session
By Vivek Seth (Lead BI Architect)
3/27/2012 C O N F I D E N T I A L 1
 Agenda
 Definition of Cloud
Cloud Deployment Types
Cloud Service Models
 How does Cloud impact BI/DW Users?
Looking into some TDWI Survey results
 Cloud Use Cases
Business Intelligence
Data Warehouse
 Cloud and BI Vendors
MicroStrategy
Cognos (IBM)
Informatica
Business Objects (SAP)
SAS EBI
 Examples of Cloud in Consumer Market
 What is next for Cloud in BI Arena ?
 Recommendations.

C O N F I D E N T I A L 2
 Definition of Cloud
US National Institute of Standards and Technology (NIST)

“Cloud computing is a model for enabling convenient, on-demand

network access to a shared pool of configurable computing resources
that can be rapidly provisioned and released with minimal
management effort or service provider interaction.”

C O N F I D E N T I A L 3
 Factors that are Driving the need for Cloud

In distributed computing
environments, at times up
to 75% of computing
70% on average is spent capacity sits idle
on maintaining current IT
infrastructures versus
adding new capabilities.

C O N F I D E N T I A L 4
 “Cloud” – Computing as a Utility

C O N F I D E N T I A L 5
 Private Vs. Public CLOUD

•Public Clouds
Owner of Control vs. Economics of Scalability

–These get a lot of press, so it’s what we think of first.

–Driven by trends toward IT data center outsourcing.
–Software-as-a-service (SaaS) is often set up to run in a cloud.
(But SaaS is also available via non-cloud infrastructure)

•Hybrid is a Combo of Private and Public Clouds

•Private Clouds
–Some firms have set up private clouds in-house.
–A private cloud is sometimes called an enterprise cloud.
–Driven by need for cloud flexibility, but under secure control.
•Also, trend toward server virtualization, eventually data
virtualization.

C O N F I D E N T I A L 6
 Considerations Of Private Vs. Public Cloud

PRIVATE CLOUD PUBLIC CLOUD

 Cost :  Cost :
› Existing infrastructure › Economies of Scale
› Existing IT skills › Reduced Capital
› Complexity (of integration, data › Fixed to variable pricing, “pay as
migration) you go”
 Privacy/SBU/PII/HIPAA  Scalability
 Customization  Standardization

Appetite for sharing

Security
Control
Standardization
Performance/Response time

C O N F I D E N T I A L 7
 Cloud Deployment Models

•Software as a Service (SaaS)

•Infrastructure as a Service (IaaS)
•Platform as a Service (PaaS).
“Most BI Tools”

IaaS

“Most BI Tools”
PaaS
“Most BI Tools”

SaaS

C O N F I D E N T I A L 8
 TDWI Cloud Survey
“BI/DW Professionals are Familiar
with Cloud”

•TDWI Technology Survey

–Over two survey runs, respondents selecting “not
familiar at all” dropped from 42% to 16%.
–Results for “somewhat familiar” rose from 52% to
75%.
–“Very familiar” rose slightly.
–Responses to other questions saw “don’t know”
fall dramatically.

•BI/DW professionals are much more familiar with

cloud computing today than they were a year ago.
•Cloud computing is now on the radar screens of
BI/DW professionals.

C O N F I D E N T I A L 9
 TDWI Cloud Survey
“Users prefer Private Clouds over Public
Ones”
•TDWI Technology Survey
–In two runs of the survey, only 7% prefer a
public cloud
–~50% prefer a private cloud
–~25% prefer a hybrid combo
–A TDWI Best Practices survey of 2009
showed same preferences.
•The preference is due to:
–Users’ concerns over security and
governance with public clouds
–General confusion over cloud’s business
value
–How to move data into and out of a cloud

C O N F I D E N T I A L 10
 TDWI Cloud Survey

“Clouds are becoming more likely for

BI/DW”

•TDWI Technology Survey

–Users reporting “no plans” for cloud
decreased from 52% to 30%.
–Those in “exploration phase” increased from
26% to 49%.
–“Already using” and other more advanced
implementation phases remained about the
same.
•So, the percentage of user organizations
using cloud for BI/DW hasn’t increased much
in the last year, if at all.
•But the number considering it has increased
substantially, making it a more likely
possibility.
C O N F I D E N T I A L 11
 TDWI Cloud Survey
“Scalability, Savings & SaaS are Leading Benefits”

•Scalability is the leading benefit

–In both survey runs, “scalability on
demand” (37% and 49%) was the top
benefit of cloud computing.
–The related benefit “capacity guaranteed”
fared well, too.
•Potential savings is a benefit
–Seen in responses to “reduced IT costs”
and “reduces capital expenditures”.
•SaaS registered in the survey
–“Access to SaaS” rose from 26% to 34%.
–Similar rise for “automatic software
updates for SaaS” (20% to 23%).

C O N F I D E N T I A L 12
 “Barriers: Security, Governance, Value, Integration”
Security threats (46%, 62%)
–This is users’ top concern.
–Users will get comfortable as more clouds
appear.
•Governance issues (35%,
43%)
–Fears will subside as best practices for
data management on clouds coalesce.
•Unclear biz value (29%, 30%)
–The economic and IT admin benefits of
clouds are clear.
–But do they truly improve biz process &
performance?
•Moving data in/out (26%, 37%)
–BI and especially DW involve a lot of data
movement & integration.
–TDWI has seen users succeed with large
C O N F I D E N T I A L 13
data volumes & clouds.
 MicroStrategy and Cloud

C O N F I D E N T I A L 14
 MicroStrategy and Cloud

C O N F I D E N T I A L 15
 SAS Business Analytics in a Cloud

Support for internal and external Cloud Deployments

•Complete virtualization and optimization of compute services
•Dynamic SAS service provisioning
•On Demand & automated access to available compute capacity
•Self-service for effective creation and administration of services
•Based on a Pay-per-use model

C O N F I D E N T I A L 16
 Cognos and Cloud
“Use IBM Cognos Business Intelligence 10.1.1 on the IBM SmartCloud Enterprise. The IBM Cloud provides you with quick access a
security-rich, enterprise-ready testing and development environment to help reduce costs, shorten cycle times and improve quality. With
the IBM Cloud, you can access and pay for development and testing resources as you need them (Pay-Per-Use Model)“.

IBM SmartCloud Enterprise

C O N F I D E N T I A L 17
 Informatica and Cloud

Informtica Cloud Express is a pay-as-you Service

Informtica offers both Paas and Saas Models

Development tools and collaboration services that allow developers to create reusable data
integration tasks (e.g., mappings and mapplets), publish and run them as custom Informatica
Cloud Services.
Administration services that allow business users to schedule and automate integration tasks,
as well as manage users and track data integration performance.
Connector services including a secure agent that reaches through the firewall to deliver
powerful cloud-to-on-premise data integration, such as Salesforce CRM to Oracle, or Salesforce
CRM to JD Edwards, as well as cloud-to-cloud data integration.
A multitenant repository that ensures all upgrades are delivered seamlessly and customers
benefit from frequent releases.
A sandbox environment to test and develop integration tasks before running them in production.

C O N F I D E N T I A L 18

Reporting and BI Platforms
•Enterprise BI and Enterprise Reporting
–Scalability is a challenge.
•Thousands of concurrent end users
•Tens of thousands of reports to refresh daily or on
demand
–The cloud provides and reallocates resources as
enterprise BI workloads surge and subside.
•Departmental BI and Reporting
–TDWI is seeing a recent focus on departmental
BI.
•But enterprise BI is still there, too.
–As more departmental solutions are deployed, the
cloud provisions resources accordingly.
C O N F I D E N T I
Cloud : BI/DW Used Cases
Analytic Tools and Datasets
•Advanced Analytics is a growth area.
–Users are reaching beyond OLAP into advanced
forms of analytics that are discovery oriented.
•Extreme SQL, data mining, statistical, predictive,
natural language processing, MapReduce, etc.
•New Analytic Requirements
–Advanced analytic workloads can be disruptive,
unpredictable.
•Users tend to go through several large datasets,
quickly.
•Tools for advanced analytics run best with data in
certain models, file types, databases,
condition, etc.
–Clouds are proven to handle new analytic
requirements.
•Allocate resources as datasets, queries, predictive
models change
A L 19

Data Management Tools & Platforms
•Tools for Data Integration (DI) and Data Quality (DQ)
–DQ has a long history of service providers.
–Some DI tools are today available via SaaS.
–As user organizations get comfortable with moving data in/out of
clouds, usage will increase.
•Some public clouds charge per DI connection, which makes DW
expensive; this economic barrier needs to go away.
•Data Storage Platforms
–Some organizations have already virtualized their storage
systems as part of their cloud commitment.
–More will follow, then BI/DW will follow, too.
3/27/2012 C O N F I D E N T I
Cloud : BI/DW Used Cases
BI Data Stores
•TDWI has found in the cloud:
–Warehouses, marts, operational data stores, sandboxes,
analytic databases.
•Analytic Databases
–Can be a specialized database management system (DBMS)
like a column store; or any DBMS managing an analytic
dataset.
–Analytic DB offloads analytic workloads from EDW
•Conforms with trend toward distributed EDW architectures
–Cloud is a good home for analytic DBs of unpredictable size &
workload.
•Mixed Workloads on a Private Cloud
–One reason there are so many types of BI data stores is that
each optimizes and isolates a DW workload.
–Why? Most EDW platforms cannot handle multiple workloads
simultaneously.
•Imagine a Private Cloud as the EDW platform
–The cloud is flexible, so it can handle multiple workloads
simultaneously.
–Consolidate diverse BI data stores onto a single private cloud.
–Simplifies EDW architecture, governance, single version of
truth, data integration.
A L 20
 Examples of Cloud in Consumer Market

“Microsoft’s office 365 offers an “Apple’s iCloud stores your

avenue to perform , Store and music, photos, documents, and
Collaborate all you MS Office more and wirelessly pushes
tasks in the cloud.” them to all your devices.”

“Microsoft and Apple are planning to weave the cloud into the next generation of their
desktop operating systems, Windows 8, and OS X Mountain Lion.”
C O N F I D E N T I A L 21
 What is next for Cloud in BI Arena ?

• Usage will increase as users get comfortable with:

– Data security and privacy issues
– Moving data in/out of clouds
• Some organizations will adopt BI clouds due to:
– Focus on departmental BI
– Need for consolidation of bi data stores
• Some orgs have cloud for app servers and storage.
– These orgs are now moving BI/DW in their cloud.
– BI/DW usually lags in adoption of new infrastructure.
• Some apps need private cloud, other public.
– Expect a mixture of various cloud types, plus Web and traditional.
• TDWI expects many BI/DW tool/platforms on clouds.
– Should be common within three years.
– Eventually, clouds will be permanent infrastructure, even in BI/DW.

C O N F I D E N T I A L 22
 Recommendations
 Feel confident that clouds can support BI/DW.
–TDWI survey data shows that some organizations are already using clouds for BI/DW.

 Note that private clouds are easier to “sell”.

–They avoid user concerns over security, governance, data movement.
–Public clouds are just as useable (despite user concerns); good place prove cloud concept before building private
cloud.

 Embrace clouds for their benefits to BI/DW .

–Survey Sez: Scalability, Savings & SaaS are the leading benefits.
–Other Benefits: fast and flexible deployment of BI/DW tools and data; low-cost but scalable hardware maintained by
someone else (not you).

 Know the successful use cases.

–Enterprise BI and reporting, analytic tools, analytic databases, sandboxes, DI/DQ tools, data storage, isolated DW
workloads.
–More to follow, especially enterprise data warehouses.

 Consider various types of clouds as platforms for BI/DW.

–They are established, have demonstrated benefits, will become common.

C O N F I D E N T I A L 23
 References
Best Book on Cloud
Cloud Computing, A
 http://www.informaticacloud.com Practical Approach
by
 http://www.microstrategy.com/cloud/ Toby Velte ,Anthony
Velte
 http://WWW.TDWI.org
 www.information-management.com (Cloud Computing Exchange)
 Trends in BI and Cloud Computing by Philip Russom (Research
Director -TDWI)
 Cloud Computing in Healthcare by Healthcare Bobbi Terkowitz,IBM
 SAS Global Forum : See Through the Clouds – SAS and Cloud
Computing (Cheryl Doninger, R&D Director – SAS)
 http://www.ibm.com/developerworks/downloads/im/cognosbi/cloud.html

C O N F I D E N T I A L 24
 Questions ?

C O N F I D E N T I A L