Professional Documents
Culture Documents
Introduction
Chief Marketing Officers (CMOs) without plans for Big Data may be putting themselves and
their companies at a competitive disadvantage. Big Data is already being widely deployed to
enhance marketing responsibilities, although the small number of widely-touted success stories
might be masking a significant number of failed implementations. When correctly planned and
implemented, however, Big Data can create significant value for CMOs and their organisations.
In this paper, we focus on describing specific examples of how Big Data can support CMO
responsibilities and developing frameworks for identifying Big Data opportunities.
Big Data refers to the ability to derive insights and make decisions using a newly available, expanded set of technology tools (e.g.
Hadoop, Neo4j, Impala…) that store, process, and visualise data that is greater in volume, velocity, and variety than traditional business
intelligence (BI) tools can handle.
Whitepaper | 3
More than 90% of data in the world was Figure 1 – Use of Big Data by functionality area
produced in the last two years and several
exabytes are now produced each day Sales
5.0%
(more than 100 thousand times larger than 6.4% 15.2%
Marketing
the Library of Congress book collections).1
Customer Service
In response to this rapid growth of data, 6.7%
companies are quickly building capabilities Product Development
to store and analyse data. In 2012, $28 billion 7.7% 15.0% IT
of worldwide IT spending was devoted to
Manufacturing
Big Data and an additional $200 billion is
8.3% Finance
expected to be spent on Big Data by 2016.2
Marketing is one of the most enthusiastic Logistics
13.3%
adopters of Big Data. CMOs frequently 11.1% Other
identify Big Data as a top priority and 11.3%
HR
nearly three-quarters of marketers plan to
be leveraging Big Data analytics solutions
within the next two years.3
Since Marketing departments also tend Figure 2 – Core CMO responsibilities and Big Data use case examples
to spend the most on Big Data, they could
Responsibility Examples Use Cases Why Big Data
become the de-facto epicenter of Big
Data in an organisation. Today, CMOs are Consumer targeting Williams-Sonoma Developed revenue attribution and Consolidates millions of
targeting techniques to more consumer behavior
planning to allocate significant portions and segmentation efficiently target customer. The 8% of characteristics to target
direct emails with Big Data generated individual consumers
of their budgets in the next five years to content resulted in 32% of sales
develop Big Data capabilities, with 40% of
CMOs willing to spend up to half of their New product BMW BMW ConnectedDrive utilises Allows heightened
predictive analysis to forecast optimisation of a huge variety
development consumer trends and demands to and volume of data reserves
budget and another 45% willing to spend optimise design and capabilities
one-quarter.4 However, there is a significant
risk the money will not be well spent.
Advertisements Google Google leverages multi-source Tracks online consumer
Buying IT and Big Data technologies is consumer data to target behavior to more accurately
individuals with specific align adverts to individuals in
not a core capability of CMOs, but nearly advertising campaigns real time
1
IBM
2
Gartner
3
Teradata Data-Driven Marketing
Survey 2013
4
Forbes
Although Big Data is a top priority for CMOs, implement, yet general enough to result in a
70% of CMOs feel unprepared for it.5 manageable number of objectives.
There are, indeed, clear hurdles to Second, you must determine if Big Data is the
implementing Big Data, and CMOs are likely right solution for achieving your business
to encounter three common challenges: objectives or if existing technology can
1. Lack of alignment on the objectives suffice.
Without clear planning of objectives,
Finally, your implementation should be
companies may rush to implement
planned using a holistic framework that
‘something’ with Big Data just to keep up
includes both technology and business
with current trends. Often this approach
change elements.
will focus on the technical aspects of the
solutions and fail to meet the needs of the Since objective setting is a different topic
business. Vendors can be just as eager to relevant to many strategy and IT efforts, we
sell ‘something’ and may make promises focus below on the second element of our
about the flexibility and capabilities of approach, identifying when Big Data is the
their offerings to meet the yet unspecific right solution. The third topic,
business requirements of the company. implementation, is covered in a separate
forthcoming whitepaper.
2. Confusion about when Big Data is truly
required
Existing enterprise IT tools are quite
adept at solving many data analysis Identifying when Big Data is the solution
problems. Before investing in new Big Data
capabilities, ensure your objectives cannot
be achieved using existing capabilities. Each business objective can be assessed
3. Difficulties of technical implementation to determine whether Big Data tools
Data itself is often ‘dirty’ in the sense that are the right choice, or whether existing
it takes significant effort to prepare and technical capabilities are sufficient. We
standardise it before analyses can be propose assessing business objectives
performed. Clean data can also contain for Big Data suitability in two dimensions:
structural biases that could skew analysis decision-making characteristics and data
results. Since very few CMOs are data characteristics. When we say Big Data is the
scientists, significant effort may need to be ‘right choice’, we mean that traditional tools
invested into training and to integrate new will be unable to perform adequately, due to
tools into existing day-to-day workflows. On limitations on storage technologies (speed
this matter, a positive trend is that there’s a of writing data, speed of reading data) or
clear industry move towards making Big processing technologies (speed of analysis,
Data compatible with existing BI interfaces, database structure).
therefore bypassing the need to hire highly
Decision making characteristics
sought after data scientists. At the same
Big Data enables decision-making to occur
time, a Big Data implementation should
at a speed and level of detail beyond the
be holistic – appropriate training and tools
capabilities of previous generations of
are required not only for the department
technology. To identify whether your
implementing Big Data, but also for
decision-making process requires Big Data,
everyone who stands to be influenced by
consider the following two distinct, but often
the requirements and benefits it brings.
related characteristics of decision-making.
Many challenges can be avoided by using
the proper approach for Big Data
The first step in any approach to Big Data is to
define clear business objectives that focus on
business value rather than being technical in Source
nature. Objectives must be specific enough to
identify concrete technology capabilities to IBM Global CMO Study 2013
5
Whitepaper | 5
1. Volume
The amount of data to be analysed is a key
consideration in determining the need for
Big Data, as standard database technologies
may not be able to handle extremely large
volumes. To support 350+ million items
available, eBay needed to build out a
massive Hadoop implementation of 50+
petabytes.6
Source
6
Slideshare
7 Oracle
8
IDC’s Digital Universe Study, sponsored
by EMC, June 2011
Once you have clarified the characteristics of your decision making and the underlying
data, you can combine these considerations to help determine whether Big Data is
necessary. The framework below may help with this assessment. The qualifications of ‘high’
and ‘low’ are deliberately subjective, and what is considered ‘high’ or ‘low’ is a moving target
as technology continues to advance.
Figure 3
High
Variety
High speed
High of decision
Volume making, or Big Data likely needed
Low high number
Low of outcomes
Big Data potentially needed
Volume would likely
require Big Data
Traditional tools likely sufficient
Low High
Velocity
If your data has a high degree of Variety, If your data has a high degree of Volume Traditional tools, however, are still
you will likely need Big Data tools. AND you need to make fast decisions with appropriate for many tasks.
it, you will likely need Big Data tools.
Traditional tools were created to analyse If you only need to make a few decisions
well-structured data with clear Big Data tools are able to extract and with a small set of structured data,
relationships between tables and analyse data from enormous datasets very traditional tools are likely sufficient. For the
databases. By many definitions, any tool quickly, which is particularly useful for framework outcomes resulting in ‘Big Data
that can perform analysis across server rapidly changing data that can be analysed potentially needed’ it is important to keep
logs, geospatial data, social media, audio in-memory. Traditional tools, on the other in mind that there is an overlapping area of
and video files, unstructured text, and more hand, may be unable to analyse data fast capabilities where either tool may suffice.
will be a Big Data tool. enough for real-time decision making. This is especially true in cases where the
qualifications don’t fit neatly into ‘high’ or
If your data has a high degree of Velocity, If your data has a high degree of Volume
AND you need to perform many analyses ‘low’. In these cases, the less clear benefits
you will likely need Big Data tools.
on it, you will likely need Big Data tools. from Big Data will need to be weighed
Traditional relational databases were against the risk appetite for financial
created to optimise ‘reading’ data from Big Data tools are able to distribute complex investment and the organisational effort
databases, so difficulties emerge when processing jobs to a large number of nodes, required to implement Big Data.
trying to massively scale ‘writing’ to a reducing the computational complexity
databases. When velocity gets very high that would slow down the performance of
(e.g., hundreds of thousands of smartgrid traditional tools to an unacceptable level.
meters), Big Data tools will likely be the
only option.
Whitepaper | 7
Examples of applying the framework for identifying if Big Data is the solution