Big Data In Cloud Computing : Features & Challenges

Under the guidance of

Dr. Anuradha Kanade
School Of Computer Science
MIT WPU

Ritwik Sonal Parag Bhangale Ashish Pal

TY MCA TY MCA TY MCA
Faculty of Science Faculty of Science Faculty of Science
MIT WPU MIT WPU MIT WPU
Pune, India Pune , India Pune , India

Abstract information or addresses exaflop

computing abilities efficiently. This paper
Big data refers to the large amount of overviews both cloud and big data
information that is just too difficult to technologies describing the current issues
manage with traditional data-modeling with these technologies.
techniques. Big data technology is able to
store and process large volumes of Literature Review
different types of data, delivering
meaningful insights by exploring its Big Data is a major trend that is increasing
clients' or experiments' entire in size day by day, and new challenges and
activities/statistics. Cloud computing solutions are being published every day.
provides a way to manage big data in an
Cloud computing is awesome for
environment that is reliable,available and
performing massive and complex
scalable. In this paper, we will discuss an
calculations. It reduces the need to
overview of big data and cloud computing
maintain expensive computer hardware,
when integrating both together. Though
giving you more time to think up
big data is rather powerful and successful
innovative ways of working out some
so far, it still presents some gaps and
problems that are completely new to you.
issues that require thorough addressing.
Massive growth in the scale of data
Security risks are a pretty common
generated through cloud computing has
problem to face today as are privacy issues
been observed. Addressing the big data
of various natures, which also have their
problem efficiently with high performance
own sets of challenges to deal with in
is a challenging task that requires large
terms of scaling and recovery mechanisms,
computational infrastructure to ensure
as well as problems relating to data
successful data analysis and processing.
heterogeneity, especially of different
types. Threats such as disaster
Introduction
recovery.Other concerns relate to cloud
computing as that is enormous amounts of
Big data is BIG! The type of big data you
have is directly related to the kinds of
devices and tools that are being used these
days, such as the IoT for example (which
monitors things like vast amounts of
internet-connected devices). Big data is
defined as any information that has been
gathered from a host of sources related to
digital technology. Data types can be
visual or audio in nature, such as images
and videos, or text-based, like emails and
social media.
Cloud computing refers to on-demand
computing resources that can be used to
easily and quickly access a variety of
useful computer services. This often refers
to remote servers, software, data storage
and any other functions that can be
delivered through the network in order for
users to access and experience the benefits
of cloud computing. By using common
resources and having them readily
available on demand, users are provided
with unlimited scalability from multiple
providers as opposed to only one source or
server which would naturally result in
limited capabilities and many limitations.
Data is growing in the cloud. It increases
rapidly due to the increased number of
Internet users around the world. With this
rapid growth, businesses wonder how to
provide reliable storage for their
customers' data and grow their cloud
storage infrastructure cost effectively.
They need a storage technology that can
handle this exponential increase in data
and yet stay affordable, reliable, high
capability and scalable.
Cloud computing and Big Data have
developed a strong relationship, one in
which cloud data storage supports the
processing power and storage capacity of
Big Data. Storing information demands an
extensive amount of time, resources, and
space. The cloud takes over where the
costs become too great to handle by an
individual user or other areas who need
access to complete-data backup-up
services.
In This paper we will discuss the
relationship between them, as well as
obstacles and challenges that these
relationships may encounter.
Big Data
Big data is a large amount of data that has
been collected from multiple sources no
matter big or small. This process takes
quite a bit of processing power and high
capabilities for information analysis. It is
crucial to call for the term big data during
this time because it connects directly to
how well companies have become more
analytical in nature as they have come to
understand the importance of big data in
generating an informed decision which can
then be used by those who are working in
these areas to provide better and faster
services to their clients.
Characteristics Of Big Data
The five different characteristics used to
describe big data are Volume, Variety,
Velocity, Value and Veracity.

Volume : It represents the amount of data
which represents the huge number of
numbers from multiple sources as a sum of
zeta bytes, which is the most evident
dimension in what concerns big data.
Variety : It is associated with big data,
one of the main characteristics of this
field. Because it has to deal with data from
various sources, big data frameworks
ought to be prepared for all types of
information - numbers, text, videos and
many more.
Velocity : It has been proven that data can
be retrieved from various sources at an
exponential rate. As more and more
sources, such as Twitter and Facebook for
example, release volumes of information
at an increased velocity, this means a
change in the strategy needed to analyze
data in a timely manner.
Value : Data is full of information which
helps us find the valuable information
from it. The value comes after processing,
modelling and visualization. The stage
also includes refining and cleaning up data
too.
Veracity : It refers to the quality of the
data and how accurate it is. Data’s
accuracy also determines how valuable it
is. Bad quality data can lead to inaccurate
analysis. Although there is wide agreement
on the potential value of big data,the data
it’s almost worthless if it isn't accurate.
Benefits of big data
Big data is helpful in making high choices
and taking purposeful action at the right
time. Hadoop as fast forward to it and
technologies as it gives you size and
flexibility to store data .Use a business
intelligence tool to measure your finances
that can give you a clear picture of where
your business stands.Organizations may
fine-tune their business strategy using
social data from search engines and sites
like Facebook and Twitter.Traditional
consumer feedback systems are being
phased out in favour of new Big Data-
based methods. Big Data and natural
language processing technologies are
being utilized to read and assess user
reactions in these new platforms.
Cloud Computing
It’s a term that refers to on-demand
computing resources that can be used to
easily and quickly access a variety of
useful computer services. This often refers
to remote servers, software, data storage
and any other functions that can be
delivered through the network in order for
users to access and experience the benefits
of cloud computing. By using common
resources and having them readily
available on demand, users are provided
with unlimited scalability from multiple
providers as opposed to only one source or
server which would naturally result in
limited capabilities and many limitations .
Cloud computing is a shared resource
system that can offer cost effective
opportunities for small businesses because
they could now run their whole business
without having to purchase tons of
hardware or take on massive debts!
Characteristics Of Cloud Computing
Cloud computing is one of the most
advanced models. NIST (The National
Institute for Standards and Technology)
has identified five important aspects of
cloud systems, a model that simplifies the
usage of cloud computer.
On demand Service : Cloud services are
easy, convenient, and less expensive than
having your own servers. Because they
take care of technical considerations for
you, cloud services make it easier to run
your business, so you can focus on the big
picture.
Broad Network Access : cloud computing
resources are accessible over the internet
through wireless devices and mobile
technology.
Resource Pooling : Cloud computing
users share a wide range of resources and,
as such, users can determine how they
want their resources and in which location
they prefer but cannot dictate the actual
physical location of their computing unit.
Rapid Elasticity : systems can be scaled
rapidly, to suit any and all needs. They can
be scaled up in size substantially by adding
extra hardware resources (e.g., storage
devices, processing units etc.) and/or
scaling down to run on less powerful or
smaller machines. And the process will
usually be handled by automation.
Measured service : Cloud systems track
resource use and Cloud systems also allow
for monitoring that's complete visibility
into the system as well as control over
what users are able to see—an important
aspect of both security and compliance.
Cloud computing models
There are three cloud computing models.
Infrastructure as a Service (IAAS): Cloud
service providers provide virtualized
computing resources on the Internet. In an
IaaS model, a third-party provider will
host hardware, software, and servers on
behalf of its user-- who only need to focus
on a specific aspect of their business to
grow upon.
Platform as a Service (PAAS) : Cloud
service providers offer platforms, tools and
other services to users. They manage,
including the operating system and
middleware with resources that enable you
to deliver everything from simple cloud-
based applications to sophisticated
enterprise grade solutions.
Software as a Service (SAAS) : Cloud
service providers provide a variety of
software to users who can use them
without installing the applications on their
computers. The user is not responsible for
anything other than adjusting the settings
and customizing the service as appropriate
to their needs. SAAS helps big data clients
to perform data analysis.
Big Data In Cloud
Storing and processing huge amounts of
data requires scalability and fault
tolerance. Cloud computing refers to using
the power of internet together with vast
networks of computers that are connected
all the time. The advancements in cloud
computing has enabled more powerful
hardware to handle the large datasets.
Cloud computing and big data are merging
together to help better serve people who
need to collect or store large amounts of
data. Rapid growth in big data is a
problem that needs solving because the
amounts of information being collected are
becoming too large for standard storage
systems to handle, not to mention
difficulties in getting it to integrate with
other interconnected databases effectively.
That's why cloud computing has evolved;
it allows users more ways of looking at
their information and serving as a means
by which information can be shared
between multiple disconnected locations,
making things such as backups easier. Big
data may be a problem but cloud
computing provides solutions!
Big Data Challenges
Big Data in cloud computing helps us
solve some of today's biggest problems
with large amounts of data. But it is a
continually evolving field and still has
many limitations. In this part, we will
discuss some difficulties which need to
overcome.
As more data transfers to the cloud,
security and privacy are two major things
that need to be considered. Other topics
that arise include data recovery, data
uploading to the cloud, and Exaflop
computing.
Security
Cloud computing and big data security are
both major concerns for businesses. Before
a business plans on storing confidential
data in the cloud, they must answer many
questions such as who owns that data,
where it is stored, who has access to it and
what type of rights they have permission to
change it.
a) Who is the real owner of the data ?
A client may pay for a cloud
service, but does the data belong to
them? How much access does their
provider have to information and
for what reasons may it use it? Is
the data useful to the cloud service
provider?
b)Where is the data?
Data is permission to share with
other countries. when some time
data to help to anywhere to access
but sometimes not allow to another
country so many software and
company policies register to data
allow to another way.
Privacy
Data privacy is the most important part of
the cloud with every company wanting to
be fully in control of what kind of
information they should have access to.
Big Data security and protecting privacy
have become extremely difficult as more
online services offer users online transfer
data systems for analytics, cloud storage
etc. In fact, hackers can now easily attach
themselves to emails and send login details
to people whom they wish to provide
unauthorized access towards captured
sensitive data from various companies.
Traditionally organizations have relied on
using various methods like firewalls,
certain passwords or even structures within
their own business networks to protect the
privacy rights of their customers.
Data Governance
The data organization allows some steps to
follow from storage to privacy. In some
organizations without following, policies
follow to work in storage data.
Data governance also plays a role in
regulatory control of compliance and
better-improved data quality and
management tools. They want better result
making and better business outcomes for
the benefit of people.
Improving data security. One of the data
governance is secure data and to any other
untheorized misused.
Ensuring data is used properly. They help
many users create data to privacy but some
years organization errors show to miss the
data then claim to make data to not share
any clue of the data. The data are limited
to save and no other misused and all are
followed to policies.
Disaster Recovery
Data could be a terribly valuable business
and losing information will definitely lead
to losing price. just in case of emergency
or unsafe accidents like earthquakes,
floods, and fires, information losses got to
be nominal. to meet this demand, just in
case of any incident, information should be
quickly accessible with nominal period
and loss. However, though this is often a
really vital issue because the loss of
information can probably lead to the loss
of cash, it's vital to be able to respond
expeditiously to unsafe incidents. with
success deploying huge information
DBMSs within the cloud and keeping it
invariably accessible and fault-tolerant
might powerfully rely upon disaster
recovery mechanisms.
Other Challenges
Within this section we discuss data
transference onto the cloud, Exaflop
computing, and scalability and elasticity
issues in cloud computing and big data
a) Transferring information onto a cloud
may be a terribly slow method and firms
usually like better to physically send
arduous drives to the data centers so data
will be uploaded. However, this is often
neither the foremost sensible nor the safest
resolution to transfer information onto the
cloud. Through the years there has been a
shot to enhance and make economical
information transferring algorithms to
reduce upload times and supply a secure
way to transferring data onto the cloud,
however, this method still remains a
serious bottleneck.
b) Scaling in the cloud and with big data
systems (sometimes called elasticity) is
still new technology. Today, there are only
rudimentary ways of scaling when your
cloud-based systems are involved because
of high load times, inconsistent load
distribution and other related difficulties.
Most systems don't have very good
automated methods for detecting a
problem before it gets out of control and
many algorithms that are used today are
reactive or proactive meaning they either
monitor the problem or work to prevent it.
Unfortunately, in most cases it's after an
overload has already occurred that they
begin working on the issue so their
reaction time can be too slow to help
businesses keep up with high performance
demands.
c) Exaflop computing is one of today’s
problems. Supercomputers and clouds deal
with petabyte data sets, though they may
not be able to handle exabytes since high
performance and high bandwidth are
required to transfer and process such huge
volumes of data over the network. Some
believe cloud computing is not ideal
because it is slower than supercomputers
in some cases, since it's restrained by
existing bandwidth and latency.
Solutions of these Challenge
In terms of current problems, following
are some probable advancements in the
coming years:
● Data encryption can help with
security and privacy. A new
generation of systems, on the other
hand, must ensure that data is
accessible fast and that encryption
does not significantly slow down
processing times.
● Data standardisation can be used to
address the diversity of Big Data.
● New and safe data uploading
techniques based on QoS (quality
of service) may be the answer to
making data uploading to the cloud
easier.
● Scalability and elasticity
approaches exist, and numerous
Big Data suppliers, such as
Amazon and Microsoft, employ
them extensively. The main focus
is the development of completely
automatic reactive and proactive
systems capable of automatically
responding with load needs.
● Exaflop computing is one of the
grand challenges that require
copious amounts of research and
funding from certain governments
around the globe. To date, the best
expedient computer solutions use
HPCs and GPUs;
Conclusion
With the amount of data being generated
on a daily basis, big data technologies,
particularly analytic tools, have emerged
as a key source of innovation, allowing
users to store, analyse, and retrieve
information from petabyte datasets. Big
data systems benefit greatly from cloud
settings, which provide fault-tolerant,
scalable, and available environments.
Despite the fact that big data systems are
strong tools that allow businesses and
scientists to gain insights from data, there
are certain challenges that need to be
investigated more. It will take more time
and effort to implement security
procedures and standardise data formats.
Another important aspect of Big Data is
scalability, which is usually manual in
commercial solutions rather than
automatic.
To address this issue, more study is
required. In this case, we want to leverage
adaptive techniques to create a solution for
providing elasticity across several
dimensions of big data systems running in
cloud settings. The purpose is to look at
the techniques that adaptable software can
employ to activate scalability at various
levels
REFERENCES
[1] Majhi, S.K. & Shial, G., 2015.
Challenges in big data cloud Computing
And Future Research Prospects: A
Review. The Smart Computing Review.
[2] Zhang, L. et al., 2013. Moving big data
to the cloud. INFOCOM, 2013
Proceedings IEEE
[3] Subashini, S. & Kavitha, V., 2011. A
survey on security issues in service
delivery models of cloud computing.
Journal of Network and Computer
Applications
[4] Tallon, P.P., 2013. Corporate
governance of big data: perspectives on
value, risk, and cost
[5] Tene, O. & Polonetsky, J., 2012.
Privacy in the Age of big data.
[6] Popović , K. & Hocenski, Z., 2015.
cloud computing security issues and
challenges.
[6] Wood, T. et al., 2010. Disaster
recovery as a cloud service: Economic
benefits & deployment challenges.
[7] L. Chang, R. Ranjan, Z. Xuyun, Y.
Chi, D. Georgakopoulos, C. Jinjun, Public
Auditing for Big Data Storage in Cloud
Computing – a Survey, Computational
Science and Engineering (CSE), 2013
IEEE 16th International Conference on,
2013, pp. 1128–1135
[8]http://www.kciti.edu/wp-content/
uploads/2017/07/dbms_tutorial.pdf, 2015
by Tutorials Point.
[9] Zomaya, A. Y., & Sakr, S. (2017).
Handbook of Big Data Technologies.
Springer.
[10]http://searchcio.techtarget.com/
definition/big-data-as-a-service-bdaas,
[11]https://www.maximizer.com/blog/
entering-the-age-of-big-data-as-a-service/
[12]https://en.wikipedia.org/wiki/
Cloud_computing

[13] Fonseca, N., & Boutaba, R. (2015).

Cloud services, networking, and
management. John Wiley & Sons.

14] McAfee, Andrew, and Erik

Brynjolfsson. "Big data: the management
revolution." Harvard business review
90.10 (2012): 60-68.