Title: Data Mining
wavered. Data analytics has
Summarize: this paper
aims to give a general vision on
data mining and non-SQL
databases
Historical
The term "data mining" first
appeared in the early 1960s and
had a pejorative meaning at that
time. Computers were used more
and more for all kinds of
calculations that could not be
done manually until then. Some
researchers have started to
process data tables relating to
surveys or experiments at their
disposal without a statistical a
priori. As they observed that the
results obtained, far from being
aberrant, were encouraging, they
were encouraged to systematize
this opportunistic approach.
However, official statisticians
considered this approach to be
unscientific and used the terms
"data mining" or "data fishing" to
criticize them. This opportunistic
attitude towards data coincided
in France with the dissemination
to the general public of data
analysis, the promoters of which,
like Jean-Paul Benzecri, also had
to undergo in the early days of
criticism from members of the
community of statisticians. .
Despite everything, the success of
this empirical approach has not
grown and its interest has grown
along with the size of databases.
Towards the end of the 1980s,
database researchers, such as
Rakesh Agrawal, began to work
on the exploitation of the content
of large databases such as those
of receipts from supermarkets,
convinced that they could add
value to these masses of dormant
data. They used the expression
"database mining" but, since it
was already filed by a company
(Database mining workstation), it
was "data mining" that prevailed.
In March 1989, Shapiro Piatetski
proposed the term "knowledge
discovery" at a workshop on
knowledge discovery in
databases. Currently, the terms
data mining and knowledge
discovery in data bases (KDD, or
ECD in French) are used more or
less interchangeably. We will
therefore use the expression
"data mining", the latter being
the most frequently used in the
literature. The data mining
community initiated its first
conference in 1995 following
numerous workshops on the KDD
between 1989 and 1994. In 1998,
a special chapter was created
under the auspices of the ACM,
called ACMSIGKDD, which brings
together the international KDD
community. The first journal in
the field "Data mining and
knowledge discovery journal"
published by "Kluwers" was
launched in 1997.
RELATED WORKS
Both Data mining and cloud
computing have received
significant interest in recent
years. Many works are presented
trying to improve data mining
techniques using the abilities of
cloud computing. In 2008
Christopher et al., [4] started the
first steps in this field. They tried
to scale up the classifiers for
Cloud Computing
computers/machines by making a
comparison amongst the three
classification techniques (decision
trees, knearest neighbors and
support vector machines) and to
evaluate their performance with
distributed data. They worked
with six different data sets
(Protein, KDDCup, Alpha, Beta,
Syn-SM, and Syn-LG). On the
other hand our work extends and
converges with their research by
using decision trees techniques
and proposing an
implementation of an abstraction
classification method; whilst our
work diverges from theirs by
using alternative classification
techniques and different datasets.
In 2009 Yuzhanget al., [5]
improved the decision tree
construction (SPRINT algorithm)
with service-oriented architecture
based on the principles of Cloud
Computing by using Distributed
Computational Service Cloud
(DCSC). They provided a SPRINT
model to handle the user-defined
dataset. Our work goes further by
building a cloud computing
model which distributes cross-
validation tasks and we use
different datasets.
In 2010 Jianzong Wang, et al., [6]
worked with Data Mining of Mass
Storage based on Cloud
Computing by implementing a
combination model between
three techniques (Global Effect,
K-NN and Restricted Boltzmann
Machines ) for Netflix Prize
dataset mining, They observed
that Global Effect and K-NN
worked very well but RBM did
not perform well. We are similar
to their work with regards to data
mining based on cloud
computing but we are different
by implementing a new model
for classification of tasks. In 2011
Gopalakrishnan and K. Lakshmi
[7] proposed a new Hierarchical
Virtual K-Means Approach
(HVKM) with two models of cloud
computing system PaaS and SaaS
for the user who desired to
provide Business Analysis as a
Service. They used the Sample
insurance data to test their
approach. We converges with
their work on implementing the
tow model of cloud computing
system for data mining purposes
but we differ from it by
developing a model for
classification and prediction
rather than simple clustering.
In 2012 Tong et al., [8] they built
a web application for their data
mining analysis in the forecasting
service based on cloud
computing. They called it
Forecasting as a Service (FaaS),
which provides forecasting
services for users. They evaluated
the performance of six data
mining techniques (Logistic
Regression, Time Series, ANN,
Random Forest, SVM, MARS) on
the SaaS model based on using
R, PHP and MySQL tools to
analyze the manufacturing data
of the industrial index
information forecasting in
Taiwan. From a technical point of
view, our work is similar with
theirs on building a model for
prediction which uses multiple
prediction techniques but we are
differ from them by using health
care datasets for medical
diagnosis purposes as opposed
to an industrial index dataset.
In 2012 N. R. Sheth and J. S. Shah
[9] implemented one of the most
popular Association Rule
algorithms called Apriori which
improved on MapReduce
programming model to work on
the Hadoop platform. They built
an interface between Hadoop
and the Sector file System
(Sector/Sphere Cloud system)
which give all Hadoop application
the ability to work on Sector data
and they observed a decline in
performance in the Sector file
system due to I/O and JNI
overhead. We converge with their
work on the data mining side of
cloud computing while our work
differs from theirs by using
prediction techniques rather than
yet Association Rule algorithms.
In 2012 Juan and Pallavi [10]
developed a sequential
association rule algorithm
(Apriori) by redesigning it from
the original concept and applied
it to work on MapReduce on the
Amazon EC2 cloud model which
provided a parallel computing
platform. They used four different
datasets (chess,
mushroom, connect and
T10I4D100K)..
[…]
In 2012 Nandini and Saurabh [13]
proposed high performance
cloud data mining algorithm by
improving the Apriori algorithm
using Genetic algorithm
approach to work on
sector/sphere cloud framework,
and they used multi transaction
datasets to validate their model.
Our approach is similar to theirs
by developing the cloud model
for data mining but we differ
from it by using alternative
datasets in order to test
classification techniques in
multiple computing
environments.
In 2013 Kawuu and Yu-Chin [14]
presented four efficient
algorithms (Association rule
Equal Working Set (EWS),
Request On Demand (ROD),
Small Size Working Set (SSWS)
and Progressive Size Working Set
(PSWS)) to utilize cloud nodes in
cloud computing environment
with IBM’s Quest synthetic data
generator. They observed that
the four algorithms are more
scalable than TPFP-tree and BTP-
tree schemes. PSWS required
only 12.2% and 18% of the
execution time used respectively
by TPFP-tree and BTP-tree. Our
work is similar to theirs by
utilizing the resources of the
cloud nodes to distribute the
computation of the data mining
tasks but our model is better
developed for classification and
prediction tasks rather than just
the Association rule.
Spark and Hadoop
What is Apache Hadoop?
Apache Hadoop is an open-
source software utility that allows
users to manage big data sets
(from gigabytes to petabytes) by
enabling a network of computers
(or “nodes”) to solve vast and
intricate data problems. It is a
highly scalable, cost-effective
solution that stores and
processes structured, semi-
structured and unstructured
data (e.g., Internet clickstream
records, web server logs, IoT
sensor data, etc.).
Benefits of the Hadoop
framework include the following:
 Data protection amid a
hardware failure
 Vast scalability from a single
server to thousands of
machines
 Real-time analytics for historical
analyses and decision-making
processes
What is Apache Spark?
Apache Spark — which is also
open source — is a data
processing engine for big data
sets. Like Hadoop, Spark splits
up large tasks across different
nodes. However, it tends to
perform faster than Hadoop and
it uses random access memory
(RAM) to cache and process data
instead of a file system. This
enables Spark to handle use
cases that Hadoop cannot.
Benefits of the Spark framework
include the following:
 A unified engine that supports
SQL queries, streaming
data, machine learning (ML) and
graph processing
 Can be 100x faster than
Hadoop for smaller
workloads via in-memory
processing, disk data storage,
etc.
 APIs designed for ease of use
when manipulating semi-
structured data and
transforming data
The Hadoop ecosystem
Hadoop supports advanced
analytics for stored data (e.g.,
predictive analysis, data mining,
machine learning (ML), etc.). It
enables big data analytics
processing tasks to be split into
smaller tasks. The small tasks
are performed in parallel by using
an algorithm (e.g., MapReduce),
and are then distributed across a
Hadoop cluster (i.e., nodes that
perform parallel computations on
big data sets).
The Hadoop ecosystem consists
of four primary modules:
1. Hadoop Distributed File
System (HDFS): Primary data
storage system that manages
large data sets running on
commodity hardware. It also
provides high-throughput data
access and high fault tolerance.
2. Yet Another Resource
Negotiator (YARN): Cluster
resource manager that
schedules tasks and allocates
resources (e.g., CPU and
memory) to applications.
3. Hadoop MapReduce: Splits big
data processing tasks into
smaller ones, distributes the
small tasks across different
nodes, then runs each task.
4. Hadoop Common (Hadoop
Core): Set of common libraries
and utilities that the other three
modules depend on.
The Spark ecosystem
Apache Spark, the largest open-
source project in data
processing, is the only
processing framework that
combines data and artificial
intelligence (AI). This enables
users to perform large-scale data
transformations and analyses,
and then run state-of-the-art
machine learning (ML) and AI
algorithms.
The Spark ecosystem consists of
five primary modules:
1. Spark Core: Underlying
execution engine that schedules
and dispatches tasks and
coordinates input and output
(I/O) operations.
2. Spark SQL: Gathers
information about structured
data to enable users to optimize
structured data processing.
3. Spark Streaming and
Structured Streaming: Both
add stream processing
capabilities. Spark Streaming
takes data from different
streaming sources and divides it
into micro-batches for a
continuous stream. Structured
Streaming, built on Spark SQL,
 reduces latency and simplifies
programming.
4. Machine Learning Library
(MLlib): A set of machine
learning algorithms for
scalability plus tools for feature
selection and building ML
pipelines. The primary API for
MLlib is DataFrames, which
provides uniformity across
different programming
languages like Java, Scala
and Python.
5. GraphX: User-friendly
computation engine that
enables interactive building,
modification and analysis of
scalable, graph-structured data.
Comparing Hadoop and Spark
Spark is a Hadoop enhancement
to MapReduce. The primary
difference between Spark and
MapReduce is that Spark
processes and retains data in
memory for subsequent steps,
whereas MapReduce processes
data on disk. As a result, for
smaller workloads, Spark’s data
processing speeds are up to
100x faster than MapReduce.
Furthermore, as opposed to the
two-stage execution process in
MapReduce, Spark creates a
Directed Acyclic Graph (DAG) to
schedule tasks and the
orchestration of nodes across the
Hadoop cluster. This task-
tracking process enables fault
tolerance, which reapplies
recorded operations to data from
a previous state.
Let’s take a closer look at the key
differences between Hadoop and
Spark in six critical contexts:
1. Performance: Spark is faster
because it uses random access
memory (RAM) instead of
reading and writing intermediate
data to disks. Hadoop stores
data on multiple sources and
processes it in batches via
MapReduce.
2. Cost: Hadoop runs at a lower
cost since it relies on any disk
storage type for data
processing. Spark runs at a
higher cost because it relies on
in-memory computations for
real-time data processing, which
requires it to use high quantities
of RAM to spin up nodes.
3. Processing: Though both
platforms process data in a
distributed environment,
Hadoop is ideal for batch
processing and linear data
processing. Spark is ideal for
real-time processing and
processing live unstructured
data streams.
4. Scalability: When data volume
rapidly grows, Hadoop quickly
scales to accommodate the
demand via Hadoop Distributed
File System (HDFS). In turn,
Spark relies on the fault tolerant
HDFS for large volumes of data.
5. Security: Spark enhances
security with authentication via
shared secret or event logging,
whereas Hadoop uses multiple
authentication and access
control methods. Though,
overall, Hadoop is more secure,
Spark can integrate with
Hadoop to reach a higher
security level.
6. Machine learning (ML): Spark
is the superior platform in this
category because it includes
MLlib, which performs iterative
in-memory ML computations. It
also includes tools that perform
regression, classification,
 persistence, pipeline
construction, evaluation, etc.
Discusion
Data mining has many enormous
advantages, as explained below:
1. Marketing/Retails
To create models, marketing
companies use data mining. This
was based on history to forecast
who will respond to new
marketing campaigns such as
direct mail, online marketing, etc.
This means that marketers can
sell profitable products to
targeted customers.
2. Finance/Banking
Since data extraction provides
financial institutions
information on loans and credit
reports, data can determine good
or bad credits by creating a
model for historical customers. It
also helps banks detect
fraudulent transactions by credit
cards that protect a credit card
owner.
3. Researchers
Data mining can motivate
researchers to accelerate when
the method analysis the data.
Therefore they can work more
time on other projects. Shopping
behaviours can be detected. Most
of the time, you may experience
new problems while designing
specific shopping patterns.
Therefore data mining is used to
solve these problems. Mining
methods can find all the
information on these shopping
patterns. This process also
creates an area where all the
unexpected shopping patterns
are calculated. This data
extraction can be beneficial when
shopping patterns are identified.
4. Determining Customer
Groups
We are using data mining to
respond from marketing
campaigns to customers. It also
provides information during the
identification of customer groups.
Some surveys can be used to
begin these new customer
groups. And these investigations
are one of the forms of data
mining.
5. Increases Brand Loyalty
In marketing campaigns, mining
techniques are used. This is to
understand their own customers ‘
needs and habits. And from that,
customers can also choose their
brand’s clothes. Thus, you can
definitely be self-reliant with the
help of this technique. However,
it provides possible information
when it comes to decisions.
6. Helps in Decision Making
People use these data mining
techniques to help them make
some decisions in marketing or
business. Today, with the use of
this technology, all information
can be determined. Also, using
such technology, one can decide
precisely what is unknown and
unexpected.
7. Increase Company Revenue
Data mining is a process in which
some kind of technology is
involved. One must collect
information on goods sold
online; this eventually reduces
product costs and services, which
is one of data mining benefits.
8. To Predict Future Trends
All information factors are part of
the working nature of the system.
The data mining systems can also
be obtained from these. They can
help you predict future trends,
and with the help of this
technology, this is entirely
possible. And people also adopt
behavioural changes.
9. Increases Website
Optimization
We use data mining to find all
kinds of unseen element
information. And adding data
mining helps you to optimize
your website. Similarly, this data
mining provides information that
may use the technology of data
mining.
Conclusion
Data mining has so many
advantages in the area of
businesses, governments as well
as individuals. In this article, we [10] J. Li, P. Roy, S. Khan, L. Wang
and Y. Bai, (2012). "Data Mining
have seen places where we can Using Clouds: An Experimental
efficiently use data mining. Implementation of Apriori over
MapReduce", 12th International
Conference on Scalable Computing
References and Communications (ScalCom),
http://eric.univ- Changzhou, China, December.
lyon2.fr/~ricco/cours/slides/IntroDM [13] N. Mishra, S. Sharma and A.
Draft2002.pdf Pandey, (, 2013). "High performance
[5] Y.Han, P. Brezany and I. Janciak, Cloud data mining algorithm and Data
(2009). "Cloud-Enabled Scalable mining in Clouds", IOSR
Decision Tree Construction", Fifth Journal of Computer Engineering
International Conference on (IOSRJCE) Volume 8, Issue 4.
Semantics, Knowledge and Grid", [14] K. W. Lin and Yu-Chin Lo,
ISBN: 978-0-7695-3810-5, pp.128– (2013). "Efficient algorithms for
135. frequent
[6] J. Wang, J. Wan, Z. Liu and pattern mining in many-task computing
P.Wang,(2010). "Data Mining of Mass environments", Journal of
Storage based on Cloud Computing", Knowledge-Based Systems.
Ninth International Conference
on Grid and Cloud Computing. ISBN:
978-1-4244-9334-0 , pp. 426–
431.
[7] T. G. Nair and K. L. Madhuri,
(2011). "Data Mining using
Hierarchical
Virtual K-means Approach Integrating
Data Fragments in Cloud
Computing Environment" , IEEE CCIS,
ISBN: 978-1-61284-203-5, pp.
230–234.
[8] T. Yang, B. Shia, J. Wei and K.
Fang, (2012). "Mass Data Analysis and
Forecasting Based on Cloud
Computing", Journal of Software, vol.
7,
no. 10, October.
[9] N.i R. Sheth and J. S. Shah, (2012).
"Implementing Parallel Data
Mining Algorithm on High
Performance Data Cloud ",
International
Journal of Advanced Research in
Computer Science and Electronics
Engineering Volume 1.