ML,DL,DS

• Introduction to basic Concept of Machine Learning(ML)

• Machine learning is a growing technology which enables computers to learn automatically from
past data.
• Machine learning uses various algorithms for building mathematical models and making
predictions using historical data or information.
• Currently, it is being used for various tasks such as image recognition, speech recognition,
email filtering, Facebook auto-tagging, recommender system, and many more.
• What is Machine Learning
• In the real world, we are surrounded by humans who can learn everything from their
experiences with their learning capability, and we have computers or machines which work on
our instructions.
• But can a machine also learn from experiences or past data like a human does? So here comes
the role of Machine Learning.
• Machine Learning is said as a subset of artificial intelligence that is mainly concerned with the
on their own.
• The term machine learning was first introduced by Arthur Samuel in 1959. We can define it in a
summarized way as:
• With the help of sample historical data, which is known as training data, machine learning
algorithms build a mathematical model that helps in making predictions or decisions without
being explicitly programmed.
• Machine learning brings computer science and statistics together for creating predictive
models.
• Machine learning constructs or uses the algorithms that learn from historical data.
• The more we will provide the information, the higher will be the performance.
• A machine has the ability to learn if it can improve its performance by gaining more data.
• How does Machine Learning work
• A Machine Learning system learns from historical data, builds the prediction models, and
whenever it receives new data, predicts the output for it.
• The accuracy of predicted output depends upon the amount of data, as the huge amount of data
helps to build a better model which predicts the output more accurately.
• Suppose we have a complex problem, where we need to perform some predictions, so instead of
writing a code for it, we just need to feed the data to generic algorithms, and with the help of
these algorithms, machine builds the logic as per the data and predict the output.
• Machine learning has changed our way of thinking about the problem.
• The below block diagram explains the working of Machine Learning algorithm:

• Features of Machine Learning:

• Machine learning uses data to detect various patterns in a given dataset.
• It can learn from past data and improve automatically.
• It is a data-driven technology.
• Machine learning is much similar to data mining as it also deals with the huge amount of the
data.
• Need for Machine Learning
• The reason behind the need for machine learning is that it is capable of doing tasks that are too
complex for a person to implement directly.
• As a human, we have some limitations as we cannot access the huge amount of data manually,
so for this, we need some computer systems and here comes the machine learning to make
things easy for us.
• We can train machine learning algorithms by providing them the huge amount of data and let
them explore the data, construct the models, and predict the required output automatically.
• The performance of the machine learning algorithm depends on the amount of data, and it can
be determined by the cost function.
• With the help of machine learning, we can save both time and money.
• Machine learning is used in self-driving cars, cyber fraud detection, face recognition, and friend
suggestion by Facebook, etc.
• Various top companies such as Netflix and Amazon have build machine learning models that
are using a vast amount of data
• Following are some key points which show the importance of Machine Learning:
• Rapid increment in the production of data
• Solving complex problems, which are difficult for a human
• Decision making in various sector including finance
• Finding hidden patterns and extracting useful information from data.
• Classification of Machine Learning
• At a broad level, machine learning can be classified into three types:
1. Supervised learning
2. Unsupervised learning
3. Reinforcement learning
1) Supervised Learning
• We provide sample labeled data to the machine learning system in order to train it, and on that
basis, it predicts the output.
• The system creates a model using labeled data to understand the datasets and learn about each
data, once the training and processing are done then we test the model by providing a sample
data to check whether it is predicting the exact output or not.
• The goal of supervised learning is to map input data with the output data.
• The supervised learning is based on supervision, and it is the same as when a student learns things in
the supervision of the teacher.
• The example of supervised learning is spam filtering.
• Supervised learning can be grouped further in two categories of algorithms:
• Classification
• Regression
2) Unsupervised Learning
• Unsupervised learning is a learning method in which a machine learns without any supervision.
• The training is provided to the machine with the set of data that has not been labeled, classified, or
categorized, and the algorithm needs to act on that data without any supervision.
• The goal of unsupervised learning is to restructure the input data into new features or a group of
objects with similar patterns.
• In unsupervised learning, we don't have a predetermined result. The machine tries to find useful
insights from the huge amount of data. It can be further classifieds into two categories of algorithms:
• Clustering
• Association
3) Reinforcement Learning
• Reinforcement learning is a feedback-based learning method, in which a learning agent gets a
reward for each right action and gets a penalty for each wrong action.
• The agent learns automatically with these feedbacks and improves its performance.
• In reinforcement learning, the agent interacts with the environment and explores it.
• The goal of an agent is to get the most reward points, and hence, it improves its performance.
• The robotic dog, which automatically learns the movement of his arms, is an example of
Reinforcement learning.
• Machine Learning at present:
• It is present everywhere around us, such as self-driving cars, Amazon Alexa, Catboats,
recommender system, and many more.
• It includes Supervised, unsupervised, and reinforcement learning with clustering, classification,
decision tree, SVM algorithms, etc.
• Modern machine learning models can be used for making various predictions, including
weather prediction, disease prediction, stock market analysis, etc.
• Deep Learning
• Deep learning is based on the branch of machine learning, which is a subset of artificial
intelligence.
• Since neural networks imitate the human brain and so deep learning will do.
• it is a machine learning class that makes use of numerous nonlinear processing units so as to
perform feature extraction as well as transformation.
• The output from each preceding layer is taken as input by each one of the successive layers.
• Deep learning algorithms are used, especially when we have a huge no of inputs and outputs.
• Deep learning has been evolved by the machine learning, which itself is a subset of artificial
intelligence and as the idea behind the artificial intelligence is to mimic the human behavior, so
same is "the idea of deep learning to build such algorithm that can mimic the brain".
• Deep learning is implemented with the help of Neural Networks, and the idea behind the
motivation of Neural Network is the biological neurons, which is nothing but a brain cell.
• “Deep learning is a collection of statistical techniques of machine learning for learning feature
hierarchies that are actually based on artificial neural networks”.
• Example of Deep Learning

• In the example given above, we provide the raw data of images to the first layer of the input
layer.
• After then, these input layer will determine the patterns of local contrast that means it will
differentiate on the basis of colors, luminosity, etc.
• Then the 1st hidden layer will determine the face feature, i.e., it will fixate on eyes, nose, and
lips, etc.
• And then, it will fixate those face features on the correct face template.
• So, in the 2nd hidden layer, it will actually determine the correct face here as it can be seen in the
above image, after which it will be sent to the output layer.
• Likewise, more hidden layers can be added to solve more complex problems, for example, if you
want to find out a particular kind of face having large or light complexions.
• So, as and when the hidden layers increase, we are able to solve complex problems.
• Types of Deep Learning Networks
1. Feed Forward Neural Network
• All the perceptrons are organized within layers, such that the input layer takes the input, and the
output layer generates the output.
• Since the hidden layers do not link with the outside world, it is named as hidden layers.
• Each of the perceptrons contained in one single layer is associated with each node in the subsequent
layer.
• It can be concluded that all of the nodes are fully connected. It does not contain any visible or
invisible connection between the nodes in the same layer.
• There are no back-loops in the feed-forward network.
• To minimize the prediction error, the backpropagation algorithm can be used to update the weight
• Applications:
• Data Compression
• Pattern Recognition
• Computer Vision
• Sonar Target Recognition
• Speech Recognition
• Handwritten Characters Recognition
2. Recurrent Neural Network
• Recurrent neural networks are yet another variation of feed-forward networks.
• Here each of the neurons present in the hidden layers receives an input with a specific delay in
time.
• The Recurrent neural network mainly accesses the preceding info of existing iterations.
• For example, to guess the succeeding word in any sentence, one must have knowledge about
the words that were previously used.
• It not only processes the inputs but also shares the length as well as weights crossways time.
• However, the only problem with this recurrent neural network is that it has slow computational
speed as well as it does not contemplate any future input for the current state.
• It has a problem with reminiscing prior information.
• Applications:
• Machine Translation
• Robot Control
• Time Series Prediction
• Speech Recognition
• Speech Synthesis
• Time Series Anomaly Detection
• Rhythm Learning
• Music Composition
3. Convolutional Neural Network
• Convolutional Neural Networks are a special kind of neural network mainly used for image
classification, clustering of images and object recognition.
• To achieve the best accuracy, deep convolutional neural networks are preferred more than any
other neural network.
• Applications:
• Identify Faces, Street Signs, Tumors.
• Image Recognition.
• Video Analysis.
• NLP.
• Anomaly Detection.
• Drug Discovery.
• Checkers Game.
• Time Series Forecasting.
• Data Science
• Data science is a deep study of the massive amount of data, which involves extracting
meaningful insights from raw, structured, and unstructured data that is processed using the
scientific method, different technologies, and algorithms.
• It is a multidisciplinary field that uses tools and techniques to manipulate the data so that you
can find something new and meaningful.
• Data science uses the most powerful hardware, programming systems, and most efficient
algorithms to solve the data related problems. It is the future of artificial intelligence.
• In short, we can say that data science is all about:
• Asking the correct questions and analyzing the raw data.
• Modeling the data using various complex and efficient algorithms.
• Visualizing the data to get a better perspective.
• Understanding the data to make better decisions and finding the final result.
• Example:
• Let suppose we want to travel from station A to station B by car.
• Now, we need to take some decisions such as which route will be the best route to reach faster
the location, in which route there will be no traffic jam, and which will be cost-effective.
• All these decision factors will act as input data, and we will get an appropriate answer from
these decisions, so this analysis of data is called the data analysis, which is a part of data
science.
• Need for Data Science:
• Every Company requires data to work, grow, and improve their businesses.
• Now, handling of such huge amount of data is a challenging task for every organization.
• So to handle, process, and analysis of this, we required some complex, powerful, and efficient
algorithms and technology, and that technology came into existence as data Science.
• Following are some main reasons for using data science technology:
• With the help of data science technology, we can convert the massive amount of raw and
unstructured data into meaningful insights.
• Data science technology is opting by various companies, whether it is a big brand or a startup.
Google, Amazon, Netflix, etc, which handle the huge amount of data, are using data science
algorithms for better customer experience.
• Data science is working for automating transportation such as creating a self-driving car, which
is the future of transportation.
• Data science can help in different predictions such as various survey, elections, flight ticket
confirmation, etc.
• Data Science Components:

1. Statistics: Statistics is a way to collect and analyze the numerical data in a large amount and finding
meaningful insights from it.
2. Domain Expertise: In data science, domain expertise binds data science together. Domain expertise
means specialized knowledge or skills of a particular area.
3. Data engineering: It involves acquiring, storing, retrieving, and transforming the data. Data
engineering also includes metadata (data about data) to the data.
4. Visualization: Data visualization is meant by representing data in a visual context so that
people can easily understand the significance of data.
• Data visualization makes it easy to access the huge amount of data in visuals.
5. Advanced computing: Heavy lifting of data science is advanced computing. It involves
designing, writing, debugging, and maintaining the source code of computer programs.
6. Mathematics: Mathematics involves the study of quantity, structure, space, and changes. For
a data scientist, knowledge of good mathematics is essential.
7. Machine learning: Machine learning is backbone of data science.
• Machine learning is all about to provide training to a machine so that it can act as a human
brain.
• In data science, we use various machine learning algorithms to solve the problems.
• Comparing Data Science (DS), Machine Learning (ML), Deep Learning (DL) and
Artificial Intelligence (AI)
• AI ML DL are not part or subset of DS, although, certain tasks involved in DS intersect with AI,
ML and DL.
• DS is a data-driven technique and each of DS, ML and DL have processes that relate to data or
big data, contextually.

• DS, ML, DL and AI need loads of data to begin with.

• Each of these processes the data in their own context and techniques and provide an outcome,
which is then examined on human interests.
• A point to note is, DS, ML, DL and AI are iterative techniques that is, if the actual outcome has
large variance with the expected result, the respective processes are repeated.

• The processes contain the similarities between DS, ML, DL and AI. Linkage above two figures,
following inferences can be made
• Point of reference: DS
• DS intersects with ML on the grounds of cleaning and modelling the data
• The cleaning and munging steps of DS help is feature extraction and grouping of information in
DL
• The interference and decision making phases are advanced version of describing and modelling
steps of DS
• Point of reference: ML
• Cleansing and preparing data in ML is the precursor step of extracting features in DL; also, the
evaluation provided in ML acts as a prototype for evaluating the performance of neural network
in DL
• Simply put, AI is applied based on ML or ML can be called as subset of AI.
• Point of reference: DL
• The evaluation and self-improving stages of DL assists in developing superior AI models.