Unit – 4

Machine Learning : Supervised and unsupervised learning, Decision trees, Statistical learning models, Learning with
complete data - Naive Bayes models, Learning with hidden data – EM algorithm, Reinforcement learning,

What is Machine Learning?

Machine learning (ML) is a subdomain of artificial intelligence (AI) that focuses on developing systems that learn—or
improve performance—based on the data they ingest. Artificial intelligence is a broad word that refers to systems or machines
that resemble human intelligence. Machine learning and AI are frequently discussed together, and the terms are occasionally
used interchangeably, although they do not signify the same thing. A crucial distinction is that, while all machine learning is
AI, not all AI is machine learning.

Definition 2 : Most Imp**

Machine Learning is the field of study that gives computers the capability to learn without being explicitly programmed. ML
is one of the most exciting technologies that one would have ever come across. As it is evident from the name, it gives the
computer that makes it more similar to humans: The ability to learn. Machine learning is actively being used today, perhaps in
many more places than one would expect.

** Definition 3 :

Machine learning is an umbrella term for a set of techniques and tools that help computers learn and adapt on their
own. Machine learning algorithms help AI learn without being explicitly programmed to perform the desired action. By
learning a pattern from sample inputs, the machine learning algorithm predicts and performs tasks solely based on the
learned pattern and not a predefined program instruction. Machine learning is a life savior in several cases where applying
strict algorithms is not possible. It will learn the new process from previous patterns and execute the knowledge.

Key characteristics of machine learning

In order to understand the actual power of machine learning, you have to consider the characteristics of this technology.
There are lots of examples that echo the characteristics of machine learning in today’s data rich world :

5 key features of machine learning

Machine learning has become one of the most important technological advancements in recent years and has significantly
impacted a broad range of industries and applications. Its main features are:

 Predictive modeling: Data is used by machine learning algorithms to create models that forecast future events. These
models can be used to determine the risk of a loan default or the likelihood that a consumer would make a purchase,
among other things.
 Automation: Machine learning algorithms automate the process of finding patterns in data, requiring less human
involvement and enabling more precise and effective analysis.
 Scalability: Machine learning techniques are well suited for processing big data because they are made to handle
massive amounts of data. As a result, businesses can make decisions based on information gleaned from such data.
 Generalization: Algorithms for machine learning are capable of discovering broad patterns in data that can be used to
analyze fresh, unexplored data. Even though the data used to train the model may not be immediately applicable to
the task at hand, they are useful for forecasting future events.
  Adaptiveness: As new data becomes available, machine learning algorithms are built to learn and adapt continuously.
As a result, they can enhance their performance over time, becoming more precise and efficient as more data is made
available to them.

The future of machine learning

The future of machine learning is expected to be characterized by continued advances in algorithms, computing power and
data availability. As machine learning becomes more widely adopted and integrated into various industries, it has the
potential to greatly impact society in a number of ways.
Some of the key trends and developments in the future of machine learning include:

 Increased automation: As machine learning algorithms progress, they will be able to automate a larger range of jobs,
requiring less human input and boosting productivity.
 More personalized experiences: Machine learning algorithms will have the capacity to assess and make use of
enormous volumes of data to deliver highly individualized experiences, such as personalized suggestions and adverts.
 Enhanced judgment: As machine learning algorithms get better at making complicated judgments and predictions,
numerous businesses will benefit from more precise and efficient decision-making.
 AI ethical advancements: As machine learning becomes more common, there will be a growing emphasis on ensuring
that it is developed and utilized ethically and responsibly, with a focus on safeguarding privacy and eliminating biases
in decision-making.
 Interdisciplinary collaboration: Machine learning will increasingly be used in collaboration with other fields, such as
neuroscience and biology, to drive new discoveries and advancements in those areas.
Overall, the future of machine learning holds great promise and is expected to continue transforming a wide range of
industries, from finance to healthcare, in the coming years.

History of Machine Learning

Machine Learning Applications and Examples

1. Social Media Features

Social media platforms use machine learning algorithms and approaches to create some attractive and excellent features. For
instance, Facebook notices and records your activities, chats, likes, and comments, and the time you spend on specific kinds
of posts. Machine learning learns from your own experience and makes friends and page suggestions for your profile.
 Image Source

2. Product Recommendations

Product recommendation is one of the most popular and known applications of machine learning. Product recommendation
is one of the stark features of almost every e-commerce website today, which is an advanced application of machine
learning techniques. Using machine learning and AI, websites track your behavior based on your previous purchases,
searching patterns, and cart history, and then make product recommendations.
3. Image Recognition

Image recognition, which is an approach for cataloging and detecting a feature or an object in the digital image, is one of the
most significant and notable machine learning and AI techniques. This technique is being adopted for further analysis, such
as pattern recognition, face detection, and face recognition.
4. Natural language processing (NLP)

Just like ML can recognize images, language models can also support and manipulate speech signals into commands and text.
Software applications coded with AI can convert recorded and live speech into text files.

Voice-based technologies can be used in medical applications, such as helping doctors extract important medical
terminology from a conversation with a patient. While this tool isn't advanced enough to make trustworthy clinical decisions,
other speech recognition services provide patients with reminders to “take their medication” as if they have a home health
aide by their side.

5. Virtual personal assistants

Virtual personal assistants are devices you might have in your own homes, such as Amazon’s Alexa, Google Home, or the
Apple iPhone’s Siri. These devices use a combination of speech recognition technology and machine learning to capture data
on what you're requesting and how often the device is accurate in its delivery. They detect when you start speaking, what
you’re saying, and deliver on the command. For example, when you say, “Siri, what is the weather like today?”, Siri searches
the web for weather forecasts in your location and provides detailed information.

6. Stock market predictions

Predictive analytics and algorithmic trading are common machine learning applications in industries such as finance, real
estate, and product development. Machine learning classifies data into groups and then defines them with rules set by data
analysts. After classification, analysts can calculate the probability of an action.
These machine learning methods help predict how the stock market will perform based on year-to-year analysis. Using
predictive analytics machine learning models, analysts can predict the stock price for 2025 and beyond.

Machine Learning and its Types

Machine Learning(ML) is a subset of Artificial Intelligence(AI), defined as a computer's ability to learn

from data by using algorithms to imitate intelligent human behavior of decision making and predictions.

There are three main groups of algorithms in ML:

1. Supervised learning,

2. Unsupervised learning

3. Reinforcement learning(RL)
Supervised Learning (means output is already known)

Consider yourself as a student sitting in a classroom wherein your teacher is supervising you, “how you can solve the
problem” or “whether you are doing correctly or not”. Likewise, in Supervised Learning input is provided as a labelled
dataset, a model can learn from it to provide the result of the problem easily.
Types of Problems

Supervised Learning deals with two types of problem- classification problems and regression problems.
Classification problems (depend upon the type)
This algorithm helps to predict a discrete value. It can be thought, the input data as a member of a particular class or group.
For instance, taking up the photos of the fruit dataset, each photo has been labelled as a mango, an apple, etc. Here, the
algorithm has to classify the new images into any of these categories. Examples:
 Naive Bayes Classifier

 Support Vector Machines

 Logistic Regression

Regression problems

These problems are used for continuous data. For ex

ample, predicting the price of a piece of land in a city, given the area, location, number of rooms, etc. And then the input is
sent to the machine for calculating the price of the land according to previous examples. Examples-

 Linear Regression
 Nonlinear Regression
 Bayesian Linear Regression

Unsupervised Learning

This learning algorithm is completely opposite to Supervised Learning. In short, there is no complete and clean labelled
dataset in unsupervised learning. Unsupervised learning is self-organized learning. Its main aim is to explore the
underlying patterns and predicts the output. Here we basically provide the machine with data and ask to look for hidden
features and cluster the data in a way that makes sense. Example
 K – Means clustering

 Neural Networks
 Principal Component Analysis

Reinforcement Learning

It is neither based on supervised learning nor unsupervised learning. Moreover, here the algorithms learn to react to an
environment on their own. It is rapidly growing and moreover producing a variety of learning algorithms. These algorithms
are useful in the field of Robotics, Gaming etc.

For a learning agent, there is always a start state and an end state. However, to reach the end state, there might be a different
path. In Reinforcement Learning Problem an agent tries to manipulate the environment. The agent travels from
one state to another. The agent gets the reward(appreciation) on success but will not receive any reward or appreciation
on failure. In this way, the agent learns from the environment.

Comparison Table

Criteria Supervised ML Unsupervised ML Reinforcement ML

Trained using unlabelled data Works on interacting with

Definition Learns by using labelled data
without any guidance. the environment
Criteria Supervised ML Unsupervised ML Reinforcement ML

Type of data Labelled data Unlabelled data No – predefined data

Type of Exploitation or
Regression and classification Association and Clustering
problems Exploration

Supervision Extra supervision No supervision No supervision

Linear Regression, Logistic K – Means, Q – Learning,

Algorithms
Regression, SVM, KNN etc. C – Means, Apriori SARSA

Aim Calculate outcomes Discover underlying patterns Learn a series of action

Risk Evaluation, Forecast Recommendation System, Self Driving Cars,

Application
Sales Anomaly Detection Gaming, Healthcare