Gradient Descent with

logistic Regression
Outline
• Gradient Descent
• Gradient descent with linear regression
• Cost and Loss function
• Global and local minima
• Global and local Maxima
• Mathematical calculation
• Gradient descent with logistic regression
Gradient Descent
Cost Function with linear Regression
Cost Function with Linear Regression
Linear Regression Equation
Linear Regression Equation
Linear Regression Equation
Linear Regression Equation
Predicted and Actual value Difference
Difference calculation
Loss and Cost Function
• Loss function: loss function is to capture the difference between the
actual and predicted values for a single record

• Cost function: cost functions aggregate the difference for the entire
training dataset
Cost function
Cost function
Mean Squared Error
Gradient Descent
Goal of Gradient Descent
Gradient Descent
Local and Global minima
3D graph
Conversion of 3D into 2D
Gradient Descent formula
learning Rate
Direction
Benefit of Derivative
Linear regression
regression vs logistic
Convert linear to logistic
Convert linear to logistic
Convert linear to logistic
• https://www.baeldung.com/cs/gradient-descent-logistic-regression