BACK

PROPAGATION
Machine Learning

Submitted By

A.T.M. Fazlay Rabbi

BSSE0926

Submitted To

B. M. Mainul Hossain
Associate professor
Institute of Information Technology
University of Dhaka

JANUARY 27, 2021

Problem
The problem is to update values for all parameters (weights and biases) using two iterations of back-
propagation.

Solution
Let,
SSC cgpa = i1 = 1, HSC cgpa = i2 = 1,
SPL1 = b1 = 0.94, SPL2 = b2 = 1,
1st year cgpa = w1 = 0.98, 2nd year cgpa = w2 = 0.96, 3rd year cgpa = w3 = 0.95,
Cgpa upto 3rd year = w4 = 0.955
IIT = h, SPL3 = o1, BSSE cgpa = o2
targeto1 = 1, targeto2 = 1
Learning rate, ƞ = 0.01
Here, all the values have been converted in the range of 0 to 1.
1st Iteration
Forward Pass
𝒏𝒆𝒕𝒉 = 𝒊𝟏 ∗ 𝒘𝟏 + 𝒊𝟐 ∗ 𝒘𝟐 + 𝒃𝟏 ∗ 𝟏 = (1 * 0.98) + (1 * 0.96) + (0.94 * 1) = 2.88
𝟏 1
𝒐𝒖𝒕𝒉 = = = 0.947
𝟏 + 𝒆−𝒏𝒆𝒕𝒉 1 + e−2.88
𝒏𝒆𝒕𝒐𝟏 = 𝒐𝒖𝒕𝒉 ∗ 𝒘𝟑 + 𝒃𝟐 ∗ 𝟏 = 0.947 * 0.95 + 1 * 1 = 1.9

𝒏𝒆𝒕𝒐𝟐 = 𝒐𝒖𝒕𝒉 ∗ 𝒘𝟒 + 𝒃𝟐 ∗ 𝟏 = 0.947 * 0.955 + 1 * 1 = 1.904

𝟏 1
𝒐𝒖𝒕𝒐𝟏 = −𝒏𝒆𝒕𝒐𝟏 = = 0.87
𝟏 + 𝒆𝟏 1 + e−1.9
1
𝒐𝒖𝒕𝒐𝟐 = = = 0.87
𝟏 + 𝒆−𝒏𝒆𝒕𝒐𝟐 1 + e−1.904

Calculating Error
𝑬𝒐𝟏 = (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟏 − 𝒐𝒖𝒕𝟎𝟏)𝟐
𝑬𝒐𝟐 = (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟐 − 𝒐𝒖𝒕𝟎𝟐)𝟐
𝑬𝒕𝒐𝒕𝒂𝒍 = 𝑬𝟎𝟏 + 𝑬𝒐𝟐
= (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟏 − 𝒐𝒖𝒕𝟎𝟏)𝟐 + (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟐 − 𝒐𝒖𝒕𝟎𝟐)𝟐
= (1 – 0.87)2 + (1 – 0.87)2 = 0.0338

Backward Pass
1. Adjusting w3:

Considering w3 to know how much a change in w3 affects the total error.

𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏
= ∗ ∗
𝝏𝒘𝟑 𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒘𝟑

Now,
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
= −𝟐(𝒕𝒂𝒓𝒈𝒆𝒕
𝝏𝒐𝒖𝒕𝒐𝟏 𝒐𝟏 − 𝒐𝒖𝒕 𝒐𝟏 ) = −2(1 − 0.87) = −0.26

𝝏𝒐𝒖𝒕𝒐𝟏
𝝏𝒏𝒆𝒕𝒐𝟏 = 𝒐𝒖𝒕 𝒐𝟏 (𝟏 − 𝒐𝒖𝒕 𝒐𝟏 ) = 0.87(1 − 0.87) = 0.1131

𝝏𝒏𝒆𝒕𝒐𝟏
𝝏𝒘𝟑 = 𝒐𝒖𝒕 𝒉 = 0.947
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.26) ∗ 0.1131 ∗ 0.947 = −0.0278
𝝏𝒘𝟑
𝜕𝐸𝑡𝑜𝑡𝑎𝑙
So we get, 𝒘𝟑+ = 𝑤3 − 𝜂 ∗ = 0.95 − 0.01 ∗ (−0.0278) = 0.9502
𝜕𝑤3
2. Adjusting w4:

Considering w4 to know how much a change in w4 affects the total error.

𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐
= ∗ ∗
𝝏𝒘𝟒 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 𝝏𝒘𝟒

Now,
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
= −𝟐(𝒕𝒂𝒓𝒈𝒆𝒕
𝝏𝒐𝒖𝒕𝒐𝟐 𝒐𝟐 − 𝒐𝒖𝒕 𝒐𝟐 ) = −2(1 − 0.87) = −0.26

𝝏𝒐𝒖𝒕𝒐𝟐
𝝏𝒏𝒆𝒕𝒐𝟐 = 𝒐𝒖𝒕 𝒐𝟐 (𝟏 − 𝒐𝒖𝒕 𝒐𝟐 ) = 0.87(1 − 0.87) = 0.1131

𝝏𝒏𝒆𝒕𝒐𝟏
𝝏𝒘𝟒 = 𝒐𝒖𝒕 𝒉 = 0.947
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.26) ∗ 0.1131 ∗ 0.947 = −0.0278
𝝏𝒘𝟒
𝜕 𝐸𝑡𝑜𝑡𝑎𝑙
So we get, 𝒘𝟒+ = 𝑤4 − 𝜂 ∗ = 0.955 − 0.01 ∗ (−0.0278) = 0.9553
𝜕𝑤4

3. Adjusting b2:

Considering b2 to know how much a change in b2 affects the total error.

𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝑬𝒐𝟏 𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐
𝝏𝒃𝟐 = 𝝏𝒃𝟐 + 𝝏𝒃𝟐 = (𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒃𝟐 ) + ( 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒃𝟐 )
𝒐𝟏 𝒐𝟏 𝒐𝟐 𝒐𝟐

Now,
𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐
𝝏(𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟏 − 𝒐𝒖𝒕𝒐𝟏) 𝝏(𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟐 − 𝒐𝒖𝒕𝒐𝟐)
𝝏𝒐𝒖𝒕𝒐𝟏 = 𝝏𝒐𝒖𝒕 = −1 𝝏𝒐𝒖𝒕𝒐𝟐 = 𝝏𝒐𝒖𝒕𝒐𝟐 = −1
𝒐𝟏

𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒐𝟐
𝝏𝒏𝒆𝒕𝒐𝟏 = 𝒐𝒖𝒕 𝒐𝟏 (𝟏 − 𝒐𝒖𝒕 𝒐𝟏 ) = 0.1131 𝒐𝟐 (𝟏 − 𝒐𝒖𝒕 𝒐𝟐 ) = 0.1131
𝝏𝒏𝒆𝒕𝒐𝟐 = 𝒐𝒖𝒕
𝝏𝒏𝒆𝒕𝒐𝟏 𝝏(𝒐𝒖𝒕𝒉 ∗ 𝒘𝟑 + 𝒃𝟐 ∗ 𝟏) 𝝏𝒏𝒆𝒕𝒐𝟐 𝝏(𝒐𝒖𝒕𝒉 ∗ 𝒘𝟒 + 𝒃𝟐 ∗ 𝟏)
𝝏𝒃𝟐 = 𝝏𝒃𝟐 =1 𝝏𝒃𝟐 = 𝝏𝒃𝟐 =1
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−1 ∗ 0.1131 ∗ 1) + (−1 ∗ 0.1131 ∗ 1) = −0.2262
𝝏𝒃𝟐
𝜕𝐸𝑡𝑜𝑡𝑎𝑙
So we get, 𝒃𝟐+ = 𝑏2 − 𝜂 ∗ = 1 − 0.01 ∗ (−0.2262) = 1.002
𝜕𝑏2
4. Adjusting w1
Considering w1 to know how much a change in w1 affects the total error.
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉 𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉
𝝏𝒘𝟏 = 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟏 = ( 𝝏𝒐𝒖𝒕 + 𝝏𝒐𝒖𝒕 ) ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟏
𝒉 𝒉 𝒉 𝒉 𝒉
Here,
𝝏𝑬𝒐𝟏
𝝏𝒐𝒖𝒕𝒉 = 𝝏𝑬𝒐𝟏 ∗ 𝝏𝒐𝒖𝒕𝒐𝟏 ∗ 𝝏𝒏𝒆𝒕𝒐𝟏 = −1 ∗ 0.1131 ∗ 𝑤3 = −0.1131 ∗ 0.95 = −0.107
𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒉
𝝏𝑬𝒐𝟐
𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 = −1 ∗ 0.1131 ∗ 𝑤4 = −0.1131 ∗ 0.955 = −0.108
𝝏𝒐𝒖𝒕𝒉 =
𝝏𝒐𝒖𝒕𝒐𝟐 ∗ 𝝏𝒏𝒆𝒕𝒐𝟐 ∗ 𝝏𝒐𝒖𝒕𝒉
𝝏𝒐𝒖𝒕𝒉
𝝏𝒏𝒆𝒕𝒉 = 𝒐𝒖𝒕 (𝟏 − 𝒐𝒖𝒕𝒉 ) = 0.947(1 − 0.947) = 0.0502
𝒉

𝝏𝒏𝒆𝒕𝒉
= 𝑖1 = 1
𝝏𝒘𝟏
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.107 − 0.108) ∗ 0.0502 ∗ 1 = −0.011
𝝏𝒘𝟏
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
So we get, 𝒘𝟏+ = 𝑤1 − 𝜂 ∗ = 0.98 − 0.01 ∗ (−0.011) = 0.98011
𝝏𝒘𝟏

5. Adjusting w2
Considering w2 to know how much a change in w2 affects the total error.
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉 𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉
𝝏𝒘𝟐 = 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟐 = ( 𝝏𝒐𝒖𝒕 + 𝝏𝒐𝒖𝒕 ) ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟐
𝒉 𝒉 𝒉 𝒉 𝒉
Here,
𝝏𝑬𝒐𝟏
𝝏𝒐𝒖𝒕𝒉 = 𝝏𝑬𝒐𝟏 ∗ 𝝏𝒐𝒖𝒕𝒐𝟏 ∗ 𝝏𝒏𝒆𝒕𝒐𝟏 = −1 ∗ 0.1131 ∗ 𝑤3 = −0.1131 ∗ 0.95 = −0.107
𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒉
𝝏𝑬𝒐𝟐
𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 = −1 ∗ 0.1131 ∗ 𝑤4 = −0.1131 ∗ 0.955 = −0.108
𝝏𝒐𝒖𝒕𝒉 =
𝝏𝒐𝒖𝒕𝒐𝟐 ∗ 𝝏𝒏𝒆𝒕𝒐𝟐 ∗ 𝝏𝒐𝒖𝒕𝒉
𝝏𝒐𝒖𝒕𝒉
𝝏𝒏𝒆𝒕𝒉 = 𝒐𝒖𝒕 (𝟏 − 𝒐𝒖𝒕𝒉 ) = 0.947(1 − 0.947) = 0.0502
𝒉

𝝏𝒏𝒆𝒕𝒉
= 𝑖2 = 1
𝝏𝒘𝟐
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.107 − 0.108) ∗ 0.0502 ∗ 1 = −0.011
𝝏𝒘𝟐
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
So we get, 𝒘𝟐+ = 𝑤2 − 𝜂 ∗ = 0.96 − 0.01 ∗ (−0.011) = 0.96011
𝝏𝒘𝟐
6. Adjusting b1
Considering b1 to know how much a change in b1 affects the total error.
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉 𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉
𝝏𝒃𝟏 = 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒃𝟏 = ( 𝝏𝒐𝒖𝒕 + 𝝏𝒐𝒖𝒕) ∗ 𝝏𝒏𝒆𝒕∗
𝒉 𝒉 𝒉 𝒉 𝒉 𝝏𝒃𝟏
Here,
𝝏𝑬𝒐𝟏
𝝏𝒐𝒖𝒕𝒉 = 𝝏𝑬𝒐𝟏 ∗ 𝝏𝒐𝒖𝒕𝒐𝟏 ∗ 𝝏𝒏𝒆𝒕𝒐𝟏 = −1 ∗ 0.1131 ∗ 𝑤3 = −0.1131 ∗ 0.95 = −0.107
𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒉
𝝏𝑬𝒐𝟐
𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 = −1 ∗ 0.1131 ∗ 𝑤4 = −0.1131 ∗ 0.955 = −0.108
𝝏𝒐𝒖𝒕𝒉 =
𝝏𝒐𝒖𝒕𝒐𝟐 ∗ 𝝏𝒏𝒆𝒕𝒐𝟐 ∗ 𝝏𝒐𝒖𝒕𝒉
𝝏𝒐𝒖𝒕𝒉
𝝏𝒏𝒆𝒕𝒉 = 𝒐𝒖𝒕 (𝟏 − 𝒐𝒖𝒕𝒉 ) = 0.947(1 − 0.947) = 0.0502
𝒉

𝝏𝒏𝒆𝒕𝒉
𝝏𝒃𝟏 = 1
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.107 − 0.108) ∗ 0.0502 ∗ 1 = −0.0107
𝝏𝒃𝟏
𝝏 𝑬𝒕𝒐𝒕𝒂𝒍
So we get, 𝒃𝟏+ = 𝑏1 − 𝜂 ∗ = 0.94 − 0.01 ∗ (−0.0107) = 0.9401
𝝏𝒃𝟏

1st Iteration Adjusted Values

After 1st iteration, we get the adjusted values as below:
SSC cgpa = i1 = 1, HSC cgpa = i2 = 1,
SPL1 = b1 = 0.9401, SPL2 = b2 = 1.002,
1st year cgpa = w1 = 0.98011, 2nd year cgpa = w2 = 0.96011, 3rd year cgpa = w3 = 0.9502,
Cgpa upto 3rd year = w4 = 0.9553
IIT = h, SPL3 = o1, BSSE cgpa = o2
targeto1 = 1, targeto2 = 1
Learning rate, ƞ = 0.01

These values will be used to adjust the weights and biases for 2nd iteration.
2nd Iteration
Forward Pass
𝒏𝒆𝒕𝒉 = 𝒊𝟏 ∗ 𝒘𝟏 + 𝒊𝟐 ∗ 𝒘𝟐 + 𝒃𝟏 ∗ 𝟏 = (1 * 0.98011) + (1 * 0.96011) + (0.9401 * 1) = 2.88032
𝟏 1
𝒐𝒖𝒕𝒉 = = = 0.947
𝟏 + 𝒆−𝒏𝒆𝒕𝒉 1 + e−2.88032
𝒏𝒆𝒕𝒐𝟏 = 𝒐𝒖𝒕𝒉 ∗ 𝒘𝟑 + 𝒃𝟐 ∗ 𝟏 = 0.947 * 0.9502 + 1.002 * 1 = 1.902

𝒏𝒆𝒕𝒐𝟐 = 𝒐𝒖𝒕𝒉 ∗ 𝒘𝟒 + 𝒃𝟐 ∗ 𝟏 = 0.947 * 0.9553 + 1.002 * 1 = 1.906

𝒐𝒖𝒕𝒐𝟏 = 𝟏 1
𝟏+𝒆−𝒏𝒆𝒕𝒐𝟏 = 1 + e−1.902
= 0.8701
𝟏 1
𝒐𝒖𝒕𝒐𝟐 = = = 0.871
𝟏 + 𝒆−𝒏𝒆𝒕𝒐𝟐 1 + e−1.906

Calculating Error
𝑬𝒐𝟏 = (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟏 − 𝒐𝒖𝒕𝟎𝟏)𝟐
𝑬𝒐𝟐 = (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟐 − 𝒐𝒖𝒕𝟎𝟐)𝟐
𝑬𝒕𝒐𝒕𝒂𝒍 = 𝑬𝟎𝟏 + 𝑬𝒐𝟐
= (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟏 − 𝒐𝒖𝒕𝟎𝟏)𝟐 + (𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟐 − 𝒐𝒖𝒕𝟎𝟐)𝟐
= (1 – 0.8701)2 + (1 – 0.871)2 = 0.03

Backward Pass
1. Adjusting w3:

Considering w3 to know how much a change in w3 affects the total error.

𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏
= ∗ ∗
𝝏𝒘𝟑 𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒘𝟑

Now,
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
= −𝟐(𝒕𝒂𝒓𝒈𝒆𝒕
𝝏𝒐𝒖𝒕𝒐𝟏 𝒐𝟏 − 𝒐𝒖𝒕 𝒐𝟏 ) = −2(1 − 0.8701) = −0.26

𝝏𝒐𝒖𝒕𝒐𝟏
𝝏𝒏𝒆𝒕𝒐𝟏 = 𝒐𝒖𝒕 𝒐𝟏 (𝟏 − 𝒐𝒖𝒕 𝒐𝟏 ) = 0.8701(1 − 0.8701) = 0.113

𝝏𝒏𝒆𝒕𝒐𝟏
𝝏𝒘𝟑 = 𝒐𝒖𝒕 𝒉 = 0.947
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.26) ∗ 0.113 ∗ 0.947 = −0.03
𝝏𝒘𝟑
𝜕𝐸𝑡𝑜𝑡𝑎𝑙
So we get, 𝒘𝟑+ = 𝑤3 − 𝜂 ∗ = 0.9502 − 0.01 ∗ (−0.03) = 0.9505
𝜕𝑤3
2. Adjusting w4:

Considering w4 to know how much a change in w4 affects the total error.

𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐
= ∗ ∗
𝝏𝒘𝟒 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 𝝏𝒘𝟒

Now,
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
= −𝟐(𝒕𝒂𝒓𝒈𝒆𝒕
𝝏𝒐𝒖𝒕𝒐𝟐 𝒐𝟐 − 𝒐𝒖𝒕 𝒐𝟐 ) = −2(1 − 0.871) = −0.258

𝝏𝒐𝒖𝒕𝒐𝟐
𝝏𝒏𝒆𝒕𝒐𝟐 = 𝒐𝒖𝒕 𝒐𝟐 (𝟏 − 𝒐𝒖𝒕 𝒐𝟐 ) = 0.871(1 − 0.871) = 0.11

𝝏𝒏𝒆𝒕𝒐𝟏
𝝏𝒘𝟒 = 𝒐𝒖𝒕 𝒉 = 0.947
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.258) ∗ 0.11 ∗ 0.947 = −0.0268
𝝏𝒘𝟒
𝜕 𝐸𝑡𝑜𝑡𝑎𝑙
So we get, 𝒘𝟒+ = 𝑤4 − 𝜂 ∗ = 0.9553 − 0.01 ∗ (−0.0268) = 0.96
𝜕𝑤4

3. Adjusting b2:

Considering b2 to know how much a change in b2 affects the total error.

𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝑬𝒐𝟏 𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐
𝝏𝒃𝟐 = 𝝏𝒃𝟐 + 𝝏𝒃𝟐 = (𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒃𝟐 ) + ( 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒃𝟐 )
𝒐𝟏 𝒐𝟏 𝒐𝟐 𝒐𝟐

Now,
𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐
𝝏(𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟏 − 𝒐𝒖𝒕𝒐𝟏) 𝝏(𝒕𝒂𝒓𝒈𝒆𝒕𝒐𝟐 − 𝒐𝒖𝒕𝒐𝟐)
𝝏𝒐𝒖𝒕𝒐𝟏 = 𝝏𝒐𝒖𝒕 = −1 𝝏𝒐𝒖𝒕𝒐𝟐 = 𝝏𝒐𝒖𝒕𝒐𝟐 = −1
𝒐𝟏

𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒐𝟐
𝝏𝒏𝒆𝒕𝒐𝟏 = 𝒐𝒖𝒕 𝒐𝟏 (𝟏 − 𝒐𝒖𝒕 𝒐𝟏 ) = 0.113 𝒐𝟐 (𝟏 − 𝒐𝒖𝒕 𝒐𝟐 ) = 0.11
𝝏𝒏𝒆𝒕𝒐𝟐 = 𝒐𝒖𝒕
𝝏𝒏𝒆𝒕𝒐𝟏 𝝏(𝒐𝒖𝒕𝒉 ∗ 𝒘𝟑 + 𝒃𝟐 ∗ 𝟏) 𝝏𝒏𝒆𝒕𝒐𝟐 𝝏(𝒐𝒖𝒕𝒉 ∗ 𝒘𝟒 + 𝒃𝟐 ∗ 𝟏)
𝝏𝒃𝟐 = 𝝏𝒃𝟐 =1 𝝏𝒃𝟐 = 𝝏𝒃𝟐 =1
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−1 ∗ 0.113 ∗ 1) + (−1 ∗ 0.11 ∗ 1) = −0.22
𝝏𝒃𝟐
𝜕𝐸𝑡𝑜𝑡𝑎𝑙
So we get, 𝒃𝟐+ = 𝑏2 − 𝜂 ∗ = 1.002 − 0.01 ∗ (−0.22) = 1.004
𝜕𝑏2
4. Adjusting w1
Considering w1 to know how much a change in w1 affects the total error.
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉 𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉
𝝏𝒘𝟏 = 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟏 = ( 𝝏𝒐𝒖𝒕 + 𝝏𝒐𝒖𝒕 ) ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟏
𝒉 𝒉 𝒉 𝒉 𝒉
Here,
𝝏𝑬𝒐𝟏
𝝏𝒐𝒖𝒕𝒉 = 𝝏𝑬𝒐𝟏 ∗ 𝝏𝒐𝒖𝒕𝒐𝟏 ∗ 𝝏𝒏𝒆𝒕𝒐𝟏 = −1 ∗ 0.113 ∗ 𝑤3 = −0.113 ∗ 0.9502 = −0.11
𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒉
𝝏𝑬𝒐𝟐
𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 = −1 ∗ 0.11 ∗ 𝑤4 = −0.11 ∗ 0.9553 = −0.105
𝝏𝒐𝒖𝒕𝒉 =
𝝏𝒐𝒖𝒕𝒐𝟐 ∗ 𝝏𝒏𝒆𝒕𝒐𝟐 ∗ 𝝏𝒐𝒖𝒕𝒉
𝝏𝒐𝒖𝒕𝒉
𝝏𝒏𝒆𝒕𝒉 = 𝒐𝒖𝒕 (𝟏 − 𝒐𝒖𝒕𝒉 ) = 0.947(1 − 0.947) = 0.0502
𝒉

𝝏𝒏𝒆𝒕𝒉
= 𝑖1 = 1
𝝏𝒘𝟏
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.11 − 0.105) ∗ 0.0502 ∗ 1 = −0.01
𝝏𝒘𝟏
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
So we get, 𝒘𝟏+ = 𝑤1 − 𝜂 ∗ = 0.98011 − 0.01 ∗ (−0.01) = 0.9802
𝝏𝒘𝟏

5. Adjusting w2
Considering w2 to know how much a change in w2 affects the total error.
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉 𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉
𝝏𝒘𝟐 = 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟐 = ( 𝝏𝒐𝒖𝒕 + 𝝏𝒐𝒖𝒕 ) ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒘𝟐
𝒉 𝒉 𝒉 𝒉 𝒉
Here,
𝝏𝑬𝒐𝟏
𝝏𝒐𝒖𝒕𝒉 = 𝝏𝑬𝒐𝟏 ∗ 𝝏𝒐𝒖𝒕𝒐𝟏 ∗ 𝝏𝒏𝒆𝒕𝒐𝟏 = −1 ∗ 0.113 ∗ 𝑤3 = −0.113 ∗ 0.9502 = −0.11
𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒉
𝝏𝑬𝒐𝟐
𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 = −1 ∗ 0.11 ∗ 𝑤4 = −0.1131 ∗ 0.9553 = −0.105
𝝏𝒐𝒖𝒕𝒉 =
𝝏𝒐𝒖𝒕𝒐𝟐 ∗ 𝝏𝒏𝒆𝒕𝒐𝟐 ∗ 𝝏𝒐𝒖𝒕𝒉
𝝏𝒐𝒖𝒕𝒉
𝝏𝒏𝒆𝒕𝒉 = 𝒐𝒖𝒕 (𝟏 − 𝒐𝒖𝒕𝒉 ) = 0.947(1 − 0.947) = 0.0502
𝒉

𝝏𝒏𝒆𝒕𝒉
= 𝑖2 = 1
𝝏𝒘𝟐
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.11 − 0.105) ∗ 0.0502 ∗ 1 = −0.01
𝝏𝒘𝟐
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
So we get, 𝒘𝟐+ = 𝑤2 − 𝜂 ∗ = 0.96011 − 0.01 ∗ (−0.01) = 0.96021
𝝏𝒘𝟐
6. Adjusting b1
Considering b1 to know how much a change in b1 affects the total error.
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
𝝏𝑬𝒕𝒐𝒕𝒂𝒍 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉 𝝏𝑬𝒐𝟏 𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒉 𝝏𝒏𝒆𝒕𝒉
𝝏𝒃𝟏 = 𝝏𝒐𝒖𝒕 ∗ 𝝏𝒏𝒆𝒕 ∗ 𝝏𝒃𝟏 = ( 𝝏𝒐𝒖𝒕 + 𝝏𝒐𝒖𝒕) ∗ 𝝏𝒏𝒆𝒕∗
𝒉 𝒉 𝒉 𝒉 𝒉 𝝏𝒃𝟏
Here,
𝝏𝑬𝒐𝟏
𝝏𝒐𝒖𝒕𝒉 = 𝝏𝑬𝒐𝟏 ∗ 𝝏𝒐𝒖𝒕𝒐𝟏 ∗ 𝝏𝒏𝒆𝒕𝒐𝟏 = −1 ∗ 0.113 ∗ 𝑤3 = −0.113 ∗ 0.9502 = −0.11
𝝏𝒐𝒖𝒕𝒐𝟏 𝝏𝒏𝒆𝒕𝒐𝟏 𝝏𝒐𝒖𝒕𝒉
𝝏𝑬𝒐𝟐
𝝏𝑬𝒐𝟐 𝝏𝒐𝒖𝒕𝒐𝟐 𝝏𝒏𝒆𝒕𝒐𝟐 = −1 ∗ 0.11 ∗ 𝑤4 = −0.1131 ∗ 0.9553 = −0.105
𝝏𝒐𝒖𝒕𝒉 =
𝝏𝒐𝒖𝒕𝒐𝟐 ∗ 𝝏𝒏𝒆𝒕𝒐𝟐 ∗ 𝝏𝒐𝒖𝒕𝒉
𝝏𝒐𝒖𝒕𝒉
𝝏𝒏𝒆𝒕𝒉 = 𝒐𝒖𝒕 (𝟏 − 𝒐𝒖𝒕𝒉 ) = 0.947(1 − 0.947) = 0.0502
𝒉

𝝏𝒏𝒆𝒕𝒉
𝝏𝒃𝟏 = 1
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
∴ = (−0.11 − 0.105) ∗ 0.0502 ∗ 1 = −0.011
𝝏𝒃𝟏
𝝏𝑬𝒕𝒐𝒕𝒂𝒍
So we get, 𝒃𝟏+ = 𝑏1 − 𝜂 ∗ = 0.9401 − 0.01 ∗ (−0.011) = 0.9402
𝝏𝒃𝟏

2nd Iteration Adjusted Values

After 2nd iteration, we get the adjusted values as below:
SPL1 = 0.9402
SPL2 = 1.004
1st year cgpa = 0.9802 2nd
year cgpa = 0.96021 3rd
year cgpa = 0.9505 Cgpa
upto 3rd year = 0.96