Numerical

Methods
Lecture-12
[MA-200]
ARISHA ALI
 Curve Fitting

ARISHA ALI 2
 Curve Fitting
It is a process of finding “best fit”
curve, since different approximation
curves can be obtained for the same
data.

ARISHA ALI 3
 Least Square Method

▪ 𝑦 = 𝑎 + 𝑏𝑥 (Straight Line or Linear)

▪ 𝑦 = 𝑎 + 𝑏𝑥 + 𝑐𝑥 2 (Parabola or quadratic)

ARISHA ALI 4
 Straight Line Fitting

ARISHA ALI 5
 Curve Fitting by Method of Least
Square for Straight Line
Let the point (𝑥1 , 𝑦1 ) (𝑥2 , 𝑦2 )… (𝑥𝑛 , 𝑦𝑛 )
Let 𝑦 = 𝑎 + 𝑏𝑥 ---------- (1)
Is the equation of straight line to fitted above data here
σ 𝑦𝑖 = 𝑛𝑎 + 𝑏 σ 𝑥𝑖 ------- (2)
σ 𝑥𝑖 𝑦𝑖 = 𝑎 σ 𝑥𝑖 + 𝑏 σ 𝑥𝑖2 ---------- (3)
Eq (3) and Eq (2) are called the normal equations.

ARISHA ALI 6
 Working Rule
▪ Let the point 𝑥1 , 𝑦1 , (𝑥2 , 𝑦2 )… (𝑥𝑛 , 𝑦𝑛 ) are the given data
▪ Find σ 𝑥 , σ 𝑦 , σ 𝑥𝑦 , σ 𝑥 2
▪ Construct the normal equation for 𝑎 and 𝑏
σ 𝑦𝑖 = 𝑛𝑎 + 𝑏 σ 𝑥𝑖
σ 𝑥𝑖 𝑦𝑖 = 𝑎 σ 𝑥𝑖 + 𝑏 σ 𝑥𝑖2
▪ Solve the normal equations and find 𝑎 and 𝑏
▪ Put them into equation of line i.e., 𝑦 = 𝑎 + 𝑏𝑥

ARISHA ALI 7
 Example # 1
Using the method of least square, find the straight line 𝑦 = 𝑎 + 𝑏𝑥, that fit the
following data. Also calculate the Deviation.

x 0.5 1.0 1.5 2.0 2.5 3.0

y 15 17 19 14 10 7
Solution:
The normal equations of least square fit are
σ 𝑦 = 𝑛𝑎 + 𝑏 σ 𝑥
σ 𝑥𝑦 = 𝑎 σ 𝑥 + 𝑏 σ 𝑥 2
ARISHA ALI 8
 x y xy 𝒙𝟐
0.5 15 7.5 0.25
1.0 17 17.0 1.00
1.5 19 28.5 2.25
2.0 14 28.0 4.00
2.5 10 25.0 6.25
3.0 7 21.0 9.00

෍ 𝑥 = 10.5 ෍ 𝑦 = 82 ෍ 𝑥𝑦 = 127 ෍ 𝑥 2 = 22.75

ARISHA ALI 9
 Cont…
Put values in normal equation
𝑛=6
σ 𝑦 = 𝑛𝑎 + 𝑏 σ 𝑥 ⟹ 82 = 6𝑎 + 10.5𝑏------ (1)
σ 𝑥𝑦 = 𝑎 σ 𝑥 + 𝑏 σ 𝑥 2 ⟹ 127 = 10.5𝑎 + 22.75𝑏------- (2)
6𝑎 + 10.5𝑏 = 82
82−10.5𝑏
𝑎=
6

Put value of 𝑎 in equation (2)

ARISHA ALI 10
 Cont…
127 = 10.5𝑎 + 22.75𝑏
82−10.5𝑏
127 = 10.5 + 22.75𝑏
6

127 = 143.5 − 18.375𝑏 + 22.75𝑏

𝑏 = −3.7714
82−10.5𝑏 82−10.5(−3.7714)
𝑎= = ⟹ 𝑎 = 20.2667
6 6

Hence the required fit for the given data is

𝑦 = 𝑎 + 𝑏𝑥 ⟹ 𝑦 = 20.2667 − 3.7714𝑥
ARISHA ALI 11
 Error Evaluation
𝑖 𝑥𝑖 𝑦𝑖 𝑔 𝑥𝑖 = 𝑎 + 𝑏𝑥𝑖 𝐷𝑒𝑣𝑖𝑎𝑡𝑖𝑜𝑛 = 𝑦𝑖 − 𝑔(𝑥𝑖 )

1 0.5 15 20.2667 − 3.7714(0.5) = 18.381 15 − 18.381 = −3.381

2 1.0 17 20.2667 − 3.7714(1.0) = 16.4953 17 − 16.4953 = 0.5047
3 1.5 19 20.2667 − 3.7714 1.5 = 36.3043 19 − 36.3043 = 55.3043
4 2.0 14 20.2667 − 3.7714 2.0 = 12.7239 14 − 12.7239 = 1.2761
5 2.5 10 20.2667 − 3.7714 2.5 = 10.8382 10 − 10.8382 = −0.8382
6 3.0 17 20.2667 − 3.7714 3.0 = 8.9525 17 − 8.9525 = 8.0475
ARISHA ALI 12
 Parabola Fitting

ARISHA ALI 13
 Curve Fitting by Method of Least
Square for Parabola
Let the point (𝑥1 , 𝑦1 ) (𝑥2 , 𝑦2 )… (𝑥𝑛 , 𝑦𝑛 )
Let 𝑦 = 𝑎 + 𝑏𝑥 + 𝑐𝑥 2 ---------- (1)
Is the equation of parabola to fitted above data here
σ 𝑦𝑖 = 𝑛𝑎 + 𝑏 σ 𝑥𝑖 + 𝑐 σ 𝑥𝑖2 ------- (2)
σ 𝑥𝑖 𝑦𝑖 = 𝑎 σ 𝑥𝑖 + 𝑏 σ 𝑥𝑖2 + 𝑐 σ 𝑥𝑖3 ---------- (3)
σ 𝑥𝑖2 𝑦𝑖 = 𝑎 σ 𝑥𝑖2 + 𝑏 σ 𝑥𝑖3 + 𝑐 σ 𝑥𝑖4 --------- (4)
Eq (2), (3) and Eq (4) are called the normal equations.

ARISHA ALI 14
 Working Rule
▪ Let the point 𝑥1 , 𝑦1 , (𝑥2 , 𝑦2 )… (𝑥𝑛 , 𝑦𝑛 ) are the given data
▪ Find σ 𝑥 , σ 𝑦 , σ 𝑥𝑦 , σ 𝑥 2 , σ 𝑥 2 𝑦, σ 𝑥 3 , σ 𝑥 4
▪ Construct the normal equation for 𝑎, 𝑏 and 𝑐
σ 𝑦𝑖 = 𝑛𝑎 + 𝑏 σ 𝑥𝑖 + 𝑐 σ 𝑥𝑖2

σ 𝑥𝑖 𝑦𝑖 = 𝑎 σ 𝑥𝑖 + 𝑏 σ 𝑥𝑖2 + 𝑐 σ 𝑥𝑖3

σ 𝑥𝑖2 𝑦𝑖 = 𝑎 σ 𝑥𝑖2 + 𝑏 σ 𝑥𝑖3 + 𝑐 σ 𝑥𝑖4

▪ Solve the normal equations and find 𝑎, 𝑏 and 𝑐

▪ Put them into equation of parabola i.e., 𝑦 = 𝑎 + 𝑏𝑥 + 𝑐𝑥 2

ARISHA ALI 15
 Example # 2
Applying the method of least square to find an equation of the form
𝑦 = 𝑎𝑥 + 𝑏𝑥 2 that fit the following data

x 1 2 3 4 5 6
y 2.6 5.4 8.7 12.1 16.0 20.2
Solution:
𝑦 = 𝑎𝑥 + 𝑏𝑥 2 ⟹ 𝑦 = 𝑥(𝑎 + 𝑏𝑥)
𝑦
= 𝑎 + 𝑏𝑥 ⟹ 𝑌 = 𝑎 + 𝑏𝑥
𝑥

ARISHA ALI 16
 x Y xY 𝑥2
1 2.6 2.6 1
2 2.7 5.4 4
3 2.9 8.7 9
4 3.025 12.1 16
5 3.2 16.0 25
6 3.367 20.2 36

෍ 𝑥 = 21 ෍ 𝑌 = 17.792 ෍ 𝑥𝑌 = 65.0 ෍ 𝑥 2 = 91

ARISHA ALI 17
 Cont…
Put values in normal equation
𝑛=6
σ 𝑌 = 𝑛𝑎 + 𝑏 σ 𝑥 ⟹ 17.792 = 6𝑎 + 21𝑏------ (1)
σ 𝑥𝑌 = 𝑎 σ 𝑥 + 𝑏 σ 𝑥 2 ⟹ 65.0 = 21𝑎 + 91𝑏------- (2)
𝑎 = 2.41973, 𝑏 = 0.15589
𝑌 = 0.15589 + 2.41973𝑥
𝑦
𝑌= = 0.15589 + 2.41973 𝑥
𝑥

𝑦 = 0.15589𝑥 + 2.41973𝑥 2
ARISHA ALI 18
 Example # 3 (quadratic fit)

Solution:
Let the equation of the parabolic fit is 𝑦 = 𝑎 + 𝑏𝑥 + 𝑐𝑥 2
The corresponding normal equations are
σ 𝑦 = 𝑛𝑎 + 𝑏 σ 𝑥 + 𝑐 σ 𝑥 2
σ 𝑥𝑦 = 𝑎 σ 𝑥 + 𝑏 σ 𝑥 2 + 𝑐 σ 𝑥 3
σ 𝑥2𝑦 = 𝑎 σ 𝑥2 + 𝑏 σ 𝑥3 + 𝑐 σ 𝑥4
ARISHA ALI 19
 x y 𝑥2 𝑥3 𝑥4 xy 𝑥2y

1.0 0.98 1.00 1.0 1.0000 0.980 0.9800

1.2 1.40 1.44 1.728 2.0736 1.680 2.0160

1.4 1.86 1.96 2.744 3.8416 2.604 3.6456

1.6 2.55 2.56 4.096 6.5536 4.080 6.5280

1.8 2.28 3.24 5.832 10.4976 4.104 7.3872

2.0 3.20 4.00 8.000 16.0000 6.400 12.8000

෍𝑥 = 9 ෍𝑦 = ෍ 𝑥2 = ෍ 𝑥3 = ෍ 𝑥4 = ෍ 𝑥𝑦 = ෍ 𝑥2𝑦 =

12.27 14.20 23.4 39.9664 19.848 33.3568

ARISHA ALI 20
 Cont…
Put values in normal equation
𝑛=6
σ 𝑦 = 𝑛𝑎 + 𝑏 σ 𝑥 + 𝑐 σ 𝑥 2 ⟹ 12.27 = 6𝑎 + 9.0𝑏 + 14.20𝑐
σ 𝑥𝑦 = 𝑎 σ 𝑥 + 𝑏 σ 𝑥 2 + 𝑐 σ 𝑥 3 ⟹ 19.848 = 9𝑎 + 14.20𝑏 + 23.4𝑐
σ 𝑥 2 𝑦 = 𝑎 σ 𝑥 2 + 𝑏 σ 𝑥 3 + 𝑐 σ 𝑥 4 ⟹ 33.3568 = 14.20𝑎 + 23.4𝑏 + 39.9664𝑐
𝑎 = −0.1875, 𝑏 = 2.6239, 𝑐 = −1.4471
𝑦 = −0.1875 + 2.6239𝑥 − 1.4471𝑥 2

ARISHA ALI 21