Scribd Logo
Upload

Welcome to Scribd!

  • Linear Regreion SolvedExample

    Uploaded by

    Ahmed Maged
    10 views2 pages
    This document describes the process of linear regression to fit a line to input-output data. It initializes the parameters θ0 and θ1, and iterates over the data twice to update the parameters using gradient descent. Each iteration calculates the predictions, errors, derivatives and cost to update the parameters θ0 and θ1, reducing the cost from 8 to 2.5452.

    Original Description:

    Original Title

    Linear_Regreion_SolvedExample

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document describes the process of linear regression to fit a line to input-output data. It initializes the parameters θ0 and θ1, and iterates over the data twice to update the parameters using gradient descent. Each iteration calculates the predictions, errors, derivatives and cost to update the parameters θ0 and θ1, reducing the cost from 8 to 2.5452.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    10 views2 pages

    Linear Regreion SolvedExample

    Uploaded by

    Ahmed Maged
    This document describes the process of linear regression to fit a line to input-output data. It initializes the parameters θ0 and θ1, and iterates over the data twice to update the parameters using gradient descent. Each iteration calculates the predictions, errors, derivatives and cost to update the parameters θ0 and θ1, reducing the cost from 8 to 2.5452.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 2

    Linear Regression algorithm Q1

    intial paramter θ = [1 1]
    learning rate α = 0.002
    inputs x =
    5 10 20 30

    Target output y =
    10 15 25 35

    iteration (1)
    ==============
    x y hθ(x)=θ*x ek=h-y dJ/dθ0=ek*1 dJ/dθ1=ek*x cost
    =========================================================
    5 10 6 -4 -4 -20 16
    10 15 11 -4 -4 -40 16
    20 25 21 -4 -4 -80 16
    30 35 31 -4 -4 -120 16
    ---------------------------------------------------------
    Total -16 -260 64
    Cost =1/(2*m)*∑(hθ(x)-y)^2= 8
    dθ0 = -α/m*∑(dj/dθ0) = 0.008
    dθ1 = -α/m*∑(dj/dθ1) = 0.13
    θ0 =θ0+dθ0= 1.008
    θ1 =θ1+dθ1= 1.13

    iteration (2)
    ==============
    x y hθ(x)=θ*x ek=h-y dJ/dθ0=ek*1 dJ/dθ1=ek*x cost
    =========================================================
    5 10 6.658 -3.342 -3.342 -16.71 11.169
    10 15 12.308 -2.692 -2.692 -26.92 7.2469
    20 25 23.608 -1.392 -1.392 -27.84 1.9377
    30 35 34.908 -0.092 -0.092 -2.76 0.008464
    ---------------------------------------------------------
    Total -7.518 -74.23 20.362
    Cost =1/(2*m)*∑(hθ(x)-y)^2= 2.5452
    dθ0 = -α/m*∑(dj/dθ0) = 0.003759
    dθ1 = -α/m*∑(dj/dθ1) = 0.037115
    θ0 =θ0+dθ0= 1.0118
    θ1 =θ1+dθ1= 1.1671

    >>

    You might also like