Scribd Logo
Upload

Welcome to Scribd!

  • 03 Chap03 ReviewOfLinearRegression

    Uploaded by

    Costanza Neversurrender
    5 views6 pages
    This document compares linear regression and K-nearest neighbors (KNN) regression. KNN regression predicts the value of Y for a given X by taking the average of the Y values of the k closest data points to X in the training data. KNN is more flexible than linear regression for small values of k since it does not assume a linear relationship. However, KNN does not perform as well as linear regression in high-dimensional situations.

    Original Description:

    Original Title

    03_chap03_ReviewOfLinearRegression

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document compares linear regression and K-nearest neighbors (KNN) regression. KNN regression predicts the value of Y for a given X by taking the average of the Y values of the k closest data points to X in the training data. KNN is more flexible than linear regression for small values of k since it does not assume a linear relationship. However, KNN does not perform as well as linear regression in high-dimensional situations.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    5 views6 pages

    03 Chap03 ReviewOfLinearRegression

    Uploaded by

    Costanza Neversurrender
    This document compares linear regression and K-nearest neighbors (KNN) regression. KNN regression predicts the value of Y for a given X by taking the average of the Y values of the k closest data points to X in the training data. KNN is more flexible than linear regression for small values of k since it does not assume a linear relationship. However, KNN does not perform as well as linear regression in high-dimensional situations.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 6

    Linear vs.

    KNN Regression
    To predict Y for a given value of X, consider k closest
    points to X in training data and take the average of the
    responses. i.e.

    1
    f (x) 
    K
    y i
    xi Ni

    If k is small kNN is much more flexible than linear


    regression.
    Is that better?
    KNN Fits for k =1 and k = 9
    KNN Fits in One Dimension (k =1 and k =
    9)
    Linear Regression Fit
    KNN vs. Linear Regression
    Not So Good in High Dimensional
    Situations

    You might also like