Professional Documents
Culture Documents
Bias?
In our prediction model when we predict values something several times and all values are
close, they may all be wrong if there is a “Bias”. Bias is a systematic (built-in) error that
makes all measurements wrong by a certain amount. The term bias is the difference between
the average predicted value of the model and the actual value of our model which we are
trying to predict. A model with high bias pays very little attention to the training data and
oversimplifies the model. Suppose in case the model with high error on training and testing
data model with high Bias.
What is variance?
Variance is the variability of model prediction for a given data point or a value that tells us
the spread of our data. Model with high variance pays a lot of attention to training data and
does not generalize on the data which it hasn’t seen before. As a result, such models perform
very well on training data but have high error rates on test data.
In easy words, the bias corresponds to training set error and variance corresponds to the test
set error.
A model which performs really well on the training set or has high accuracy on training set
but it does not perform well on the test set. Suppose, if we plot a point with new coordinates,
overfitted model might not perform better. In case of Overfitting, the training set error is
less, so it will have low bias and our test set error is high, so it will have high variance.
A model which does not perform well on both training and test set. In case of Underfitting,
our training set error is high, so it will have high bias and our test set error is also high, so it
will have high variance.