They could be described as inaccurate data or as showing a regression line that doesn't match well.

When an outlier deviates more in a horizontal direction from the rest of the data, it is referred to as an
influential observation ("Linear Regression").

Reference:

1. Outliers to narrow down choices. Explain why- Free Subjects Examples

(maryelizabethbodycare.com)
2.