The Principle of Least Squares
The best-fitting line is the one with the smallest sum of squared residuals.
Assumptions:
- other variables that affect the response are controlled.
- residuals are independent and normally distributed, with a mean of zero and constant variance.
- no uncertainty in x.