Differences between revisions 3 and 4

Ordinary Least Squares

Ordinary Least Squares (OLS) is a linear regression method. It minimizes root mean square errors.

Contents

Univariate

The regression line passes through two points:

and

Take the generic equation form of a line:

Insert the first point into this form.

This can be trivially rewritten to solve for a in terms of b:

Insert the second point into the original form.

Now additionally insert the solution for a in terms of b.

Expand all terms to produce:

This can now be eliminated into:

Giving a solution for b:

This solution is trivially rewritten as:

Expand the formula for correlation as:

This can now be eliminated into:

Finally, b can be eloquently written as:

Giving a generic formula for the regression line:

Statistics/OrdinaryLeastSquares (last edited 2025-01-10 14:33:38 by DominicRicottone)

-  ⇤ ← Revision 3 as of 2023-10-28 05:37:48 → 
  Size: 1349
  Editor: DominicRicottone
  Comment:
+   ← Revision 4 as of 2023-10-28 05:38:00 → ⇥
  Size: 1293
  Editor: DominicRicottone
  Comment: Rename
-Deletions are marked like this.
+Additions are marked like this.
 Line 1:
-## page was renamed from Econometrics/LinearRegression