Differences between revisions 7 and 15 (spanning 8 versions)
⇤ ← Revision 7 as of 2023-10-28 16:21:41 →
Size: 1381
Editor: DominicRicottone
Comment:
← Revision 15 as of 2023-10-28 18:25:46 → ⇥
Size: 1730
Editor: DominicRicottone
Comment:
Deletions are marked like this. Additions are marked like this.
Line 33: Line 33:
== Multivariate ==

----
Line 42: Line 48:
 2. Exogeneity

{{attachment:model2.svg}}

 3.#3 Random sampling		  2. [[Econometrics/Exogeneity|Exogeneity]]
 3. Random sampling
Line 48: Line 51:
 5. Heteroskedasticity  5. [[Econometrics/Homoskedasticity|Homoskedasticity]]
Line 54: Line 57:
{{attachment:model3.svg}} {{attachment:model2.svg}}
Line 56: Line 59:
The variance for each coefficient is estimated as: The variances for each coefficient are:
Line 58: Line 61:
{{attachment:model4.svg}} {{attachment:homo1.svg}}
Line 60: Line 63:
Where R^2^ is calculated as: Note that the standard deviation of the population's parameter is unknown, so it's estimated like:
Line 62: Line 65:
{{attachment:model5.svg}} {{attachment:homo2.svg}}
Line 64: Line 67:
Note also that the standard deviation of the population's parameter is unknown, so it's estimated like: If the homoskedasticity assumption does not hold, then the estimators for each coefficient are actually:
Line 66: Line 69:
{{attachment:model6.svg}} {{attachment:hetero1.svg}}

Wherein, for example, ''r,,1j,,'' is the residual from regressing ''x,,1,,'' onto ''x,,2,,'', ... ''x,,k,,''.

The variances for each coefficient can be estimated with the Eicker-White formula:

{{attachment:hetero2.svg}}

Ordinary Least Squares

Ordinary Least Squares (OLS) is a linear regression method. It minimizes root mean square errors.

Contents

  1. Ordinary Least Squares
    1. Univariate
    2. Multivariate
    3. Linear Model

Univariate

The regression line passes through two points:

[ATTACH]

and

[ATTACH]

These points, with the generic equation for a line, can prove that the slope of the regression line is equal to:

[ATTACH]

The generic formula for the regression line is:

[ATTACH]

Multivariate

Linear Model

The linear model can be expressed as:

model1.svg

If these assumptions can be made:

  1. Linearity

  2. Exogeneity

  3. Random sampling
  4. No perfect multicolinearity

  5. Homoskedasticity

Then OLS is the best linear unbiased estimator (BLUE) for these coefficients.

Using the computation above, the coefficients are estimated to produce:

model2.svg

The variances for each coefficient are:

[ATTACH]

Note that the standard deviation of the population's parameter is unknown, so it's estimated like:

[ATTACH]

If the homoskedasticity assumption does not hold, then the estimators for each coefficient are actually:

[ATTACH]

Wherein, for example, r1j is the residual from regressing x1 onto x2, ... xk.

The variances for each coefficient can be estimated with the Eicker-White formula:

[ATTACH]

CategoryRicottone

Statistics/OrdinaryLeastSquares (last edited 2025-09-03 02:08:40 by DominicRicottone)