|
Size: 1164
Comment: Initial commit
|
← Revision 5 as of 2026-07-21 01:15:33 ⇥
Size: 816
Comment: Killing most of article
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 11: | Line 11: |
| == Description == The first raw moment is the mean: ''μ = E[X]''. The second central moment is the variance: ''σ^2^ = E[(X - E[X])^2^ = E[(X - μ)^2^'' The third central moment, skewness, measures lopsidedness of a distribution. The fourth central moment, kurtosis, measures the heaviness of the tails on a distribution. ---- |
|
| Line 29: | Line 16: |
| The '''mean square error''' ('''MSE''') is the second moment of the error: ''MSE(ˆθ) = E[(ˆθ - E[ˆθ])^2^]''. MSE can be decomposed into the variance of the estimator and bias: ''MSE(ˆθ) = Var(ˆθ) + Bias(ˆθ,θ)^2^ = Var(ˆθ) + (E[ˆθ]-θ)^2^''. | The '''mean square error''' ('''MSE''') is the second moment of the error: ''MSE(θ̂) = E[(θ̂ - E[θ̂])^2^]''. MSE can be decomposed into the variance of the estimator and bias: ''MSE(θ̂) = Var(θ̂) + Bias(θ̂,θ)^2^ = Var(θ̂) + (E[θ̂]-θ)^2^''. |
| Line 32: | Line 19: |
| * '''Bias''', i.e. ''E[ˆθ] - θ'', is ''not'' the same as the first moment of errors. * If there is no bias, then MSE ''is'' the variance of the estimator: ''MSE(ˆθ) = Var(ˆθ)''. |
* '''Bias''', i.e. ''E[θ̂] - θ'', is ''not'' the same as the first moment of errors. * If there is no bias, then MSE ''is'' the variance of the estimator: ''MSE(θ̂) = Var(θ̂)''. |
Moments
Moments are measures of a distribution's shape and density.
Errors
Models generally assume that individual errors average to zero, i.e. the first moment of errors is zero: E[Ŷ - Y] = 0. Nonetheless, higher order moments are important.
The mean square error (MSE) is the second moment of the error: MSE(θ̂) = E[(θ̂ - E[θ̂])2]. MSE can be decomposed into the variance of the estimator and bias: MSE(θ̂) = Var(θ̂) + Bias(θ̂,θ)2 = Var(θ̂) + (E[θ̂]-θ)2.
Two important notes:
Bias, i.e. E[θ̂] - θ, is not the same as the first moment of errors.
If there is no bias, then MSE is the variance of the estimator: MSE(θ̂) = Var(θ̂).