Differences between revisions 3 and 4
Revision 3 as of 2025-01-10 14:35:34
Size: 1069
Comment: Killing Econometrics page
Revision 4 as of 2025-01-10 14:52:51
Size: 2024
Comment: Killing Econometrics page
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
## page was renamed from Econometrics/TestStatistic
Line 4: Line 3:
A '''test statistic''' is a statistic generated for hypothesis testing in statistical inference. A '''test statistic''' is a statistic generated for hypothesis testing in [[Statistics/CausalInference|causal inference]].
Line 12: Line 11:
== Usage == == Description ==
Line 18: Line 17:
A critical value should reflect a tolerance for Type I error.
Line 22: Line 23:
Statistical analysis can be done with '''p-values''' instead. A '''p-value''' is the probability of achieving a test statistic assuming the null hypothesis is true. This is effectively a reformulation of the above framework: a critical level is selected (commonly 0.05; or conversely a level of significance is selected, like 95%) and ''H,,0,,'' is rejected if the p-value exceeds it.
Line 24: Line 25:
The ''intention'' of p-values is to enable readers to apply their own tolerance for Type I error as a critical value. In some cases it is more succinct to report p-values rather than annotate multiple levels of significance (e.g. 90%, 95%, and 99%). The advantage to formulating inference through p-values is that anyone can formulate their personal tolerance for Type I error, determine the corresponding critical level, and re-evaluate the inference. In contexts where a variety of critical levels ought to be considered (e.g., at 0.1, 0.05, and 0.01 simultaneously), it can also be more succinct to report p-values than annotate each.
Line 26: Line 27:
The unfortunate fact is that many people interpret p-values as a probability that the result is correct. For example, some people see a p-value of 0.02 and incorrectly assume that there is a 98% probability that the result is correct. The disadvantage to this formulation is that p-values are more easily misunderstood (e.g., possible to misinterpret a p-value of 0.02 as meaning there is a 98% probability that the result is correct, when it truly means that there is a 2% probability that the estimate is 0).
Line 32: Line 33:
== t-test == == Usage ==
Line 34: Line 35:
---- There are a variety of test statistics. Most tests are designed for application in specific contexts, when certain assumptions hold. See the below pages for usage guidance:
Line 36: Line 37:


== Z-test ==

----



== Chi-squared test ==

----



== F-test ==
 * [[Statistics/CollinearityTest|Collinearity test]]
 * [[Statistics/HosmerLemeshowTest|Hosmer-Lemeshow test]]
 * [[Statistics/KolmogorovSmirnovTest|Kolmogorov-Smirnov test]]
 * [[Statistics/LagrangeMultiplierTest|Lagrange multiplier test]]
 * [[Statistics/LikelihoodRatioTest|Likelihood-ratio test]]
 * [[Statistics/PearsonTest|Pearson test]]
 * [[Statistics/WaldTest|Wald test]]

Test Statistic

A test statistic is a statistic generated for hypothesis testing in causal inference.


Description

A test statistic is compared to a critical value. H0 is rejected if:

test.svg

A critical value should reflect a tolerance for Type I error.

P-Values

A p-value is the probability of achieving a test statistic assuming the null hypothesis is true. This is effectively a reformulation of the above framework: a critical level is selected (commonly 0.05; or conversely a level of significance is selected, like 95%) and H0 is rejected if the p-value exceeds it.

The advantage to formulating inference through p-values is that anyone can formulate their personal tolerance for Type I error, determine the corresponding critical level, and re-evaluate the inference. In contexts where a variety of critical levels ought to be considered (e.g., at 0.1, 0.05, and 0.01 simultaneously), it can also be more succinct to report p-values than annotate each.

The disadvantage to this formulation is that p-values are more easily misunderstood (e.g., possible to misinterpret a p-value of 0.02 as meaning there is a 98% probability that the result is correct, when it truly means that there is a 2% probability that the estimate is 0).


Usage

There are a variety of test statistics. Most tests are designed for application in specific contexts, when certain assumptions hold. See the below pages for usage guidance:


CategoryRicottone

Statistics/TestStatistic (last edited 2025-04-08 15:28:58 by DominicRicottone)