Med Library . org

Open Source Encyclopedia

Freedman's paradox

Welcome to MedLibrary.org. For best results, we recommend beginning with the navigation links at the top of the page, which can guide you through our collection of over 14,000 medication labels and package inserts. For additional information on other topics which are not covered by our database of medications, just enter your topic in the search box below:

In statistical analysis, Freedman's paradox,[1] named after David Freedman, describes a problem in model selection whereby predictor variables with no explanatory power can appear artificially important. Freedman demonstrated (through simulation and asymptotic calculation) that this is a common occurrence when the number of variables is similar to the number of data points. Recently, new information-theoretic estimators have been developed in an attempt to reduce this problem,[2] in addition to the accompanying issue of model selection bias,[3] whereby estimators of predictor variables that have a weak relationship with the response variable are biased.

References

  1. ^ Freedman, D. A. (1983) "A note on screening regression equations." The American Statistician, 37, 152–155.
  2. ^ Lukacs, P. M., Burnham, K. P. & Anderson, D. R. (2009) "Model selection bias and Freedman's paradox." Annals of the Institute of Statistical Mathematics, 62(1), 117–125 doi:10.1007/s10463-009-0234-4
  3. ^ Burnham, K. P., & Anderson, D. R. (2002). Model Selection and Multimodel Inference: A Practical-Theoretic Approach, 2nd ed. Springer-Verlag.