[en] In this paper, the estimation of extremely large or extremely small proficiency levels, given
the item parameters of a logistic item response model, is investigated. On the one hand, the
estimation of proficiency levels by maximum likelihood (ML), despite being asymptotically
unbiased, may yield infinite estimates. On the other hand, with an appropriate prior
distribution, the Bayesian approach of maximum a posteriori (MAP) yields finite estimates,
but it suffers from severe estimation bias at the extremes of the proficiency scale. In a first
step, we propose a simple correction to the MAP estimator in order to reduce this estimation
bias. The correction factor is determined through a simulation study and depends only on the
length of the test. In a second step, some additional simulations highlight that the corrected
estimator behaves like the ML estimator and outperforms the standard MAP method for
extremely small or extremely large abilities. Although based on the Rasch model, the method
could be adapted to other logistic item response models.
Disciplines :
Mathematics
Author, co-author :
Magis, David ; Université de Liège - ULiège > Département de mathématique > Statistique mathématique
Béland, Sébastien; Université du Québec à Montréal > Education et pédagogie
Raîche, Gilles; Université du Québec à Montréal > Education et pédagogie
Language :
English
Title :
A test-length correction to the estimation of extreme proficiency levels
Alternative titles :
[fr] Une correction de l'estimation des niveaux d'habileté extrêmes selon la longueur du test
scite shows how a scientific paper has been cited by providing the context of the citation, a classification describing whether it supports, mentions, or contrasts the cited claim, and a label indicating in which section the citation was made.
Bibliography
Andersen, E.B. (1970). Asymptotic properties of conditional maximum likelihood estimators. Journal of the Royal Statistical Society (Series B), 32, 283-301.
Andersen, E.B. (1972). The numerical solution of a set of conditional estimation equations. Journal of the Royal Statistical Society (Series B), 34, 42-54.
Baker, F.B. (1992). Item response theory: Parameter estimation techniques. New York, NY: Marcel Dekker.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397-479). Reading, MA: Addison-Wesley.
Bock, R.D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters. An application of the EM algorithm. Psychometrika, 37, 29-51.
Bock, R.D., & Mislevy, R.J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431-444.
Carlin, B.P., & Louis, T.A. (1996). Bayes and empirical Bayes methods for data analysis. London, England: Chapman & Hall.
Chang, H.H., & Ying, Z. (2008). To weight or not to weight? Balancing influence of initial items in adaptive testing. Psychometrika, 73, 441-450.
Cramer, H. (1946). Mathematical models for statistics. Princeton, NJ: Princeton University Press.
Firth, D. (1993). Bias reduction of maximum likelihood estimates [Correction: 82, 667]. Biometrika, 80, 27-38.
Gelman, A., Carlin, J.B., Stern, H.S., & Rubin, D.B. (2004). Bayesian data analysis (2nd ed.). New York, NY: Chapman & Hall.
Hambleton, R.K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer.
Lord, F.M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
Lord, F.M. (1983). Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability. Psychometrika, 48, 233-245.
Lord, F.M. (1986). Maximum likelihood and Bayesian parameter estimation in item response theory. Journal of Educational Measurement, 23, 157-162.
Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
Magis, D., & Raîche, G. (2010). An iterative maximum a posteriori estimation of proficiency level to detect multiple local likelihood maxima. Applied Psychological Measurement, 34, 75-90.
R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.
Rizopoulos, D. (2006). Ltm: An R package for latent variable modeling and item response theory analyses. Journal of Statistical Software, 17, 1-25.
Rulison, K.L., & Loken, E. (2009). I've fallen and I can't get up: Can high-ability students recover from early mistakes in CAT? Applied Psychological Measurement, 33, 83-101.
Samejima, F. (1973). A comment on Birnbaum's three-parameter logistic model in the latent trait theory. Psychometrika, 38, 221-223.
Samejima, F. (1977). Weakly parallel tests in latent trait theory with some criticisms of classical test theory. Psychometrika, 42, 193-198.
Samejima, F. (1993). An approximation for the bias function of the maximum likelihood estimate of a latent variable for the general case where the item responses are discrete. Psychometrika, 58, 119-138.
Samejima, F. (1998, April). Expansion of Warm's weighted likelihood estimator of ability for the three-parameter logistic model to general discrete responses. Paper presented at the annual meeting of the national Council on Measurement in Education, San Diego, CA.
Swaminathan, H., & Gifford, J.A. (1985). Bayesian estimation in the two-parameter logistic model. Psychometrika, 50, 349-364.
Swaminathan, H., & Gifford, J.A. (1986). Bayesian estimation in the three-parameter logistic model. Psychometrika, 51, 589-601.
Tukey, J. (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
Wang, T., Hanson, B.A., & Lau, C.-M.A. (1999). Reducing bias in CT trait estimation: A comparison of approaches. Applied Psychological Measurement, 23, 263-278.
Warm, T.A. (1989). Weighted likelihood estimation of in item response theory. Psychometrika, 54, 427-450.
Similar publications
Sorry the service is unavailable at the moment. Please try again later.
This website uses cookies to improve user experience. Read more
Save & Close
Accept all
Decline all
Show detailsHide details
Cookie declaration
About cookies
Strictly necessary
Performance
Strictly necessary cookies allow core website functionality such as user login and account management. The website cannot be used properly without strictly necessary cookies.
This cookie is used by Cookie-Script.com service to remember visitor cookie consent preferences. It is necessary for Cookie-Script.com cookie banner to work properly.
Performance cookies are used to see how visitors use the website, eg. analytics cookies. Those cookies cannot be used to directly identify a certain visitor.
Used to store the attribution information, the referrer initially used to visit the website
Cookies are small text files that are placed on your computer by websites that you visit. Websites use cookies to help users navigate efficiently and perform certain functions. Cookies that are required for the website to operate properly are allowed to be set without your permission. All other cookies need to be approved before they can be set in the browser.
You can change your consent to cookie usage at any time on our Privacy Policy page.