Computerized adaptive testing with R: Recent updates of the package catR

Magis, David; Barrada, Juan Ramon

doi:10.18637/jss.v076.c01

Download

Article (Scientific journals)

Computerized adaptive testing with R: Recent updates of the package catR

Magis, David; Barrada, Juan Ramon

2017 • In Journal of Statistical Software, 76 (1), p. 1-19

Peer Reviewed verified by ORBi

Permalink
https://hdl.handle.net/2268/192875

DOI
10.18637/jss.v076.c01

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

Journal of Statistical Software 76 (2017), 1-19.pdf

Publisher postprint (481.8 kB)

Download

All documents in ORBi are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

Computerized adaptive testing; polytomous IRT models,; post-hoc simulations,; R package

Abstract :

[en] The purpose of this paper is to list the recent updates of the R package catR. This package allows for generating response patterns under a computerized adaptive testing (CAT) framework with underlying item response theory (IRT) models. Among the most important updates, well-known polytomous IRT models are now supported by catR; several item selection rules have been added; and it is now possible to perform post-hoc simulations. Some functions were also rewritten or withdrawn to improve the usefulness and performances of the package.

Disciplines :

Education & instruction

Author, co-author :

Magis, David ; Université de Liège > Département des Sciences de l'éducation > Psychométrie et édumétrie

Barrada, Juan Ramon

Language :

English

Title :

Computerized adaptive testing with R: Recent updates of the package catR

Publication date :

2017

Journal title :

Journal of Statistical Software

ISSN :

1548-7660

Publisher :

University of California at Los Angeles, Los Angeles, United States - California

Volume :

Issue :

Pages :

1-19

Peer reviewed :

Peer Reviewed verified by ORBi

Available on ORBi :

since 04 February 2016

Statistics

Number of views

595 (1 by ULiège)

Number of downloads

623 (0 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

Bibliography

Andrich D (1978a). “Application of a Psychometric Model to Ordered Categories Which Are Scored with Successive Integers.” Applied Psychological Measurement, 2(4), 581–594. doi:10.1177/014662167800200413.
Andrich D (1978b). “A Rating Formulation for Ordered Response Categories.” Psychometrika, 43(4), 561–573. doi:10.1007/bf02293814.
Barrada JR, Abad FJ, Veldkamp BP (2009a). “Comparison of Methods for Controlling Maximum Exposure Rates in Computerized Adaptive Testing.” Psicothema, 21(2), 313– 320.
Barrada JR, Olea J, Ponsoda V, Abad FJ (2008). “Incorporating Randomness to the Fisher Information for Improving Item Exposure Control in CATS.” British Journal of Mathematical and Statistical Psychology, 61(2), 493–513. doi:10.1348/000711007x230937.
Barrada JR, Olea J, Ponsoda V, Abad FJ (2009b). “Item Selection Rules in Computerized Adaptive Testing: Accuracy and Security.” Methodology, 5(1), 7–17. doi: 10.1027/1614-2241.5.1.7.
Bock RD (1972). “Estimating Item Parameters and Latent Ability When Responses Are Scored in Two or More Nominal Categories.” Psychometrika, 37(1), 29–51. doi:10.1007/ bf02291411.
Chalmers RP (2016). “Generating Adaptive and Non-Adaptive Test Interfaces for Multidimensional Item Response Theory Applications.” Journal of Statistical Software, 71(5), 1–39. doi:10.18637/jss.v071.i05.
Chang HH, Ying Z (1996). “A Global Information Approach to Computerized Adaptive Testing.” Applied Psychological Measurement, 20(3), 213–229. doi:10.1177/ 014662169602000303.
Cheng Y (2009). “When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT.” Psychometrika, 74(4), 619–632. doi:10.1007/s11336-009-9123-2.
Embretson SE, Reise SP (2000). Item Response Theory for Psychologists. Lawrence Erlbaum Associates, Mahwah.
Fischer HF, Klug C, Roeper K, Blozik E, Edelmann F, Eisele M, Stor S, Wachter R, Scherer M, Rose M, Herrmann-Lingen C (2014). “Screening for Mental Disorders in Heart Failure Patients Using Computer-Adaptive Tests.” Quality of Life Research, 23(5), 1609–1618. doi:10.1007/s11136-013-0599-y.
Gibbons RD, Weiss DJ, Kupfer DJ, Frank E, Fagiolini A, Grochocinsk VJ, Bhaumik DK, Stover A, Bock RD, Immekus JC (2008). “Using Computerized Adaptive Testing to Reduce the Burden of Mental Health Assessment.” Psychiatric Services, 59(4), 361–368. doi: 10.1176/appi.ps.59.4.361.
Kaplan M, de la Torre J, Barrada JR (2015). “New Item Selection Methods for Cognitive Diagnosis Computerized Adaptive Testing.” Applied Psychological Measurement, 39(3), 167–188. doi:10.1177/0146621614554650.
Kosinski M, Lis P, Mahalingam V, Kielczewski B, Okubo T, Stillwell D, Sun L, Rust J (2013). Concerto – Open-Source Online R-Based Adaptive Testing Platfrom (Version 4). The Psychometrics Centre, Cambridge. URL http://www.psychometrics.cam.ac.uk/newconcerto.
Li YH, Schafer WD (2005). “Increasing the Homogeneity of CAT’s Item-Exposure Rates by Minimizing or Maximizing Varied Target Functions While Assembling Shadow Tests.” Journal of Educational Measurement, 42(3), 245–269. doi:10.1111/j.1745-3984.2005. 00013.x.
Maechler M, et al. (2016). sfsmisc: Utilities from “Seminar für Statistik”, ETH Zurich. R package version 1.1-0, URL https://CRAN.R-project.org/package=sfsmisc.
Magis D (2013). “A Note on the Item Information Function of the Four-Parameter Logistic Model.” Applied Psychological Measurement, 37(4), 304–315. doi:10.1177/ 0146621613475471.
Magis D, Raîche G (2012). “Random Generation of Response Patterns under Computerized Adaptive Testing with the R Package catR.” Journal of Statistical Software, 48(8), 1–31. doi:10.18637/jss.v048.i08.
Masters GN (1982). “A Rasch Model for Partial Credit Scoring.” Psychometrika, 47(2), 149–174. doi:10.1007/bf02296272.
McClarty KL, Sperling RA, Dodd BG (2006). “A Variant of the Progressive-Restricted Item Exposure Control Procedure in Computerized Adaptive Testing Systems Based on the 3PL and Partial Credit Models.” Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco.
Muraki E (1990). “Fitting a Polytomous Item Response Model to Likert-Type Data.” Applied Psychological Measurement, 14(1), 59–71. doi:10.1177/014662169001400106.
Muraki E (1992). “A Generalized Partial Credit Model: Application of an EM Algorithm.” Applied Psychological Measurement, 16(2), 159–176. doi:10.1177/014662169201600206.
Olea J, Barrada JR, Abad FJ, Ponsoda V, Cuevas L (2012). “Computerized Adaptive Testing: The Capitalization on Chance Problem.” Spanish Journal of Psychology, 15(1), 424–441. doi:10.5209/rev_sjop.2012.v15.n1.37348.
R Core Team (2016). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
Reckase M (2009). Multidimensional Item Response Theory. Springer-Verlag.
Revuelta J, Ponsoda V (1998). “A Comparison of Item Exposure Control Methods in Computerized Adaptive Testing.” Journal of Educational Measurement, 35(4), 311–327. doi: 10.1111/j.1745-3984.1998.tb00541.x.
Samejima F (1969). “Estimation of Latent Ability Using a Response Pattern of Graded Scores.” Psychometrika Monograph, 34(Supplement 1), 1–97. doi:10.1007/bf03372160.
Samejima F (1996). “The Graded Response Model.” In WJ van der Linden, RK Hambleton (eds.), Handbook of Modern Item Response Theory, pp. 85–100. Springer-Verlag.
Segall DO (2004). “A Sharing Item Response Theory Model for Computerized Adaptive Testing.” Journal of Educational and Behavioral Statistics, 29(4), 439–460. doi:10.3102/ 10769986029004439.
Thissen D, Steinberg L (1986). “A Taxonomy of Item Response Models.” Psychometrika, 51(4), 567–577. doi:10.1007/bf02295596.
Urry VW (1970). A Monte Carlo Investigation of Logistic Test Models. Unpublished doctoral dissertation, Purdue University, West Lafayette.
van der Linden WJ, Glas CAW (2000). “Capitalization on Item Calibration Error in Adaptive Testing.” Applied Measurement in Education, 13(1), 35–53. doi:10.1207/ s15324818ame1301_2.
van der Linden WJ, Glas CAW (2010). Elements of Adaptive Testing. Springer-Verlag. doi:10.1007/978-0-387-85461-8.
van der Linden WJ, Pashley PJ (2010). “Item Selection and Ability Estimation in Adaptive Testing.” In WJ van der Linden, CAW Glas (eds.), Elements of Adaptive Testing, pp. 3–30. Springer-Verlag. doi:10.1007/978-0-387-85461-8_1.
van der Linden WJ, Veldkamp BP (2004). “Constraining Item Exposure in Computerized Adaptive Testing with Shadow Tests.” Journal of Educational and Behavioral Statistics, 29(3), 273–291. doi:10.3102/10769986029003273.
Wainer H (2000). Computerized Adaptive Testing: A Primer. 2nd edition. Lawrence Erlbaum, Mahwah. doi:10.4324/9781410605931.
Wainer H, Bradlow ET, Wang X (2009). Testlet Response Theory and Its Applications. Cambridge University Press, Cambridge.