Archives
-
A Score-Based Method for Detecting Item Compromise and Preknowledge in Computerized Adaptive Testing
Vol. 12 No. 2 (2025)In recent years, several methods have been proposed to detect compromised items (CI) and examinees with preknowledge (EWP) simultaneously. However, most of these methods are limited in one of two ways: (1) The method was specifically designed for non-adaptive tests and might therefore not be suitable for adaptive tests, or (2) the method involves the analysis of more than just the item scores. In this paper, a new method is developed for computerized adaptive tests that requires only an analysis of the item scores. The perfor-mance of the method is evaluated using simulations in which several factors are manip-ulated, such as test length, the percentage of CI, the percentage of EWP, and EWP ability distribution. Across most conditions, the method is shown to produce reasonable false positive rates and favorable true positive rates for both items and examinees.
-
The Influence of Computerized Adaptive Testing on Psychometric Theory and Practice
Vol. 11 No. 1 (2024)The major premise of this article is that part of the stimulus for the evolution of psychometric theory since the 1950s was the introduction of the concept of computerized adaptive testing (CAT) or its earlier non-CAT variations. The conceptual underpinnings of CAT that had the most influence on psychometric theory was the shift of emphasis from the test (or test score) as the focus of analysis to the test item (or item score). The change in focus allowed a change in the way that test results are conceived of as measurements. It also resolved the conflict among a number of ideas that were present in the early work on psychometric theory. Some of the conflicting ideas are summarized below to show how work on the development of CAT resolved some of those conflicts.
-
Expanding the Meaning of Adaptive Testing to Enhance Validity
Vol. 10 No. 2 (2023) -
An Extended Taxonomy of Variants of Computerized Adaptive Testing
Vol. 10 No. 1 (2023) -
The (non)Impact of Misfitting Items in Computerized Adaptive Testing
Vol. 9 No. 2 (2022) -
Improving Precision of CAT Measures
Vol. 9 No. 1 (2022)This paper was the author’s presidential address at the 2015 conference of the International Association for Computerized Adaptive Testing.
-
Three Measures of Test Adaptation Based on Optimal Test Information
Vol. 8 No. 1 (2020) -
Time-Efficient Adaptive Measurement of Change
Vol. 7 No. 2 (2019) -
How Adaptive Is an Adaptive Test: Are All Adaptive Tests Adaptive?
Vol. 7 No. 1 (2019) -
Implementing Three CATs Within Eighteen Months
Vol. 6 No. 3 (2018) -
Adaptive Item Selection Under Matroid Constraints
Vol. 6 No. 2 (2018) -
Latent-Class-Based Item Selection for Computerized Adaptive Progress Tests
Vol. 5 No. 2 (2017) -
Implementing a CAT: The AMC experience
Vol. 3 No. 1 (2015)