Speculations on the Future of Test Design

The paper discusses the potential benefits of integrating technology, cognitive science, and psychometric theory. It is argued that even though adaptive testing, as currently implemented, is an important achievement, it will be necessary to pay close attention to the psychological foundation of tests to continue advancing the state of the art. Such an effort requires construct validation in the broadest sense, as well as focusing on items and why they differ with respect to psychometric parameters, specially difficulty. This approach opens the possibility of generating items with better control of their psychometric characteristics and ultimately the development of computer‐based tests that are solidly anchored in psychological theory.