When the Psychometrics of Test Development Meets Organizational Realities: A Conceptual Framework for Organizational Change, Examples, and Recommendations

Our standards for the construction of psychological tests give scant attention to the organizational context in which the tests are to be used. This paper describes 10 Psychometric issues associated with the development of an electrical job knowledge test. The test was designed to replace seniority as a means of making promotional decisions within an organization. The 10 test‐related issues are presented as a means to understand the underlying process of organizational change associated with the implementation of the new test. It is suggested that a closer link between the science and practice of our profession can be attained by achieving a greater understanding of issues associated with the practical implementation of theory‐based interventions.