PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
December 19, 2025International Journal of Selection and Assessment3 citationsOpen Access

Validity at Risk? the Future of Generative AI Use by Candidates in Assessments

View Full Paper
DHDjurre HoltropRBRoderick Bronzwaer

Key Points

  • This commentary evaluates the implications of candidate use of Generative AI for construct- and criterion-related validity.
  • Critically assess existing scenarios of Generative AI use from Lievens and Dunlop (2024)
  • Propose experimental paradigms to analyze the impact of Generative AI as an impersonator or assistant.
  • Examine the effects of increased accessibility of Generative AI on assessment outcomes.
  • Generative AI use may weaken the diagnostic value of assessments due to its accessibility.
  • The speed of technological development in Generative AI may impact validity perception.
  • There is a need to rethink definitions and measurements of psychological constructs in light of Generative AI.

Abstract

ABSTRACT In this commentary on Lievens and Dunlop (2024), we critically evaluate the implications of candidate GenAI use from the perspectives of criterion‐ and construct‐related validity. While the focal article provides valuable scenarios for understanding the role of GenAI use by candidates, we argue it may underestimate the speed of technological development and overstate the generalizability of augmentation across all job types. By considering increasing GenAI accessibility, we highlight how ease of use may weaken the diagnostic value of GenAI‐related variance in assessments. Furthermore, we propose experimental paradigms to empirically investigate the impact of GenAI on criterion‐ and construct‐related validity by framing GenAI as either an impersonator or an assistant. Finally, we reflect on a future where GenAI agents may challenge existing conceptions of construct validity, calling for a rethinking of the way we define and measure psychological constructs in the age of AI.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Holtrop et al. (2025) studied this question.

synapsesocial.com/papers/69449a892f0218eca95084f0https://doi.org/10.1111/ijsa.70035
Ask AI
Helpful
Bookmark
Share
View Full Paper