PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
July 8, 2026Journal of Educational Measurement1 citations

Beyond a Single Coefficient: A Model‐Based Framework for Local Predictive Validity along the Score Scale

View Full Paper
VHVictoria Florenzano HernándezEAEduardo Alarcón‐BustamanteIVInés M. Varas

Key Points

  • This research aims to explore how predictive strength of admission test scores varies across different score levels and its implications for academic performance.
  • Developed a model-based framework to analyze predictive validity across score scales.
  • Used a zero/one inflated Beta regression model to account for data distribution between 0 and 1.
  • Examined first-year progress rates as the key outcome in relation to admission test scores.
  • Identified regions where test scores provide varying levels of predictive information.
  • Demonstrated the local rate of change in expected academic performance based on specific score ranges.

Abstract

Abstract Most studies on predictive validity summarize the relationship between admission test scores and academic performance using a single coefficient, such as a correlation or a linear regression slope. While informative, such summaries do not reveal how predictive strength varies across the score scale. In this article, we extend the concept of the marginal effect to the context of predictive validity, formalizing it as the local rate of change in expected academic performance given test scores. The outcome considered is the first‐year progress rate, a bounded variable between 0 and 1 that often takes values at the extremes. To respect this distributional structure, we implement a zero/one inflated Beta regression model, which simultaneously accounts for point masses at 0 and 1 and the continuous component in between. This framework enables us to examine how predictive capacity evolves across different score ranges, uncovering regions where test scores are more or less informative. By highlighting such heterogeneity, the approach provides richer insights into how admission tests function and offers valuable tools for analyzing predictive capacity and informing admission policies.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Hernández et al. (2026) studied this question.

synapsesocial.com/papers/6a4de9e4d2ea289ef6283d3bhttps://doi.org/10.1111/jedm.70052
Ask AI
Helpful
Bookmark
Share
View Full Paper