217 Advancing translational science evaluation: Validated sales to assess short- and long-term real-world impacts

Objectives/Goals: Our hub’s annual survey evaluates the impacts of our institute’s support on investigators’ research productivity and real-world impacts. We have piloted new measures to establish valid and reliable approaches to measuring short- and long-term translational science impacts of interest to the CTSAs. Methods/Study Population: SC CTSI developed an annual survey to assess our institute’s impact on investigators’ research productivity, sustained engagement in behaviors of translational scientists, and real-world impacts. In 2023, we piloted two versions of the TSBM 30-elements across four domains. In 2025, we piloted a 20-item hallmarks of a Translational Scientist scale covering collaboration, mindset, capacity building, and planning for D&I and real-world impact. After online administration to over 700 CTSI-supported USC and CHLA-affiliated researchers, data are analyzed using descriptive statistics and exploratory factor analysis, to assess factor structure, item loadings, validity, and reliability. Results/Anticipated Results: Prior analyses showed that 27/30 TSBM items aligned well with intended domains, with clinical/medical and policy benefits demonstrating strong internal consistency. Current analyses will establish the psychometric properties of the new Hallmarks of a Translational Scientist scale and sub-domains. Refinement of items and best practices will be shared. Anticipated outcomes include standardized tools for CTSA evaluators to assess short- and long-term translational science impacts. The survey aims to enable consistent measurement of translational science benefits, support longitudinal tracking, and strengthen cross-hub comparisons of real-world impact beyond research productivity. Discussion/Significance of Impact: The validated impact measures shared in this session advance translational science evaluation. Standardized items assessing translational science short- and long-term impacts are of interest to the CTSA community and any organization engaged in translational science capacity building.