What question did this study set out to answer?

The aim is to establish valid and reliable measures for assessing the impacts of translational science on research productivity and real-world outcomes.

May 9, 2026Open Access

217 Advancing translational science evaluation: Validated sales to assess short- and long-term real-world impacts

Key Points

The aim is to establish valid and reliable measures for assessing the impacts of translational science on research productivity and real-world outcomes.
Developed an annual survey for CTSI-supported researchers to assess impacts on productivity and translation behaviors.
Piloted versions of TSBM and Hallmarks of a Translational Scientist scale across various domains.
Analyzed data from over 700 researchers using descriptive statistics and exploratory factor analysis to determine validity and reliability.
27 out of 30 TSBM items aligned well with intended domains with strong internal consistency.
Current analyses will validate the psychometric properties of the Hallmarks of a Translational Scientist scale.
The anticipated outcome includes standardized assessment tools for short- and long-term translational science impacts.

Abstract

Objectives/Goals: Our hub’s annual survey evaluates the impacts of our institute’s support on investigators’ research productivity and real-world impacts. We have piloted new measures to establish valid and reliable approaches to measuring short- and long-term translational science impacts of interest to the CTSAs. Methods/Study Population: SC CTSI developed an annual survey to assess our institute’s impact on investigators’ research productivity, sustained engagement in behaviors of translational scientists, and real-world impacts. In 2023, we piloted two versions of the TSBM 30-elements across four domains. In 2025, we piloted a 20-item hallmarks of a Translational Scientist scale covering collaboration, mindset, capacity building, and planning for D&I and real-world impact. After online administration to over 700 CTSI-supported USC and CHLA-affiliated researchers, data are analyzed using descriptive statistics and exploratory factor analysis, to assess factor structure, item loadings, validity, and reliability. Results/Anticipated Results: Prior analyses showed that 27/30 TSBM items aligned well with intended domains, with clinical/medical and policy benefits demonstrating strong internal consistency. Current analyses will establish the psychometric properties of the new Hallmarks of a Translational Scientist scale and sub-domains. Refinement of items and best practices will be shared. Anticipated outcomes include standardized tools for CTSA evaluators to assess short- and long-term translational science impacts. The survey aims to enable consistent measurement of translational science benefits, support longitudinal tracking, and strengthen cross-hub comparisons of real-world impact beyond research productivity. Discussion/Significance of Impact: The validated impact measures shared in this session advance translational science evaluation. Standardized items assessing translational science short- and long-term impacts are of interest to the CTSA community and any organization engaged in translational science capacity building.

Bookmark

View Full Paper