Objectives/Goals: The goal of the NCATS CTSA Collaborative and Innovative Acceleration (CCIA) Award Initiative is to advance clinical and translational science through the collaboration, dissemination, and implementation of innovative solutions that have long-term, real-world impact. Methods/Study Population: To evaluate the real-world impacts of the CCIA Initiative, the Translational Science Benefit Model (TSBM) framework was used to create TSBM Impact Profiles for 55 CCIA awards issued between 2016 and 2022 using a secure large-language model (HHS-NIH GPT-5). Profiles were generated using data from final research performance progress reports (RPPRs) or, when those were unavailable, the most recent RPPRs in ERACommons. To guard against inaccuracies, 10% of AI-generated case studies were randomly selected and independently validated by subject matter experts. Descriptive statistics were used to summarize overall CCIA impacts. Results/Anticipated Results: A total of 49 fRPPR and 6 RPPRs were analyzed. TSBM Impact Profiles were efficiently, securely, and accurately generated using AI. Analysis showed that the CCIAs produced innovative solutions impacting all four TSBM domains and each of the nine subcategories. Evidence linked the CCIAs to 28 of the 30 TSBM benefits. The CCIAs had the greatest translational science impact in the Procedure most observed benefits were associated with improvements to Clinical Care Guidelines (25 awards), followed by Therapeutic- (23 awards) and Investigative Procedures (19 awards). Discussion/Significance of Impact: Analysis using the TSBM framework suggests that the CCIA Initiative has had wide-ranging, real-world impacts, indicative of the effective development and dissemination of innovative solutions beyond traditional scientific outputs.
Bough et al. (Wed,) studied this question.