233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program

Objectives/Goals: To identify and characterize future potentially high impact research generated by the Clinical and Translational Science Awards (CTSA) Program, we evaluated the Altmetric Attention Scores (AAS) of recent articles associated with the Program and conducted an initial assessment of th...

Full description

Saved in:
Bibliographic Details
Main Authors: Andie Vaught, Robin Wagner
Format: Article
Language:English
Published: Cambridge University Press 2025-04-01
Series:Journal of Clinical and Translational Science
Online Access:https://www.cambridge.org/core/product/identifier/S205986612400880X/type/journal_article
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850097771386765312
author Andie Vaught
Robin Wagner
author_facet Andie Vaught
Robin Wagner
author_sort Andie Vaught
collection DOAJ
description Objectives/Goals: To identify and characterize future potentially high impact research generated by the Clinical and Translational Science Awards (CTSA) Program, we evaluated the Altmetric Attention Scores (AAS) of recent articles associated with the Program and conducted an initial assessment of the attributes associated with high AAS for Program articles. Methods/Study Population: We used the NIH Query, View, Report (QVR) tool to identify recently-published scientific papers that cited support from a CTSA Program grant. The unique publications identified by QVR were used to construct an Altmetric Explorer report. We examined the relationship between the AAS and other variables, including number of authors, number of grants supporting the publication, number of CTSA program institutions supporting the publication, and if the publication included group authorship. Results/Anticipated Results: Our analyses confirmed that the Program indeed supports potentially high impact research, as indicated by the highest scoring papers, across a wide range of diseases and conditions. Nearly all the highest scoring papers were focused on a specific disease or condition rather than broader methodological research, despite the disease-agnostic focus of the CTSA program. We also found that the Program significantly contributed to critical research on the once-in-a-century COVID-19 pandemic. We confirmed the entire CTSA consortium is contributing to potentially high impact research, with all institutions represented in the highest scoring publications. Discussion/Significance of Impact: Understanding the impact of the CTSA Program presents a unique challenge – the program supports biomedical research infrastructure and training programs whose outcomes and impact can be difficult to track or measure. These data offer early signals of impact and can assist evaluators with designing future evaluations.
format Article
id doaj-art-1b8b5f3ea1e044459ca8096459ee0eff
institution DOAJ
issn 2059-8661
language English
publishDate 2025-04-01
publisher Cambridge University Press
record_format Article
series Journal of Clinical and Translational Science
spelling doaj-art-1b8b5f3ea1e044459ca8096459ee0eff2025-08-20T02:40:52ZengCambridge University PressJournal of Clinical and Translational Science2059-86612025-04-019717210.1017/cts.2024.880233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) ProgramAndie Vaught0Robin Wagner1National Center for Advancing Translational Sciences, NIHNational Center for Advancing Translational Sciences, NIHObjectives/Goals: To identify and characterize future potentially high impact research generated by the Clinical and Translational Science Awards (CTSA) Program, we evaluated the Altmetric Attention Scores (AAS) of recent articles associated with the Program and conducted an initial assessment of the attributes associated with high AAS for Program articles. Methods/Study Population: We used the NIH Query, View, Report (QVR) tool to identify recently-published scientific papers that cited support from a CTSA Program grant. The unique publications identified by QVR were used to construct an Altmetric Explorer report. We examined the relationship between the AAS and other variables, including number of authors, number of grants supporting the publication, number of CTSA program institutions supporting the publication, and if the publication included group authorship. Results/Anticipated Results: Our analyses confirmed that the Program indeed supports potentially high impact research, as indicated by the highest scoring papers, across a wide range of diseases and conditions. Nearly all the highest scoring papers were focused on a specific disease or condition rather than broader methodological research, despite the disease-agnostic focus of the CTSA program. We also found that the Program significantly contributed to critical research on the once-in-a-century COVID-19 pandemic. We confirmed the entire CTSA consortium is contributing to potentially high impact research, with all institutions represented in the highest scoring publications. Discussion/Significance of Impact: Understanding the impact of the CTSA Program presents a unique challenge – the program supports biomedical research infrastructure and training programs whose outcomes and impact can be difficult to track or measure. These data offer early signals of impact and can assist evaluators with designing future evaluations. https://www.cambridge.org/core/product/identifier/S205986612400880X/type/journal_article
spellingShingle Andie Vaught
Robin Wagner
233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program
Journal of Clinical and Translational Science
title 233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program
title_full 233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program
title_fullStr 233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program
title_full_unstemmed 233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program
title_short 233 Beyond bibliometrics: Altmetric analysis as an early signal of the impact of the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Awards (CTSA) Program
title_sort 233 beyond bibliometrics altmetric analysis as an early signal of the impact of the national center for advancing translational sciences ncats clinical and translational science awards ctsa program
url https://www.cambridge.org/core/product/identifier/S205986612400880X/type/journal_article
work_keys_str_mv AT andievaught 233beyondbibliometricsaltmetricanalysisasanearlysignaloftheimpactofthenationalcenterforadvancingtranslationalsciencesncatsclinicalandtranslationalscienceawardsctsaprogram
AT robinwagner 233beyondbibliometricsaltmetricanalysisasanearlysignaloftheimpactofthenationalcenterforadvancingtranslationalsciencesncatsclinicalandtranslationalscienceawardsctsaprogram