Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches
This scoping review systematically examines the evolution of research impact assessment frameworks, categorising their development into 4 generations. The study follows Arksey and O’Malley’s (2005) scoping review methodology, enhanced by Levac et al. (2010) and aligned with PRISMA-ScR guidelines. A...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National Taiwan University
2025-06-01
|
| Series: | Journal of Library and Information Studies |
| Subjects: | |
| Online Access: | https://jlis.lis.ntu.edu.tw/files/journal/j60-1.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849468021436841984 |
|---|---|
| author | Mudassar Arsalan Omar Mubin Abdullah Al Mahmud |
| author_facet | Mudassar Arsalan Omar Mubin Abdullah Al Mahmud |
| author_sort | Mudassar Arsalan |
| collection | DOAJ |
| description | This scoping review systematically examines the evolution of research impact assessment frameworks, categorising their development into 4 generations. The study follows Arksey and O’Malley’s (2005) scoping review methodology, enhanced by Levac et al. (2010) and aligned with PRISMA-ScR guidelines. A comprehensive search was conducted across Scopus, Web of Science, PubMed, IEEE Xplore, and Google Scholar, as well as grey literature, to identify relevant studies on research impact frameworks, metrics, and methodologies. A total of 139 studies were selected based on predefined inclusion criteria, encompassing bibliometric indices, multidimensional frameworks, predictive analytics, and alternative metrics.
The findings highlight the transition from traditional citation-based measures to sophisticated, data-driven methodologies. The first generation (bibliometric indices) included 26 key metrics focusing on publication productivity. The second generation introduced 41 multidimensional frameworks incorporating societal, economic, and policy indicators. The third-generation integrated machine learning and predictive analytics to assess impact across 17 aspects and 9 data-driven factors. The fourth generation utilised 16 alternative metrics, including Altmetric Attention Scores and PlumX Metrics, to capture real-time digital engagement.
Key challenges identified include limited standardisation, regional biases, and the under-exploitation of emerging technologies, such as large language models. The study underscores the need for predictive multidimensional frameworks and standardised taxonomies to enhance scalability and foresight in impact assessment. By structuring the evolution of research impact science, this review provides actionable insights to refine assessment methodologies, ensuring their relevance for addressing societal challenges and guiding strategic research investments. |
| format | Article |
| id | doaj-art-0e4a58df8f63427fbfb0e771729d9c4b |
| institution | Kabale University |
| issn | 1606-7509 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | National Taiwan University |
| record_format | Article |
| series | Journal of Library and Information Studies |
| spelling | doaj-art-0e4a58df8f63427fbfb0e771729d9c4b2025-08-20T03:25:59ZengNational Taiwan UniversityJournal of Library and Information Studies1606-75092025-06-0123117710.6182/jlis.202506_23(1).001Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive ApproachesMudassar Arsalan0https://orcid.org/0000-0001-9622-5930Omar Mubin1https://orcid.org/0000-0002-6435-6407Abdullah Al Mahmud2https://orcid.org/0000-0002-2801-723XSchool of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, AustraliaSchool of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, AustraliaCentre for Design Innovation, Swinburne University of Technology, Melbourne, AustraliaThis scoping review systematically examines the evolution of research impact assessment frameworks, categorising their development into 4 generations. The study follows Arksey and O’Malley’s (2005) scoping review methodology, enhanced by Levac et al. (2010) and aligned with PRISMA-ScR guidelines. A comprehensive search was conducted across Scopus, Web of Science, PubMed, IEEE Xplore, and Google Scholar, as well as grey literature, to identify relevant studies on research impact frameworks, metrics, and methodologies. A total of 139 studies were selected based on predefined inclusion criteria, encompassing bibliometric indices, multidimensional frameworks, predictive analytics, and alternative metrics. The findings highlight the transition from traditional citation-based measures to sophisticated, data-driven methodologies. The first generation (bibliometric indices) included 26 key metrics focusing on publication productivity. The second generation introduced 41 multidimensional frameworks incorporating societal, economic, and policy indicators. The third-generation integrated machine learning and predictive analytics to assess impact across 17 aspects and 9 data-driven factors. The fourth generation utilised 16 alternative metrics, including Altmetric Attention Scores and PlumX Metrics, to capture real-time digital engagement. Key challenges identified include limited standardisation, regional biases, and the under-exploitation of emerging technologies, such as large language models. The study underscores the need for predictive multidimensional frameworks and standardised taxonomies to enhance scalability and foresight in impact assessment. By structuring the evolution of research impact science, this review provides actionable insights to refine assessment methodologies, ensuring their relevance for addressing societal challenges and guiding strategic research investments.https://jlis.lis.ntu.edu.tw/files/journal/j60-1.pdfresearch impact assessmentgenerational frameworksbibliometric metricsmultidimensional modelspredictive analytics |
| spellingShingle | Mudassar Arsalan Omar Mubin Abdullah Al Mahmud Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches Journal of Library and Information Studies research impact assessment generational frameworks bibliometric metrics multidimensional models predictive analytics |
| title | Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches |
| title_full | Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches |
| title_fullStr | Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches |
| title_full_unstemmed | Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches |
| title_short | Mapping the Generations of Research Impact Science: A Scoping Review of Metrics, Frameworks, and Predictive Approaches |
| title_sort | mapping the generations of research impact science a scoping review of metrics frameworks and predictive approaches |
| topic | research impact assessment generational frameworks bibliometric metrics multidimensional models predictive analytics |
| url | https://jlis.lis.ntu.edu.tw/files/journal/j60-1.pdf |
| work_keys_str_mv | AT mudassararsalan mappingthegenerationsofresearchimpactscienceascopingreviewofmetricsframeworksandpredictiveapproaches AT omarmubin mappingthegenerationsofresearchimpactscienceascopingreviewofmetricsframeworksandpredictiveapproaches AT abdullahalmahmud mappingthegenerationsofresearchimpactscienceascopingreviewofmetricsframeworksandpredictiveapproaches |