The Role of Scientometric Thresholds for the Evaluation of Grant Applications
The present study focuses on data from the Russian Science Foundation (RSF). The authors analyze the effect of using quantitative indicators in grant allocation by using the natural experiment with the increasing publication threshold for principal investigators between two waves of grant selections...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Moscow Polytechnic University
2023-10-01
|
| Series: | Высшее образование в России |
| Subjects: | |
| Online Access: | https://vovr.elpub.ru/jour/article/view/4615 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832574358481010688 |
|---|---|
| author | K. S. Guba A. M. Zheleznov E. A. Chechik |
| author_facet | K. S. Guba A. M. Zheleznov E. A. Chechik |
| author_sort | K. S. Guba |
| collection | DOAJ |
| description | The present study focuses on data from the Russian Science Foundation (RSF). The authors analyze the effect of using quantitative indicators in grant allocation by using the natural experiment with the increasing publication threshold for principal investigators between two waves of grant selections in 2014 and 2017. The authors selected the relatively new RSF as our case study due to its policy to establish a publication threshold for grants’ principal investigators. The policy change provides the authors with the opportunity to study whether reliance on bibliometric indicators brings better results in the project evaluation process. This analysis included two groups of researchers: 1) physicists and 2) social sciences and humanities scholars. Scopus was sourced to collect bibliographic data, while the foundation’s website was used to check data on the funded projects. The following questions are explored in detail: whether the policy affected the distribution of funds to researchers with a better publication record, the strategies of increasing publications by individual researchers, and the differences, if any, in policy effects between disciplines. The authors found that the selection among physicists in the first wave was already effective as the grant recipients are prolific authors who publish many highly cited papers before 2014. In addition, the results indicated that the group of research leaders in physics did not significantly change between the two selected waves of competitions (from 2014 to 2017). Although social scientists demonstrated a relatively weak ability to publish internationally, the increase in scientometric expectations has improved the publication record regarding the quantity and quality of publications. |
| format | Article |
| id | doaj-art-2a37c06f08bb42d1bd97b98a3fc4a9fb |
| institution | Kabale University |
| issn | 0869-3617 2072-0459 |
| language | English |
| publishDate | 2023-10-01 |
| publisher | Moscow Polytechnic University |
| record_format | Article |
| series | Высшее образование в России |
| spelling | doaj-art-2a37c06f08bb42d1bd97b98a3fc4a9fb2025-02-01T13:14:32ZengMoscow Polytechnic UniversityВысшее образование в России0869-36172072-04592023-10-013210577510.31992/0869-3617-2023-32-10-57-752416The Role of Scientometric Thresholds for the Evaluation of Grant ApplicationsK. S. Guba0A. M. Zheleznov1E. A. Chechik2Center for Institutional Analysis of Science and Education of the European University at Saint PetersburgCenter for Institutional Analysis of Science and Education of the European University at Saint PetersburgCenter for Institutional Analysis of Science and Education of the European University at Saint PetersburgThe present study focuses on data from the Russian Science Foundation (RSF). The authors analyze the effect of using quantitative indicators in grant allocation by using the natural experiment with the increasing publication threshold for principal investigators between two waves of grant selections in 2014 and 2017. The authors selected the relatively new RSF as our case study due to its policy to establish a publication threshold for grants’ principal investigators. The policy change provides the authors with the opportunity to study whether reliance on bibliometric indicators brings better results in the project evaluation process. This analysis included two groups of researchers: 1) physicists and 2) social sciences and humanities scholars. Scopus was sourced to collect bibliographic data, while the foundation’s website was used to check data on the funded projects. The following questions are explored in detail: whether the policy affected the distribution of funds to researchers with a better publication record, the strategies of increasing publications by individual researchers, and the differences, if any, in policy effects between disciplines. The authors found that the selection among physicists in the first wave was already effective as the grant recipients are prolific authors who publish many highly cited papers before 2014. In addition, the results indicated that the group of research leaders in physics did not significantly change between the two selected waves of competitions (from 2014 to 2017). Although social scientists demonstrated a relatively weak ability to publish internationally, the increase in scientometric expectations has improved the publication record regarding the quantity and quality of publications.https://vovr.elpub.ru/jour/article/view/4615grantsresearch fundingresearch policyuniversity research funding |
| spellingShingle | K. S. Guba A. M. Zheleznov E. A. Chechik The Role of Scientometric Thresholds for the Evaluation of Grant Applications Высшее образование в России grants research funding research policy university research funding |
| title | The Role of Scientometric Thresholds for the Evaluation of Grant Applications |
| title_full | The Role of Scientometric Thresholds for the Evaluation of Grant Applications |
| title_fullStr | The Role of Scientometric Thresholds for the Evaluation of Grant Applications |
| title_full_unstemmed | The Role of Scientometric Thresholds for the Evaluation of Grant Applications |
| title_short | The Role of Scientometric Thresholds for the Evaluation of Grant Applications |
| title_sort | role of scientometric thresholds for the evaluation of grant applications |
| topic | grants research funding research policy university research funding |
| url | https://vovr.elpub.ru/jour/article/view/4615 |
| work_keys_str_mv | AT ksguba theroleofscientometricthresholdsfortheevaluationofgrantapplications AT amzheleznov theroleofscientometricthresholdsfortheevaluationofgrantapplications AT eachechik theroleofscientometricthresholdsfortheevaluationofgrantapplications AT ksguba roleofscientometricthresholdsfortheevaluationofgrantapplications AT amzheleznov roleofscientometricthresholdsfortheevaluationofgrantapplications AT eachechik roleofscientometricthresholdsfortheevaluationofgrantapplications |