157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts
Objectives/Goals: To support the growing number of clinical research professionals (CRP) working in behavioral and social science contexts, relevant formative assessments of research skills are needed. This study examines the development of an objective formative assessment designed to assess skills...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2025-04-01
|
| Series: | Journal of Clinical and Translational Science |
| Online Access: | https://www.cambridge.org/core/product/identifier/S205986612400815X/type/journal_article |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850097910997319680 |
|---|---|
| author | Phillip Ianni Brenda L. Eakin Angela K. Lyden Jennifer A. Miner Reema Kadri Mary R. Janevic Sheria G. Robinson-Lane Susan L. Murphy |
| author_facet | Phillip Ianni Brenda L. Eakin Angela K. Lyden Jennifer A. Miner Reema Kadri Mary R. Janevic Sheria G. Robinson-Lane Susan L. Murphy |
| author_sort | Phillip Ianni |
| collection | DOAJ |
| description | Objectives/Goals: To support the growing number of clinical research professionals (CRP) working in behavioral and social science contexts, relevant formative assessments of research skills are needed. This study examines the development of an objective formative assessment designed to assess skills relevant to conducting social and behavioral research. Methods/Study Population: A multidisciplinary group at the University of Michigan was convened to develop the assessment. Case studies depicting clinical and translational research conducted in behavioral and social science contexts were used to measure proficiency in seven of the eight ECRPTQ competencies: Scientific Concepts & Research Design, Ethical & Participant Safety Concerns, Clinical Trial Operations (Good Clinical Practice), Study & Site Management, Data Management & Informatics, Leadership & Professionalism, Communication, and Teamwork & Team Science. Three difficulty levels of questions were developed: basic, intermediate, and advanced. To reinforce knowledge and skill development, the assessment was designed to give respondents formative feedback after responding to each question. Results/Anticipated Results: A preliminary “pre-pilot” test was conducted with three postdoctoral scholars to ensure that the assessment items were understandable. The assessment was then pilot tested with a larger group of 40 clinical research professionals (CRP) to test for the clarity and difficulty level of the items. A smaller group of 20 of these CRPs agreed to participate in focus groups to obtain feedback on their user experience. Data regarding years of experience as a CRP, types of studies engaged with, and information regarding professional certification were collected and used in the analyses. Demographic data collected were not connected to user responses. Results of the pilot test and focus groups were used to revise the questions on the final version of the assessment. Discussion/Significance of Impact: To our knowledge, this is the first objective assessment of research skills for CRP working in behavioral and social science contexts. We will discuss how other institutions can use this instrument to evaluate the training needs of their social and behavioral research workforce. |
| format | Article |
| id | doaj-art-e7f889b2694a439eb6af136177bcd4e0 |
| institution | DOAJ |
| issn | 2059-8661 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | Journal of Clinical and Translational Science |
| spelling | doaj-art-e7f889b2694a439eb6af136177bcd4e02025-08-20T02:40:51ZengCambridge University PressJournal of Clinical and Translational Science2059-86612025-04-019474710.1017/cts.2024.815157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contextsPhillip Ianni0Brenda L. Eakin1Angela K. Lyden2Jennifer A. Miner3Reema Kadri4Mary R. Janevic5Sheria G. Robinson-Lane6Susan L. Murphy7University of MichiganUniversity of MichiganUniversity of MichiganUniversity of MichiganUniversity of MichiganUniversity of MichiganUniversity of MichiganUniversity of MichiganObjectives/Goals: To support the growing number of clinical research professionals (CRP) working in behavioral and social science contexts, relevant formative assessments of research skills are needed. This study examines the development of an objective formative assessment designed to assess skills relevant to conducting social and behavioral research. Methods/Study Population: A multidisciplinary group at the University of Michigan was convened to develop the assessment. Case studies depicting clinical and translational research conducted in behavioral and social science contexts were used to measure proficiency in seven of the eight ECRPTQ competencies: Scientific Concepts & Research Design, Ethical & Participant Safety Concerns, Clinical Trial Operations (Good Clinical Practice), Study & Site Management, Data Management & Informatics, Leadership & Professionalism, Communication, and Teamwork & Team Science. Three difficulty levels of questions were developed: basic, intermediate, and advanced. To reinforce knowledge and skill development, the assessment was designed to give respondents formative feedback after responding to each question. Results/Anticipated Results: A preliminary “pre-pilot” test was conducted with three postdoctoral scholars to ensure that the assessment items were understandable. The assessment was then pilot tested with a larger group of 40 clinical research professionals (CRP) to test for the clarity and difficulty level of the items. A smaller group of 20 of these CRPs agreed to participate in focus groups to obtain feedback on their user experience. Data regarding years of experience as a CRP, types of studies engaged with, and information regarding professional certification were collected and used in the analyses. Demographic data collected were not connected to user responses. Results of the pilot test and focus groups were used to revise the questions on the final version of the assessment. Discussion/Significance of Impact: To our knowledge, this is the first objective assessment of research skills for CRP working in behavioral and social science contexts. We will discuss how other institutions can use this instrument to evaluate the training needs of their social and behavioral research workforce.https://www.cambridge.org/core/product/identifier/S205986612400815X/type/journal_article |
| spellingShingle | Phillip Ianni Brenda L. Eakin Angela K. Lyden Jennifer A. Miner Reema Kadri Mary R. Janevic Sheria G. Robinson-Lane Susan L. Murphy 157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts Journal of Clinical and Translational Science |
| title | 157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts |
| title_full | 157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts |
| title_fullStr | 157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts |
| title_full_unstemmed | 157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts |
| title_short | 157 Development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts |
| title_sort | 157 development of a skills assessment for the formative evaluation of clinical research professionals working in behavioral and social science research contexts |
| url | https://www.cambridge.org/core/product/identifier/S205986612400815X/type/journal_article |
| work_keys_str_mv | AT phillipianni 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT brendaleakin 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT angelaklyden 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT jenniferaminer 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT reemakadri 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT maryrjanevic 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT sheriagrobinsonlane 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts AT susanlmurphy 157developmentofaskillsassessmentfortheformativeevaluationofclinicalresearchprofessionalsworkinginbehavioralandsocialscienceresearchcontexts |