A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure
Abstract Background Few implementation science (IS) measures have been evaluated for validity, reliability and utility – the latter referring to whether a measure captures meaningful aspects of implementation contexts. We present a real-world case study of rigorous measure development in IS that ass...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2024-11-01
|
| Series: | BMC Health Services Research |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12913-024-11783-6 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846172182768517120 |
|---|---|
| author | Lawrence H. Yang Judy K. Bass PhuongThao D Le Ritika Singh Dristy Gurung Paola R. Velasco Margaux M. Grivel Ezra Susser Charles M. Cleland Rubén Alvarado Brandon A. Kohrt Arvin Bhana |
| author_facet | Lawrence H. Yang Judy K. Bass PhuongThao D Le Ritika Singh Dristy Gurung Paola R. Velasco Margaux M. Grivel Ezra Susser Charles M. Cleland Rubén Alvarado Brandon A. Kohrt Arvin Bhana |
| author_sort | Lawrence H. Yang |
| collection | DOAJ |
| description | Abstract Background Few implementation science (IS) measures have been evaluated for validity, reliability and utility – the latter referring to whether a measure captures meaningful aspects of implementation contexts. We present a real-world case study of rigorous measure development in IS that assesses Barriers and Facilitators in Implementation of Task-Sharing in Mental Health services (BeFITS-MH), with the objective of offering lessons-learned and a framework to enhance measurement utility. Methods We summarize conceptual and empirical work that informed the development of the BeFITS-MH measure, including a description of the Delphi process, detailed translation and local adaptation procedures, and concurrent pilot testing. As validity and reliability are key aspects of measure development, we also report on our process of assessing the measure’s construct validity and utility for the implementation outcomes of acceptability, appropriateness, and feasibility. Results Continuous stakeholder involvement and concurrent pilot testing resulted in several adaptations of the BeFITS-MH measure’s structure, scaling, and format to enhance contextual relevance and utility. Adaptations of broad terms such as “program,” “provider type,” and “type of service” were necessary due to the heterogeneous nature of interventions, type of task-sharing providers employed, and clients served across the three global sites. Item selection benefited from the iterative process, enabling identification of relevance of key aspects of identified barriers and facilitators, and what aspects were common across sites. Program implementers’ conceptions of utility regarding the measure’s acceptability, appropriateness, and feasibility clustered across several common categories. Conclusions This case study provides a rigorous, multi-step process for developing a pragmatic IS measure. The process and lessons learned will aid in the teaching, practice and research of IS measurement development. The importance of including experiences and knowledge from different types of stakeholders in different global settings was reinforced and resulted in a more globally useful measure while allowing for locally-relevant adaptation. To increase the relevance of the measure it is important to target actionable domains that predict markers of utility (e.g., successful uptake) per program implementers’ preferences. With this case study, we provide a detailed roadmap for others seeking to develop and validate IS measures that maximize local utility and impact. |
| format | Article |
| id | doaj-art-860c5f5cabdd41559588e4492ba4cc6c |
| institution | Kabale University |
| issn | 1472-6963 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Health Services Research |
| spelling | doaj-art-860c5f5cabdd41559588e4492ba4cc6c2024-11-10T12:14:20ZengBMCBMC Health Services Research1472-69632024-11-0124111710.1186/s12913-024-11783-6A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measureLawrence H. Yang0Judy K. Bass1PhuongThao D Le2Ritika Singh3Dristy Gurung4Paola R. Velasco5Margaux M. Grivel6Ezra Susser7Charles M. Cleland8Rubén Alvarado9Brandon A. Kohrt10Arvin Bhana11Department of Social and Behavioral Sciences, New York University School of Global Public HealthDepartment of Mental Health, Johns Hopkins Bloomberg School of Public Health Department of Community Health Sciences, Boston University School of Public HealthCenter for Global Mental Health Equity, Department of Psychiatry and Behavioral Health, George Washington UniversityTranscultural Psychosocial Organization (TPO) NepalUniversidad O’HigginsDepartment of Social and Behavioral Sciences, New York University School of Global Public HealthColumbia University Mailman School of Public HealthDepartment of Population Health, New York University Grossman School of MedicineUniversidad de Valparaíso, Faculty of Medicine, School of Medicine, Department of Public Health, Center for Interdisciplinary Health Studies (CIESAL)Center for Global Mental Health Equity, Department of Psychiatry and Behavioral Health, George Washington UniversityUniversity of KwaZulu-Natal, Centre for Rural Health, Howard College campusAbstract Background Few implementation science (IS) measures have been evaluated for validity, reliability and utility – the latter referring to whether a measure captures meaningful aspects of implementation contexts. We present a real-world case study of rigorous measure development in IS that assesses Barriers and Facilitators in Implementation of Task-Sharing in Mental Health services (BeFITS-MH), with the objective of offering lessons-learned and a framework to enhance measurement utility. Methods We summarize conceptual and empirical work that informed the development of the BeFITS-MH measure, including a description of the Delphi process, detailed translation and local adaptation procedures, and concurrent pilot testing. As validity and reliability are key aspects of measure development, we also report on our process of assessing the measure’s construct validity and utility for the implementation outcomes of acceptability, appropriateness, and feasibility. Results Continuous stakeholder involvement and concurrent pilot testing resulted in several adaptations of the BeFITS-MH measure’s structure, scaling, and format to enhance contextual relevance and utility. Adaptations of broad terms such as “program,” “provider type,” and “type of service” were necessary due to the heterogeneous nature of interventions, type of task-sharing providers employed, and clients served across the three global sites. Item selection benefited from the iterative process, enabling identification of relevance of key aspects of identified barriers and facilitators, and what aspects were common across sites. Program implementers’ conceptions of utility regarding the measure’s acceptability, appropriateness, and feasibility clustered across several common categories. Conclusions This case study provides a rigorous, multi-step process for developing a pragmatic IS measure. The process and lessons learned will aid in the teaching, practice and research of IS measurement development. The importance of including experiences and knowledge from different types of stakeholders in different global settings was reinforced and resulted in a more globally useful measure while allowing for locally-relevant adaptation. To increase the relevance of the measure it is important to target actionable domains that predict markers of utility (e.g., successful uptake) per program implementers’ preferences. With this case study, we provide a detailed roadmap for others seeking to develop and validate IS measures that maximize local utility and impact.https://doi.org/10.1186/s12913-024-11783-6Task-sharingMental Health ServicesImplementation scienceMeasure developmentMeasure adaptationMeasure validation; Case Study |
| spellingShingle | Lawrence H. Yang Judy K. Bass PhuongThao D Le Ritika Singh Dristy Gurung Paola R. Velasco Margaux M. Grivel Ezra Susser Charles M. Cleland Rubén Alvarado Brandon A. Kohrt Arvin Bhana A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure BMC Health Services Research Task-sharing Mental Health Services Implementation science Measure development Measure adaptation Measure validation; Case Study |
| title | A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure |
| title_full | A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure |
| title_fullStr | A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure |
| title_full_unstemmed | A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure |
| title_short | A case study of the development of a valid and pragmatic implementation science measure: the Barriers and Facilitators in Implementation of Task-Sharing Mental Health interventions (BeFITS-MH) measure |
| title_sort | case study of the development of a valid and pragmatic implementation science measure the barriers and facilitators in implementation of task sharing mental health interventions befits mh measure |
| topic | Task-sharing Mental Health Services Implementation science Measure development Measure adaptation Measure validation; Case Study |
| url | https://doi.org/10.1186/s12913-024-11783-6 |
| work_keys_str_mv | AT lawrencehyang acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT judykbass acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT phuongthaodle acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT ritikasingh acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT dristygurung acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT paolarvelasco acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT margauxmgrivel acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT ezrasusser acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT charlesmcleland acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT rubenalvarado acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT brandonakohrt acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT arvinbhana acasestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT lawrencehyang casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT judykbass casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT phuongthaodle casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT ritikasingh casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT dristygurung casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT paolarvelasco casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT margauxmgrivel casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT ezrasusser casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT charlesmcleland casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT rubenalvarado casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT brandonakohrt casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure AT arvinbhana casestudyofthedevelopmentofavalidandpragmaticimplementationsciencemeasurethebarriersandfacilitatorsinimplementationoftasksharingmentalhealthinterventionsbefitsmhmeasure |