Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol.
Health facility assessments provide important data to measure the quality of health services delivered to populations. These assessments are comprehensive, resource intensive, and periodic to inform medium- to-longer-term policies. However, in absence of other reliable data sources, country decision...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0309570 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849469954498232320 |
|---|---|
| author | Rachel Neill Pablo Amor Fernandez Ruchika Bhatia Jigyasa Sharma Kathryn Andrews Sven Neelsen Etoile Pinder Marifat Abdullaev Firuza Safarova Mutriba Latypova Mirja Channa Sjoblom Tashrik Ahmed Michael A Peters Ashley Sheffel Tawab Hashemi Peter M Hansen Ghafur Muhsinzoda Gil Shapira |
| author_facet | Rachel Neill Pablo Amor Fernandez Ruchika Bhatia Jigyasa Sharma Kathryn Andrews Sven Neelsen Etoile Pinder Marifat Abdullaev Firuza Safarova Mutriba Latypova Mirja Channa Sjoblom Tashrik Ahmed Michael A Peters Ashley Sheffel Tawab Hashemi Peter M Hansen Ghafur Muhsinzoda Gil Shapira |
| author_sort | Rachel Neill |
| collection | DOAJ |
| description | Health facility assessments provide important data to measure the quality of health services delivered to populations. These assessments are comprehensive, resource intensive, and periodic to inform medium- to-longer-term policies. However, in absence of other reliable data sources, country decision makers often rely on outdated data to address service delivery challenges that change more frequently. High-frequency phone surveys are a potential option to improve the efficiency and timeliness of collecting time-sensitive service delivery indicators in-between comprehensive in-person assessments. The objectives of this study are to assess the reliability, concurrent criterion validity, and non-response rates in a rapid phone-based health facility assessment developed by the Global Financing Facility's FASTR initiative compared to a comprehensive in-person health facility assessment developed by the World Bank's Service Delivery Indicators Health Program. The in-person survey and corresponding in-person item verification will serve as the gold standard. Both surveys will be administered to an identical sample of 500 health facilities in Tajikistan using the same data collection entity. To assess reliability, percent agreement, Cohens Kappa, and prevalence and bias adjusted Kappa will be calculated. To assess concurrent criterion validity, sensitivity and specificity will be calculated, with a cut-off of.7 used for adequate validity. The study will further compare response rates and dropout rates of both surveys using simple t-tests and balance tests to identify if the characteristics of the phone-based and in-person survey samples are similar after accounting for any differences in survey response rates. The results of this study will provide important insights into the reliability and validity of phone-based data collection approaches for health facility assessments. This is critical as Ministries of Health seek to establish and sustain more continuous data collection, analysis, and use of health facility-level data to complement periodic in-person assessments to improve the quality of services provided to their populations. |
| format | Article |
| id | doaj-art-9db80e5d15c14603a40c2d84dc5a84a8 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-9db80e5d15c14603a40c2d84dc5a84a82025-08-20T03:25:17ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01205e030957010.1371/journal.pone.0309570Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol.Rachel NeillPablo Amor FernandezRuchika BhatiaJigyasa SharmaKathryn AndrewsSven NeelsenEtoile PinderMarifat AbdullaevFiruza SafarovaMutriba LatypovaMirja Channa SjoblomTashrik AhmedMichael A PetersAshley SheffelTawab HashemiPeter M HansenGhafur MuhsinzodaGil ShapiraHealth facility assessments provide important data to measure the quality of health services delivered to populations. These assessments are comprehensive, resource intensive, and periodic to inform medium- to-longer-term policies. However, in absence of other reliable data sources, country decision makers often rely on outdated data to address service delivery challenges that change more frequently. High-frequency phone surveys are a potential option to improve the efficiency and timeliness of collecting time-sensitive service delivery indicators in-between comprehensive in-person assessments. The objectives of this study are to assess the reliability, concurrent criterion validity, and non-response rates in a rapid phone-based health facility assessment developed by the Global Financing Facility's FASTR initiative compared to a comprehensive in-person health facility assessment developed by the World Bank's Service Delivery Indicators Health Program. The in-person survey and corresponding in-person item verification will serve as the gold standard. Both surveys will be administered to an identical sample of 500 health facilities in Tajikistan using the same data collection entity. To assess reliability, percent agreement, Cohens Kappa, and prevalence and bias adjusted Kappa will be calculated. To assess concurrent criterion validity, sensitivity and specificity will be calculated, with a cut-off of.7 used for adequate validity. The study will further compare response rates and dropout rates of both surveys using simple t-tests and balance tests to identify if the characteristics of the phone-based and in-person survey samples are similar after accounting for any differences in survey response rates. The results of this study will provide important insights into the reliability and validity of phone-based data collection approaches for health facility assessments. This is critical as Ministries of Health seek to establish and sustain more continuous data collection, analysis, and use of health facility-level data to complement periodic in-person assessments to improve the quality of services provided to their populations.https://doi.org/10.1371/journal.pone.0309570 |
| spellingShingle | Rachel Neill Pablo Amor Fernandez Ruchika Bhatia Jigyasa Sharma Kathryn Andrews Sven Neelsen Etoile Pinder Marifat Abdullaev Firuza Safarova Mutriba Latypova Mirja Channa Sjoblom Tashrik Ahmed Michael A Peters Ashley Sheffel Tawab Hashemi Peter M Hansen Ghafur Muhsinzoda Gil Shapira Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol. PLoS ONE |
| title | Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol. |
| title_full | Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol. |
| title_fullStr | Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol. |
| title_full_unstemmed | Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol. |
| title_short | Comparison of the results of in-person and mobile phone surveys for a health facility assessment in Tajikistan: A validation study protocol. |
| title_sort | comparison of the results of in person and mobile phone surveys for a health facility assessment in tajikistan a validation study protocol |
| url | https://doi.org/10.1371/journal.pone.0309570 |
| work_keys_str_mv | AT rachelneill comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT pabloamorfernandez comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT ruchikabhatia comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT jigyasasharma comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT kathrynandrews comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT svenneelsen comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT etoilepinder comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT marifatabdullaev comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT firuzasafarova comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT mutribalatypova comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT mirjachannasjoblom comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT tashrikahmed comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT michaelapeters comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT ashleysheffel comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT tawabhashemi comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT petermhansen comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT ghafurmuhsinzoda comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol AT gilshapira comparisonoftheresultsofinpersonandmobilephonesurveysforahealthfacilityassessmentintajikistanavalidationstudyprotocol |