Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments
Introduction Contemporary validity testing theory holds that validity lies in the extent to which a proposed interpretation and use of test scores is justified, the evidence for which is dependent on both quantitative and qualitative research methods. Despite this, we hypothesise that development an...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2019-10-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/9/10/e030753.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850060094695276544 |
|---|---|
| author | Melanie Hawkins Gerald R Elsworth Richard H Osborne |
| author_facet | Melanie Hawkins Gerald R Elsworth Richard H Osborne |
| author_sort | Melanie Hawkins |
| collection | DOAJ |
| description | Introduction Contemporary validity testing theory holds that validity lies in the extent to which a proposed interpretation and use of test scores is justified, the evidence for which is dependent on both quantitative and qualitative research methods. Despite this, we hypothesise that development and validation studies for assessments in the field of health primarily report a limited range of statistical properties, and that a systematic theoretical framework for validity testing is rarely applied. Using health literacy assessments as an exemplar, this paper outlines a protocol for a systematic descriptive literature review about types of validity evidence being reported and if the evidence is reported within a theoretical framework.Methods and analysis A systematic descriptive literature review of qualitative and quantitative research will be used to investigate the scope of validation practice in the rapidly growing field of health literacy assessment. This review method employs a frequency analysis to reveal potentially interpretable patterns of phenomena in a research area; in this study, patterns in types of validity evidence reported, as assessed against the criteria of the 2014 Standards for Educational and Psychological Testing, and in the number of studies using a theoretical validity testing framework. The search process will be consistent with the Preferred Reporting Items for Systematic Reviews and Meta-analyses statement. Outcomes of the review will describe patterns in reported validity evidence, methods used to generate the evidence and theoretical frameworks underpinning validation practice and claims. This review will inform a theoretical basis for future development and validity testing of health assessments in general.Ethics and dissemination Ethics approval is not required for this systematic review because only published research will be examined. Dissemination of the review findings will be through publication in a peer-reviewed journal, at conference presentations and in the lead author’s doctoral thesis. |
| format | Article |
| id | doaj-art-617d5adf3fa64f1da82d7c364933121d |
| institution | DOAJ |
| issn | 2044-6055 |
| language | English |
| publishDate | 2019-10-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-617d5adf3fa64f1da82d7c364933121d2025-08-20T02:50:41ZengBMJ Publishing GroupBMJ Open2044-60552019-10-0191010.1136/bmjopen-2019-030753Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessmentsMelanie Hawkins0Gerald R Elsworth1Richard H Osborne2Centre for Global Health and Equity, Swinburne University of Technology, Melbourne, Victoria, AustraliaCentre for Global Health and Equity, Swinburne University of Technology, Melbourne, Victoria, AustraliaFaculty of Health, Arts and Design, Swinburne University of Technology, Melbourne, Victoria, AustraliaIntroduction Contemporary validity testing theory holds that validity lies in the extent to which a proposed interpretation and use of test scores is justified, the evidence for which is dependent on both quantitative and qualitative research methods. Despite this, we hypothesise that development and validation studies for assessments in the field of health primarily report a limited range of statistical properties, and that a systematic theoretical framework for validity testing is rarely applied. Using health literacy assessments as an exemplar, this paper outlines a protocol for a systematic descriptive literature review about types of validity evidence being reported and if the evidence is reported within a theoretical framework.Methods and analysis A systematic descriptive literature review of qualitative and quantitative research will be used to investigate the scope of validation practice in the rapidly growing field of health literacy assessment. This review method employs a frequency analysis to reveal potentially interpretable patterns of phenomena in a research area; in this study, patterns in types of validity evidence reported, as assessed against the criteria of the 2014 Standards for Educational and Psychological Testing, and in the number of studies using a theoretical validity testing framework. The search process will be consistent with the Preferred Reporting Items for Systematic Reviews and Meta-analyses statement. Outcomes of the review will describe patterns in reported validity evidence, methods used to generate the evidence and theoretical frameworks underpinning validation practice and claims. This review will inform a theoretical basis for future development and validity testing of health assessments in general.Ethics and dissemination Ethics approval is not required for this systematic review because only published research will be examined. Dissemination of the review findings will be through publication in a peer-reviewed journal, at conference presentations and in the lead author’s doctoral thesis.https://bmjopen.bmj.com/content/9/10/e030753.full |
| spellingShingle | Melanie Hawkins Gerald R Elsworth Richard H Osborne Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments BMJ Open |
| title | Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments |
| title_full | Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments |
| title_fullStr | Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments |
| title_full_unstemmed | Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments |
| title_short | Questionnaire validation practice: a protocol for a systematic descriptive literature review of health literacy assessments |
| title_sort | questionnaire validation practice a protocol for a systematic descriptive literature review of health literacy assessments |
| url | https://bmjopen.bmj.com/content/9/10/e030753.full |
| work_keys_str_mv | AT melaniehawkins questionnairevalidationpracticeaprotocolforasystematicdescriptiveliteraturereviewofhealthliteracyassessments AT geraldrelsworth questionnairevalidationpracticeaprotocolforasystematicdescriptiveliteraturereviewofhealthliteracyassessments AT richardhosborne questionnairevalidationpracticeaprotocolforasystematicdescriptiveliteraturereviewofhealthliteracyassessments |