Sample size determination for conducting a pilot study to assess reliability of a questionnaire
This article is a narrative review that discusses the recommended sample size requirements to design a pilot study to assess the reliability of a questionnaire. A list of various sample size tables that are based on the kappa agreement test, intra-class correlation test and Cronbach’s alpha test has...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korean Academy of Conservative Dentistry
2024-02-01
|
| Series: | Restorative Dentistry & Endodontics |
| Subjects: | |
| Online Access: | http://www.rde.ac/upload/pdf/rde-49-e3.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850092090367672320 |
|---|---|
| author | Mohamad Adam Bujang Evi Diana Omar Diana Hui Ping Foo Yoon Khee Hon |
| author_facet | Mohamad Adam Bujang Evi Diana Omar Diana Hui Ping Foo Yoon Khee Hon |
| author_sort | Mohamad Adam Bujang |
| collection | DOAJ |
| description | This article is a narrative review that discusses the recommended sample size requirements to design a pilot study to assess the reliability of a questionnaire. A list of various sample size tables that are based on the kappa agreement test, intra-class correlation test and Cronbach’s alpha test has been compiled together. For all calculations, type I error (alpha) was set at a maximum value of 0.05, and power was set at a minimum value of 80.0%. For the kappa agreement test, intra-class correlation test, and Cronbach’s alpha test, the recommended minimum sample size requirement based on the ideal effect sizes shall be at least 15, 22, and 24 subjects respectively. By making allowances for a non-response rate of 20.0%, a minimum sample size of 30 respondents will be sufficient to assess the reliability of the questionnaire. The clear guideline of minimum sample size requirement for the pilot study to assess the reliability of a questionnaire is discussed and this will ease researchers in preparation for the pilot study. This study provides justification for a minimum requirement of a sample size of 30 respondents specifically to test the reliability of a questionnaire. |
| format | Article |
| id | doaj-art-d2e33564c0e4483cb4ac49a01a77b376 |
| institution | DOAJ |
| issn | 2234-7658 2234-7666 |
| language | English |
| publishDate | 2024-02-01 |
| publisher | Korean Academy of Conservative Dentistry |
| record_format | Article |
| series | Restorative Dentistry & Endodontics |
| spelling | doaj-art-d2e33564c0e4483cb4ac49a01a77b3762025-08-20T02:42:12ZengKorean Academy of Conservative DentistryRestorative Dentistry & Endodontics2234-76582234-76662024-02-01491e310.5395/rde.2024.49.e31113Sample size determination for conducting a pilot study to assess reliability of a questionnaireMohamad Adam Bujang0Evi Diana Omar1Diana Hui Ping Foo2Yoon Khee Hon3Clinical Research Center, Sarawak General Hospital, Ministry of Health, Kuching, Sarawak, MalaysiaSector of Biostatistics and Data Repository, National Institutes of Health, Ministry of Health Malaysia, Selangor, MalaysiaClinical Research Center, Sarawak General Hospital, Ministry of Health, Kuching, Sarawak, MalaysiaInstitute for Clinical Research, National Institutes of Health, Ministry of Health Malaysia, Selangor, MalaysiaThis article is a narrative review that discusses the recommended sample size requirements to design a pilot study to assess the reliability of a questionnaire. A list of various sample size tables that are based on the kappa agreement test, intra-class correlation test and Cronbach’s alpha test has been compiled together. For all calculations, type I error (alpha) was set at a maximum value of 0.05, and power was set at a minimum value of 80.0%. For the kappa agreement test, intra-class correlation test, and Cronbach’s alpha test, the recommended minimum sample size requirement based on the ideal effect sizes shall be at least 15, 22, and 24 subjects respectively. By making allowances for a non-response rate of 20.0%, a minimum sample size of 30 respondents will be sufficient to assess the reliability of the questionnaire. The clear guideline of minimum sample size requirement for the pilot study to assess the reliability of a questionnaire is discussed and this will ease researchers in preparation for the pilot study. This study provides justification for a minimum requirement of a sample size of 30 respondents specifically to test the reliability of a questionnaire.http://www.rde.ac/upload/pdf/rde-49-e3.pdfpilot studyquestionnairereliabilitysample size |
| spellingShingle | Mohamad Adam Bujang Evi Diana Omar Diana Hui Ping Foo Yoon Khee Hon Sample size determination for conducting a pilot study to assess reliability of a questionnaire Restorative Dentistry & Endodontics pilot study questionnaire reliability sample size |
| title | Sample size determination for conducting a pilot study to assess reliability of a questionnaire |
| title_full | Sample size determination for conducting a pilot study to assess reliability of a questionnaire |
| title_fullStr | Sample size determination for conducting a pilot study to assess reliability of a questionnaire |
| title_full_unstemmed | Sample size determination for conducting a pilot study to assess reliability of a questionnaire |
| title_short | Sample size determination for conducting a pilot study to assess reliability of a questionnaire |
| title_sort | sample size determination for conducting a pilot study to assess reliability of a questionnaire |
| topic | pilot study questionnaire reliability sample size |
| url | http://www.rde.ac/upload/pdf/rde-49-e3.pdf |
| work_keys_str_mv | AT mohamadadambujang samplesizedeterminationforconductingapilotstudytoassessreliabilityofaquestionnaire AT evidianaomar samplesizedeterminationforconductingapilotstudytoassessreliabilityofaquestionnaire AT dianahuipingfoo samplesizedeterminationforconductingapilotstudytoassessreliabilityofaquestionnaire AT yoonkheehon samplesizedeterminationforconductingapilotstudytoassessreliabilityofaquestionnaire |