Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities
This study proposes a method of nonresponse assessment based on meta-analytical file-drawer techniques, also known as worst-case resistance testing (WCRT), and suitable for a wide range of data collection scenarios. A general method is devised to estimate the number of significantly different nonre...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Survey Research Association
2024-12-01
|
| Series: | Survey Research Methods |
| Subjects: | |
| Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/8182 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861412172136448 |
|---|---|
| author | Stephen France Frank G. Adams V. Myles Landers |
| author_facet | Stephen France Frank G. Adams V. Myles Landers |
| author_sort | Stephen France |
| collection | DOAJ |
| description |
This study proposes a method of nonresponse assessment based on meta-analytical file-drawer techniques, also known as worst-case resistance testing (WCRT), and suitable for a wide range of data collection scenarios. A general method is devised to estimate the number of significantly different nonrespondents it would take to significantly alter the results of an analysis. Estimates of nonrespondents can be plotted against effect sizes using “n-curves”, with similar interpretation to p-curves or power curves. Variants of the general method are derived for tests of means and correlations. A sample using a well-established survey instrument from previous behavioral research is used to test the method. The results suggest that employing worst-case resistance testing can be used on its own or in conjunction with wave analysis to precisely flag nonresponse risks.
|
| format | Article |
| id | doaj-art-791127dd5a8046cbb2d22fdab90f34cd |
| institution | Kabale University |
| issn | 1864-3361 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | European Survey Research Association |
| record_format | Article |
| series | Survey Research Methods |
| spelling | doaj-art-791127dd5a8046cbb2d22fdab90f34cd2025-02-09T14:16:09ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612024-12-01183Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research RealitiesStephen France0Frank G. AdamsV. Myles LandersMississippi State University This study proposes a method of nonresponse assessment based on meta-analytical file-drawer techniques, also known as worst-case resistance testing (WCRT), and suitable for a wide range of data collection scenarios. A general method is devised to estimate the number of significantly different nonrespondents it would take to significantly alter the results of an analysis. Estimates of nonrespondents can be plotted against effect sizes using “n-curves”, with similar interpretation to p-curves or power curves. Variants of the general method are derived for tests of means and correlations. A sample using a well-established survey instrument from previous behavioral research is used to test the method. The results suggest that employing worst-case resistance testing can be used on its own or in conjunction with wave analysis to precisely flag nonresponse risks. https://ojs.ub.uni-konstanz.de/srm/article/view/8182Participant Nonresponse BiasWorst-Case Resistance TestingHypothesis TestingWave Analysis |
| spellingShingle | Stephen France Frank G. Adams V. Myles Landers Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities Survey Research Methods Participant Nonresponse Bias Worst-Case Resistance Testing Hypothesis Testing Wave Analysis |
| title | Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities |
| title_full | Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities |
| title_fullStr | Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities |
| title_full_unstemmed | Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities |
| title_short | Worst Case Resistance Testing: A Nonresponse Bias Solution for Today’s Survey Research Realities |
| title_sort | worst case resistance testing a nonresponse bias solution for today s survey research realities |
| topic | Participant Nonresponse Bias Worst-Case Resistance Testing Hypothesis Testing Wave Analysis |
| url | https://ojs.ub.uni-konstanz.de/srm/article/view/8182 |
| work_keys_str_mv | AT stephenfrance worstcaseresistancetestinganonresponsebiassolutionfortodayssurveyresearchrealities AT frankgadams worstcaseresistancetestinganonresponsebiassolutionfortodayssurveyresearchrealities AT vmyleslanders worstcaseresistancetestinganonresponsebiassolutionfortodayssurveyresearchrealities |