How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals
In empirical research, scholars can choose between an exploratory causes-of-effects analysis, a confirmatory effects-of-causes approach, or a mechanism-of-effects analysis that can be either exploratory or confirmatory. Understanding the choice between the approaches is important for two reasons. Fi...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2023-05-01
|
| Series: | Research & Politics |
| Online Access: | https://doi.org/10.1177/20531680231170969 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849708135628931072 |
|---|---|
| author | Felix Bethke Ingo Rohlfing |
| author_facet | Felix Bethke Ingo Rohlfing |
| author_sort | Felix Bethke |
| collection | DOAJ |
| description | In empirical research, scholars can choose between an exploratory causes-of-effects analysis, a confirmatory effects-of-causes approach, or a mechanism-of-effects analysis that can be either exploratory or confirmatory. Understanding the choice between the approaches is important for two reasons. First, the added value of each approach depends on how much is known about the phenomenon of interest at the time of the analysis. Second, because of the specializations of methods, there are benefits to a division of labor between researchers who have expertise in the application of a given method. In this preregistered study, we test two hypotheses that follow from these arguments. We theorize that exploratory research is chosen when little is known about a phenomenon and a confirmatory approach is taken when more knowledge is available. A complementary hypothesis is that quantitative researchers opt for confirmatory designs and qualitative researchers for exploration because of their academic socialization. We test the hypotheses with a survey experiment of more than 900 political scientists from the United States and Europe. The results indicate that the state of knowledge has a significant and sizeable effect on the choice of the approach. In contrast, the evidence about the effect of methods expertise is more ambivalent. |
| format | Article |
| id | doaj-art-2a0b6cb80af74228b7ea0d79582b8c3e |
| institution | DOAJ |
| issn | 2053-1680 |
| language | English |
| publishDate | 2023-05-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | Research & Politics |
| spelling | doaj-art-2a0b6cb80af74228b7ea0d79582b8c3e2025-08-20T03:15:44ZengSAGE PublishingResearch & Politics2053-16802023-05-011010.1177/20531680231170969How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goalsFelix BethkeIngo RohlfingIn empirical research, scholars can choose between an exploratory causes-of-effects analysis, a confirmatory effects-of-causes approach, or a mechanism-of-effects analysis that can be either exploratory or confirmatory. Understanding the choice between the approaches is important for two reasons. First, the added value of each approach depends on how much is known about the phenomenon of interest at the time of the analysis. Second, because of the specializations of methods, there are benefits to a division of labor between researchers who have expertise in the application of a given method. In this preregistered study, we test two hypotheses that follow from these arguments. We theorize that exploratory research is chosen when little is known about a phenomenon and a confirmatory approach is taken when more knowledge is available. A complementary hypothesis is that quantitative researchers opt for confirmatory designs and qualitative researchers for exploration because of their academic socialization. We test the hypotheses with a survey experiment of more than 900 political scientists from the United States and Europe. The results indicate that the state of knowledge has a significant and sizeable effect on the choice of the approach. In contrast, the evidence about the effect of methods expertise is more ambivalent.https://doi.org/10.1177/20531680231170969 |
| spellingShingle | Felix Bethke Ingo Rohlfing How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals Research & Politics |
| title | How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals |
| title_full | How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals |
| title_fullStr | How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals |
| title_full_unstemmed | How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals |
| title_short | How do researchers choose their goals of inference? A survey experiment on the effects of the state of research and method preferences on the choice between research goals |
| title_sort | how do researchers choose their goals of inference a survey experiment on the effects of the state of research and method preferences on the choice between research goals |
| url | https://doi.org/10.1177/20531680231170969 |
| work_keys_str_mv | AT felixbethke howdoresearcherschoosetheirgoalsofinferenceasurveyexperimentontheeffectsofthestateofresearchandmethodpreferencesonthechoicebetweenresearchgoals AT ingorohlfing howdoresearcherschoosetheirgoalsofinferenceasurveyexperimentontheeffectsofthestateofresearchandmethodpreferencesonthechoicebetweenresearchgoals |