Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success
Considerable discussion in recent years has focused on failures to replicate findings in the psychological literature. In a Monte Carlo simulation of the research process, we examined several characteristics of research studies that might predict replication success (i.e., when both studies show sim...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Université d'Ottawa
2025-02-01
|
| Series: | Tutorials in Quantitative Methods for Psychology |
| Subjects: | |
| Online Access: | https://www.tqmp.org/RegularArticles/vol21-1/p024/p024.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823858089252618240 |
|---|---|
| author | Grant, Malcolm Snook, Brent Button, Cathryn |
| author_facet | Grant, Malcolm Snook, Brent Button, Cathryn |
| author_sort | Grant, Malcolm |
| collection | DOAJ |
| description | Considerable discussion in recent years has focused on failures to replicate findings in the psychological literature. In a Monte Carlo simulation of the research process, we examined several characteristics of research studies that might predict replication success (i.e., when both studies show similar effect sizes), and when estimated effect sizes reflect true effects. In our simulation, a successful replication was most likely when the initial findings had already been replicated once by the original author and when measurement reliability was high. As expected, greater replication success was also associated with narrow confidence intervals around effect-size estimates. However, sample sizes (i.e., those typically found in experimental psychological research) contributed relatively little to replication success. The estimates of true effect sizes were more accurate, aligning closely with the values specified in the simulation, under the same conditions associated with replication success. We discuss our findings in terms of how changes in research practices might produce more reliable psychological research. |
| format | Article |
| id | doaj-art-ef2b3e2f89f94cb89f472b5096d8b87b |
| institution | Kabale University |
| issn | 1913-4126 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Université d'Ottawa |
| record_format | Article |
| series | Tutorials in Quantitative Methods for Psychology |
| spelling | doaj-art-ef2b3e2f89f94cb89f472b5096d8b87b2025-02-11T15:58:42ZengUniversité d'OttawaTutorials in Quantitative Methods for Psychology1913-41262025-02-01211243110.20982/tqmp.21.1.p024Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication SuccessGrant, MalcolmSnook, BrentButton, CathrynConsiderable discussion in recent years has focused on failures to replicate findings in the psychological literature. In a Monte Carlo simulation of the research process, we examined several characteristics of research studies that might predict replication success (i.e., when both studies show similar effect sizes), and when estimated effect sizes reflect true effects. In our simulation, a successful replication was most likely when the initial findings had already been replicated once by the original author and when measurement reliability was high. As expected, greater replication success was also associated with narrow confidence intervals around effect-size estimates. However, sample sizes (i.e., those typically found in experimental psychological research) contributed relatively little to replication success. The estimates of true effect sizes were more accurate, aligning closely with the values specified in the simulation, under the same conditions associated with replication success. We discuss our findings in terms of how changes in research practices might produce more reliable psychological research.https://www.tqmp.org/RegularArticles/vol21-1/p024/p024.pdfreplicationreplication crisissimulationreliability |
| spellingShingle | Grant, Malcolm Snook, Brent Button, Cathryn Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success Tutorials in Quantitative Methods for Psychology replication replication crisis simulation reliability |
| title | Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success |
| title_full | Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success |
| title_fullStr | Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success |
| title_full_unstemmed | Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success |
| title_short | Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success |
| title_sort | replication a hallmark of good science unraveling the factors that predict replication success |
| topic | replication replication crisis simulation reliability |
| url | https://www.tqmp.org/RegularArticles/vol21-1/p024/p024.pdf |
| work_keys_str_mv | AT grantmalcolm replicationahallmarkofgoodscienceunravelingthefactorsthatpredictreplicationsuccess AT snookbrent replicationahallmarkofgoodscienceunravelingthefactorsthatpredictreplicationsuccess AT buttoncathryn replicationahallmarkofgoodscienceunravelingthefactorsthatpredictreplicationsuccess |