Simulation-Based Inference: Random Sampling vs. Random Assignment? What Instructors Should Know

“Simulation-based inference” is often considered a pedagogical strategy for helping students develop inferential reasoning, for example, giving them a visual and concrete reference for deciding whether the observed statistic is unlikely to happen by chance alone when the null hypothesis is true. In...

Full description

Saved in:
Bibliographic Details
Main Authors: Beth Chance, Karen McGaughey, Sophia Chung, Alex Goodman, Soma Roy, Nathan Tintle
Format: Article
Language:English
Published: Taylor & Francis Group 2025-01-01
Series:Journal of Statistics and Data Science Education
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/26939169.2024.2333736
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:“Simulation-based inference” is often considered a pedagogical strategy for helping students develop inferential reasoning, for example, giving them a visual and concrete reference for deciding whether the observed statistic is unlikely to happen by chance alone when the null hypothesis is true. In this article, we highlight for teachers some implications of different simulation strategies when analyzing two variables. In particular, does it matter whether the simulation models random sampling or random assignment? We present examples from comparing two means and simple linear regression, highlighting the impact on the standard deviation of the null distribution. We also highlight some possible extensions that simulation-based inference easily allows. Supplementary materials for this article are available online.
ISSN:2693-9169