AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting

Abstract Advances in generative artificial intelligence show great potential for improving education. Yet little is known about how this new technology should be used and how effective it can be compared to current best practices. Here we report a randomized, controlled trial measuring college stude...

Full description

Saved in:
Bibliographic Details
Main Authors: Greg Kestin, Kelly Miller, Anna Klales, Timothy Milbourne, Gregorio Ponti
Format: Article
Language:English
Published: Nature Portfolio 2025-06-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-025-97652-6
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract Advances in generative artificial intelligence show great potential for improving education. Yet little is known about how this new technology should be used and how effective it can be compared to current best practices. Here we report a randomized, controlled trial measuring college students’ learning and their perceptions when content is presented through an AI-powered tutor compared with an active learning class. The novel design of the custom AI tutor is informed by the same pedagogical best practices as employed in the in-class lessons. We find that students learn significantly more in less time when using the AI tutor, compared with the in-class active learning. They also feel more engaged and more motivated. These findings offer empirical evidence for the efficacy of a widely accessible AI-powered pedagogy in significantly enhancing learning outcomes, presenting a compelling case for its broad adoption in learning environments.
ISSN:2045-2322