An Experimental Evaluation of an AI-Powered Interactive Learning Platform

Abstract

Generative AI, which is capable of transforming static content into dynamic learning experiences, holds the potential to revolutionize student engagement in educational contexts. However, questions still remain around whether or not these tools are effective at facilitating student learning. In this research, we test the effectiveness of an AI-powered platform incorporating multiple representations and assessment through Learn Your Way, an experimental research platform that transforms textbook chapters into dynamic visual and audio representations. Through a between-subjects, mixed methods experiment with 60 US-based students, we demonstrate that students who used Learn Your Way had a more positive learning experience and had better learning outcomes compared to students learning the same content through a digital textbook. These findings indicate that AI-driven tools, capable of providing choice among interactive representations of content, constitute an effective and promising method for enhancing student learning.

Figures (4)

• Figure 1: Diagram of the Learn Your Way user interface for Immersive Text. Other learning modalities are featured at the top including Slides, Video, Audio Lesson, and Mindmap, as well as the original PDF.
• Figure 2: Overview of the experimental set-up.
• Figure 3: Violin and boxplots of immediate recall scores (left plot) and long-term recall scores (right plot) by tool condition. The immediate recall assessment was scored out of 12 points while the long-term recall assessment was scored out of 6 points.
• Figure 4: Visual of how students are able to personalize based on grade level and student interest in Learn Your Way