Tinker Tales: Interactive Storytelling Framework for Early Childhood Narrative Development and AI Literacy

TL;DR

This work introduces Tinker Tales, a tangible-digital storytelling framework for early childhood that combines NFC-enabled pawns with AI mediation to foster narrative development and AI literacy. The system uses a four-stage story structure and a dialogue-managed AI agent to ensure coherence and safety while allowing children to define story elements through physical interaction. Evaluation via simulated child-agent sessions shows high-quality, coherent, and safe narratives, demonstrating the viability of physically grounded AI literacy tools for young learners. The study highlights the benefits of integrating tangible play with AI collaboration to create engaging, safe educational experiences that extend beyond screen-based learning.

Abstract

This paper presents Tinker Tales, an interactive storytelling framework in the format of a board game, designed to support both narrative development and AI literacy in early childhood. The framework integrates tangible and speech-based interactions with AI through NFC chip-attached pawns and tokens, along with a speaker and microphone. Children select and define key story elements-such as characters, places, items, and emotions-using the pawns and tokens, providing further details to the AI and receiving proper assistance, similar to how adults prompt AI for specific tasks (e.g., writing). For evaluation, several game sessions were simulated with a child AI agent, and the quality and safety of the generated stories were assessed from various perspectives. This work highlights the potential of combining physical and digital elements in AI literacy, offering a safe and engaging way for children to learn how to effectively collaborate with AI.

Figures (8)

• Figure 1: Tinker$\;$Tales features a four-sided accordion board, NFC chip-attached pawns and tokens, and a mobile app that mediates tangible and speech interaction. Guided by the AI, the user begins by selecting and defining characters. Then, at each stage of the story, the user chooses and defines the place, item, and emotion through interactions, shaping the narrative. Once the activity is completed, the entire story is saved, if desired by the user.
• Figure 2: The user scans NFC chip-attached pawns and tokens or provides speech input. The NFC data or speech input, after STT processing, is converted into a proper prompt by the Dialogue Manager and sent to the AI. The AI generates an suitable response or instruction, which is then delivered to the user through TTS.
• Figure 3: The physical setup of our system, showing the game board and associated pawns and tokens.
• Figure 4: Our mobile app provides appropriate feedback and instructions through speech, based on the NFC chip or speech input provided by the user. The progression of the game is managed by the Dialogue Manager (\ref{['subsec:dialogue_manager']}).
• Figure 5: Example interaction between the Tinker Tale AI and the child AI agent, demonstrating the process of selecting and defining the first character.