Tangible Intangibles: Exploring Embodied Emotion in Mixed Reality for Art Therapy
Mahsa Nasri, Mahnoosh Jahanian, Wei Wu, Binyan Xu, Casper Harteveld
TL;DR
The paper investigates how mixed reality and biometric sensing can render intangible emotional experiences tangible for art therapy. It juxtaposes traditional somatic art practices (clay and 2D drawing) with MR-based biosignal visualization to create 3D emotional artifacts and an archive of affect. The approach emphasizes a hybrid workflow that foregrounds interoceptive literacy while critically examining when automated biometric translation enhances or detracts from embodied connection. The study grounds its design in somatic psychology, embodied cognition, and digital phenotyping, and aims to deliver a shared vocabulary and practical principles for trauma-informed, hybrid emotion journaling in TEI contexts.
Abstract
This in-person studio explores how mixed reality (MR) and biometrics can make intangible emotional states tangible through embodied art practices. We begin with two well-established modalities, clay sculpting and free-form 2D drawing, to ground participants in somatic awareness and manual, reflective expression. Building on this baseline, we introduce an MR prototype that maps physiological signals (e.g., breath, heart rate variability, eye movement dynamics) to visual and spatial parameters (color saturation, pulsing, motion qualities), generating ''3D emotional artifacts.'' The full-day program balances theory (somatic psychology, embodied cognition, expressive biosignals), hands-on making, and comparative reflection to interrogate what analog and digital modalities respectively afford for awareness, expression, and meaning-making. Participants will (1) experience and compare analog and MR-based journaling of emotion; (2) prototype and critique mappings from biosignals to visual/spatial feedback; and (3) articulate design principles for trauma-informed, hybrid workflows that amplify interoceptive literacy without overwhelming the user. The expected contributions include a shared design vocabulary for biometric expressivity, a set of generative constraints for future TEI work on emotional archiving, and actionable insights into when automated translation supports or hinders embodied connection.