Dialogue in Resonance: An Interactive Music Piece for Piano and Real-Time Automatic Transcription System
Hayeon Bang, Taegyun Kwon, Juhan Nam
TL;DR
This work introduces Dialogue in Resonance, a two-piano piece that pairs a human performer with a computer-controlled piano through real-time automatic transcription within a score-driven framework. The method centers on online AMT, implemented via a neural transcription system that feeds MIDI to Max/MSP for real-time transformation and playback control, enabling a genuine musical dialogue rather than a passive accompaniment. The composition balances a fixed score for the human performer with adaptive, perceptually rich responses from the computer partner, incorporating unpredictability through live transcription and parameterized processing. The project demonstrates a practical, implementable framework (Python + OSC + Max) and offers insights from rehearsals and performances, highlighting the artistic potential and challenges of integrating real-time transcription into structured electronic-augmented performance. Overall, the work advances human–computer collaboration in live music by showing how transcription-driven interaction can preserve compositional intent while embracing spontaneity.
Abstract
This paper presents <Dialogue in Resonance>, an interactive music piece for a human pianist and a computer-controlled piano that integrates real-time automatic music transcription into a score-driven framework. Unlike previous approaches that primarily focus on improvisation-based interactions, our work establishes a balanced framework that combines composed structure with dynamic interaction. Through real-time automatic transcription as its core mechanism, the computer interprets and responds to the human performer's input in real time, creating a musical dialogue that balances compositional intent with live interaction while incorporating elements of unpredictability. In this paper, we present the development process from composition to premiere performance, including technical implementation, rehearsal process, and performance considerations.