Timbre Perception, Representation, and its Neuroscientific Exploration: A Comprehensive Review
Hong Zhang, Jie Lin, Shengxuan Chen
TL;DR
The paper addresses how timbre is perceived and represented, emphasizing timbre space and neural mechanisms. It surveys historical psychoacoustics to modern MDS-based representations and high-dimensional, ML-driven manipulation. It also reviews neuroscience findings on brain regions, brightness, embodied perception, and emotion linked to timbre. The work highlights remaining gaps and calls for interdisciplinary research and practical applications in music technology and auditory perception.
Abstract
Timbre, the sound's unique "color", is fundamental to how we perceive and appreciate music. This review explores the multifaceted world of timbre perception and representation. It begins by tracing the word's origin, offering an intuitive grasp of the concept. Building upon this foundation, the article delves into the complexities of defining and measuring timbre. It then explores the concept and techniques of timbre space, a powerful tool for visualizing how we perceive different timbres. The review further examines recent advancements in timbre manipulation and representation, including the increasingly utilized machine learning techniques. While the underlying neural mechanisms remain partially understood, the article discusses current neuroimaging techniques used to investigate this aspect of perception. Finally, it summarizes key takeaways, identifies promising future research directions, and emphasizes the potential applications of timbre research in music technology, assistive technologies, and our overall understanding of auditory perception.