Table of Contents
Fetching ...

Interdisciplinary Translations: Sensory Perception as a Universal Language

Xindi Kang, Xuanyang Huang, Mingdong Song, Varvara Guljajeva, JoAnn Kuchera-Morin

TL;DR

The study aims to broaden the understanding of sensory perception's role in communication, highlighting its significance in the evolution of interactive experiences and its capacity to unify art, science, and the human experience.

Abstract

This paper investigates sensory perception's pivotal role as a universal communicative bridge across varied cultures and disciplines, and how it manifests its value in the study of media art, human computer interaction and artificial intelligence. By analyzing its function in non-verbal communication through interactive systems, and drawing on the interpretive model in translation studies where "sense" acts as a mediation between two languages, this paper illustrates how interdisciplinary communication in media art and human-computer interaction is afforded by the abstract language of human sensory perception. Specific examples from traditional art, interactive media art, HCI, communication, and translation studies demonstrate how sensory feedback translates and conveys meaning across diverse modalities of expression and how it fosters connections between humans, art, and technology. Pertaining to this topic, this paper analyzes the impact of sensory feedback systems in designing interactive experiences, and reveals the guiding role of sensory perception in the design philosophy of AI systems. Overall, the study aims to broaden the understanding of sensory perception's role in communication, highlighting its significance in the evolution of interactive experiences and its capacity to unify art, science, and the human experience.

Interdisciplinary Translations: Sensory Perception as a Universal Language

TL;DR

The study aims to broaden the understanding of sensory perception's role in communication, highlighting its significance in the evolution of interactive experiences and its capacity to unify art, science, and the human experience.

Abstract

This paper investigates sensory perception's pivotal role as a universal communicative bridge across varied cultures and disciplines, and how it manifests its value in the study of media art, human computer interaction and artificial intelligence. By analyzing its function in non-verbal communication through interactive systems, and drawing on the interpretive model in translation studies where "sense" acts as a mediation between two languages, this paper illustrates how interdisciplinary communication in media art and human-computer interaction is afforded by the abstract language of human sensory perception. Specific examples from traditional art, interactive media art, HCI, communication, and translation studies demonstrate how sensory feedback translates and conveys meaning across diverse modalities of expression and how it fosters connections between humans, art, and technology. Pertaining to this topic, this paper analyzes the impact of sensory feedback systems in designing interactive experiences, and reveals the guiding role of sensory perception in the design philosophy of AI systems. Overall, the study aims to broaden the understanding of sensory perception's role in communication, highlighting its significance in the evolution of interactive experiences and its capacity to unify art, science, and the human experience.

Paper Structure

This paper contains 11 sections, 5 figures.

Figures (5)

  • Figure 1: A spectrum illustrating the artist's position in communication and the content they generate, relation to the art-form, with the degree of agency granted to viewer increasing from left to right.
  • Figure 2: The language used in three types of communication: Human-human, system-system, human-system
  • Figure 3: Illustration of Seleskovitch's triangular model of ITT (two versions)
  • Figure 4: Wassily Kandinsky, Composition VII, 1913. Oil on canvas. © Tretyakov Gallery
  • Figure 5: Iannis Xenakis, Sketch showing string glissandi, mm. 309–14 © Wikimedia Commons