Table of Contents
Fetching ...

StereoMath: An Accessible and Musical Equation Editor

Kenneth Ge, JooYoung Seo

TL;DR

StereoMath addresses the BLV math communication gap by introducing an accessible, web-based equation editor that leverages spatial audio, muscle-memory navigation, and nonverbal cues to convey 2D equation structure. It integrates two representations (tree and table/grid) with a custom TTS backend and a multifaceted navigation system to reduce cognitive load and improve nesting comprehension. The design process used mixed-ability co-design and a set of goals (DG1–DG5) focused on spatial cues, ownership of elements, and customization. The approach has potential to enhance math engagement and literacy for BLV users and could inform broader, accessible mathematical tooling.

Abstract

For blind and low-vision (BLV) individuals, digital math communication is uniquely difficult due to the lack of accessible tools. Currently, the state of the art is either code-based, like LaTeX, or WYSIWYG, like visual editors. However, both paradigms view math communication as primarily a visual typesetting problem, and may be accessible but difficult to use. In this paper, we present an equation editor that is built from the ground up with BLV accessibility in mind. Specifically, we notice that two of the biggest barriers with current technology are the high cognitive load and the lack of spatial relationships. Thus, we build an editor that uses spatial audio cues, muscle memory, tones, and more intuitive navigation to properly contextualize math equations. We discuss how this new paradigm can enable new levels of math communication, engagement, and literacy. Finally, we discuss natural next steps.

StereoMath: An Accessible and Musical Equation Editor

TL;DR

StereoMath addresses the BLV math communication gap by introducing an accessible, web-based equation editor that leverages spatial audio, muscle-memory navigation, and nonverbal cues to convey 2D equation structure. It integrates two representations (tree and table/grid) with a custom TTS backend and a multifaceted navigation system to reduce cognitive load and improve nesting comprehension. The design process used mixed-ability co-design and a set of goals (DG1–DG5) focused on spatial cues, ownership of elements, and customization. The approach has potential to enhance math engagement and literacy for BLV users and could inform broader, accessible mathematical tooling.

Abstract

For blind and low-vision (BLV) individuals, digital math communication is uniquely difficult due to the lack of accessible tools. Currently, the state of the art is either code-based, like LaTeX, or WYSIWYG, like visual editors. However, both paradigms view math communication as primarily a visual typesetting problem, and may be accessible but difficult to use. In this paper, we present an equation editor that is built from the ground up with BLV accessibility in mind. Specifically, we notice that two of the biggest barriers with current technology are the high cognitive load and the lack of spatial relationships. Thus, we build an editor that uses spatial audio cues, muscle memory, tones, and more intuitive navigation to properly contextualize math equations. We discuss how this new paradigm can enable new levels of math communication, engagement, and literacy. Finally, we discuss natural next steps.
Paper Structure (9 sections, 2 figures)

This paper contains 9 sections, 2 figures.

Figures (2)

  • Figure 1: System Overview Diagram
  • Figure 2: Architecture overview, showing the two representations (tree-based and spatial/geometric), as well as the custom backend TTS.