Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

JooYoung Seo, Yilin Xia, Bongshin Lee, Sean McCurry, Yu Jun Yam

TL;DR

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations—bar plots, heat maps, box plots, and scatter plots—leveraging multimodal data representations and finds the MAIDR system facilitated the accurate interpretation of statistical visualizations.

Abstract

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations$-$bar plots, heat maps, box plots, and scatter plots$-$leveraging multimodal data representations. In addition to sonification and textual descriptions that are commonly employed by existing accessible visualizations, our MAIDR (multimodal access and interactive data representation) system incorporates two additional modalities (braille and review) that offer complementary benefits. It also provides blind users with the autonomy and control to interactively access and understand data visualizations. In a user study involving 11 blind participants, we found the MAIDR system facilitated the accurate interpretation of statistical visualizations. Participants exhibited a range of strategies in combining multiple modalities, influenced by their past interactions and experiences with data visualizations. This work accentuates the overlooked potential of combining refreshable tactile representation with other modalities and elevates the discussion on the importance of user autonomy when designing accessible data visualizations.

MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

TL;DR

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations—bar plots, heat maps, box plots, and scatter plots—leveraging multimodal data representations and finds the MAIDR system facilitated the accurate interpretation of statistical visualizations.

Abstract

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizationsbar plots, heat maps, box plots, and scatter plotsleveraging multimodal data representations. In addition to sonification and textual descriptions that are commonly employed by existing accessible visualizations, our MAIDR (multimodal access and interactive data representation) system incorporates two additional modalities (braille and review) that offer complementary benefits. It also provides blind users with the autonomy and control to interactively access and understand data visualizations. In a user study involving 11 blind participants, we found the MAIDR system facilitated the accurate interpretation of statistical visualizations. Participants exhibited a range of strategies in combining multiple modalities, influenced by their past interactions and experiences with data visualizations. This work accentuates the overlooked potential of combining refreshable tactile representation with other modalities and elevates the discussion on the importance of user autonomy when designing accessible data visualizations.
Paper Structure (48 sections, 7 figures, 4 tables)

This paper contains 48 sections, 7 figures, 4 tables.

Table of Contents

  1. Introduction
  2. Background and Related Work
  3. Theoretical Background
  4. Alternative Data Visualization Methods for Blind People
  5. Textual Descriptions
  6. Tactile Graphics
  7. Sonification and Mixed Modalities
  8. Co-Design Process and Considerations
  9. Interdependent Design Team
  10. Design Process
  11. Design Considerations
  12. The MAIDR System
  13. User Interaction and Navigation
  14. BTS+R Modalities
  15. Braille
  16. ...and 33 more sections

Figures (7)

  • Figure 1: With the chart and schema files as the input, the MAIDR system automatically generates an HTML file containing an accessible visualization, that can be readily rendered and opened in common web browsers.
  • Figure 2: The MAIDR interface, highlighting workspace and help menu components.
  • Figure 3: Visualizations and their corresponding braille patterns with both braille and text modality (verbose mode) activated.
  • Figure S1: State Diagram for Participate Interactions with Bar plot during the Task Session.
  • Figure S2: State Diagram for Participate Interactions with heatmap during the Task Session.
  • ...and 2 more figures