Grating haptic perception through touchscreen: Sighted vs. Visually Impaired

TL;DR

The paper investigates smartphone-based vibrotactile grating cues to convey graphical information to visually impaired users and compares their tactile discrimination with sighted controls. Two experiments quantify detection and discrimination of grating patterns, revealing a clear VI advantage in grating detection ($d'=5.60$ vs $3.96$) and a Braille-like optimal frequency for VI around $0.270\mathrm{cpmm}$, contrasted with $0.963\mathrm{cpmm}$ for sighted participants. The study introduces a contrast-sensitivity framework and dual-Weibull psychometric modeling to capture nonmonotonic performance across frequencies, highlighting distinct tactile processing strategies between groups. Findings support Braille-aligned vibrotactile encoding for graphical accessibility and underscore practical limits, such as sample size and device constraints, guiding future development of smartphone-based haptic interfaces for visually impaired users.

Abstract

Providing haptic feedback via smartphone touch screen may potentially offer blind people a capability to understand graphs. This study investigated the discrimination performance of haptic gratings in different frequencies, in both visually impaired (VI) and sighted (S) individuals. 6 VI participants and 10 S participants took part in two experiments designed to compare their ability to interpret grating images with a finger swiping across a smartphone touchscreen without vision. The swipe gesture activates phone vibration temporally synchronized with the black stripes. Their tasks were: (1) determining whether a grating pattern is presented on the touchscreen, (2) comparing two different grating frequencies and determining the wider one. Results demonstrated that the VI group exhibited superior tactile sensitivity compared to the S group, as evidenced by their significantly better performance in Experiment 1 (accuracy of 99.15\% vs. 84.5\%). Experiment 2 revealed that the peak performance of VI participants was approximately around 0.270 cycles per mm (83.3\% accuracy), a frequency very similar to Braille dot spacing, while S group peaked around 0.963 cycles per mm (70\% accuracy). The findings suggest that tactile stimulation coded with grating patterns could be potentially used to present interpretable graph for the visually impaired. Such an approach could offer a value to research in human-computer interaction and sensory adaptation.

Figures (6)

• Figure 1: Method for determine tactile acuity: two-point threshold and grating acuity. Redrawn from $Sensation$$and$$Perception$, page 362 book.
• Figure 2: Smartphone interface for Experiment 1. (a) and (b) illustrate two examples of the grating stimuli (no. 9 and no. 10). The black stripes represent the regions where tactile vibration was applied. The 'vibration status' annotation on the left refers purely to the spatial location of the haptic feedback, not to its frequency or intensity. (c) The general interface screen displayed to participants during the experiment.
• Figure 3: Smartphone interface for Experiment 2. (a) and (b) illustrate two examples of the grating stimuli (no.10+no.9 and no.9+no.10). The black stripes represent the regions where tactile vibration was applied. The 'vibration status' annotation on the left refers purely to the spatial location of the haptic feedback, not to its frequency or intensity. (c) The general interface screen displayed to participants during the experiment.
• Figure 4: Normalized confusion matrices illustrating the tactile classification performance of Visually Impaired (VI) participants (left) and Sighted (S) participants (right). The matrices map the actual stimulus state (rows: p' = positive, n' = negative) to the participants' predicted response (columns: p = positive, n = negative). Values represent the normalized proportion of responses for each condition, with color intensity corresponding to the magnitude as shown in the color bar. VI participants achieved a lower false positive rate (n'/p = 0.01), compared to the S participants (n'/p = 0.31).
• Figure 5: Mean judgment time (ms) per test trial for Visually Impaired (VI) and Sighted (S) participant groups. The graph shows the judgment time for VI participants starting significantly higher but rapidly decreasing, indicating a learning effect and convergence towards the S participant baseline over 20 trials.