Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Factually: Exploring Wearable Fact-Checking for Augmented Truth Discernment

Chitralekha Gupta, Hanjun Wu, Praveen Sasikumar, Shreyas Sridhar, Priambudi Bagaskara, Suranga Nanayakkara

TL;DR

Factually addresses misinformation in everyday settings by proposing a wearable live fact-checking system that uses discreet vibrotactile cues to alert users and provide context via a connected app. The approach combines LLM-based reasoning with web resources to verify statements in real time, demonstrated through three proof-of-concept scenarios: health misinformation, social conversations, and everyday learning. Early qualitative feedback from ten participants suggests the system is intuitive and useful, though users request more specific vibrotactile cues and topic-sensitive tuning. The work demonstrates a path toward real-time, socially integrated cognitive augmentation that can promote mindful discourse and critical thinking in naturalistic environments.

Abstract

Wearable devices are transforming human capabilities by seamlessly augmenting cognitive functions. In this position paper, we propose a voice-based, interactive learning companion designed to amplify and extend cognitive abilities through informal learning. Our vision is threefold: (1) to enable users to discover new knowledge on-the-go through contextual interactive quizzes, fostering critical thinking and mindfulness, (2) to proactively detect misinformation, empowering users to critically assess information in real time, and (3) to provide spoken language correction and prompting hints for second language learning and effective communication. As an initial step toward this vision, we present Factually - a proactive, wearable fact-checking system integrated into devices like smartwatches or rings. Factually discreetly alerts users to potential falsehoods via vibrotactile feedback, helping them assess information critically. We demonstrate its utility through three illustrative scenarios, highlighting its potential to extend cognitive abilities for real-time misinformation detection. Early qualitative feedback suggests that Factually can enhance users' fact-checking capabilities, offering both practical and experiential benefits.

Factually: Exploring Wearable Fact-Checking for Augmented Truth Discernment

TL;DR

Factually addresses misinformation in everyday settings by proposing a wearable live fact-checking system that uses discreet vibrotactile cues to alert users and provide context via a connected app. The approach combines LLM-based reasoning with web resources to verify statements in real time, demonstrated through three proof-of-concept scenarios: health misinformation, social conversations, and everyday learning. Early qualitative feedback from ten participants suggests the system is intuitive and useful, though users request more specific vibrotactile cues and topic-sensitive tuning. The work demonstrates a path toward real-time, socially integrated cognitive augmentation that can promote mindful discourse and critical thinking in naturalistic environments.

Abstract

Wearable devices are transforming human capabilities by seamlessly augmenting cognitive functions. In this position paper, we propose a voice-based, interactive learning companion designed to amplify and extend cognitive abilities through informal learning. Our vision is threefold: (1) to enable users to discover new knowledge on-the-go through contextual interactive quizzes, fostering critical thinking and mindfulness, (2) to proactively detect misinformation, empowering users to critically assess information in real time, and (3) to provide spoken language correction and prompting hints for second language learning and effective communication. As an initial step toward this vision, we present Factually - a proactive, wearable fact-checking system integrated into devices like smartwatches or rings. Factually discreetly alerts users to potential falsehoods via vibrotactile feedback, helping them assess information critically. We demonstrate its utility through three illustrative scenarios, highlighting its potential to extend cognitive abilities for real-time misinformation detection. Early qualitative feedback suggests that Factually can enhance users' fact-checking capabilities, offering both practical and experiential benefits.

Paper Structure

This paper contains 14 sections, 2 figures.

Table of Contents

  1. Introduction
  2. Related Work
  3. Misinformation Detection and Cognitive Augmentation
  4. Wearables for Misinformation Detection
  5. Real-time Fact Checking
  6. Factually
  7. Design considerations in the Assistive Augmentation space
  8. System Design
  9. Proof-of-concept Scenarios
  10. Scenario 1: Health Misinformation
  11. Scenario 2: Social Conversations
  12. Scenario 3: Everyday Learning
  13. Initial User Reactions
  14. Limitations and Future Work

Figures (2)

  • Figure 1: Overview of the Technical Implementation.
  • Figure 2: Use-Case Scenarios of Factually. (A) Scenario 1: health-related misinformation detection during a conversation between two grand daughters. (B) Scenario 2: misinformation detection during a casual lunch conversation. (C) Scenario 3: misinformation detection during learning.