Table of Contents
Fetching ...

Love in Action: Gamifying Public Video Cameras for Fostering Social Relationships in Real World

Zhang Zhang, Da Li, Geng Wu, Yaoning Li, Xiaobing Sun, Liang Wang

TL;DR

An AI-enhanced video analysis system is built incorporating multiple visual analysis modules like person detection, attribute recognition, and action recognition, to assess the performer's body language quality and shows significant improvements in their social friendships.

Abstract

In this paper, we create "Love in Action" (LIA), a body language-based social game utilizing video cameras installed in public spaces to enhance social relationships in real-world. In the game, participants assume dual roles, i.e., requesters, who issue social requests, and performers, who respond social requests through performing specified body languages. To mediate the communication between participants, we build an AI-enhanced video analysis system incorporating multiple visual analysis modules like person detection, attribute recognition, and action recognition, to assess the performer's body language quality. A two-week field study involving 27 participants shows significant improvements in their social friendships, as indicated by self-reported questionnaires. Moreover, user experiences are investigated to highlight the potential of public video cameras as a novel communication medium for socializing in public spaces.

Love in Action: Gamifying Public Video Cameras for Fostering Social Relationships in Real World

TL;DR

An AI-enhanced video analysis system is built incorporating multiple visual analysis modules like person detection, attribute recognition, and action recognition, to assess the performer's body language quality and shows significant improvements in their social friendships.

Abstract

In this paper, we create "Love in Action" (LIA), a body language-based social game utilizing video cameras installed in public spaces to enhance social relationships in real-world. In the game, participants assume dual roles, i.e., requesters, who issue social requests, and performers, who respond social requests through performing specified body languages. To mediate the communication between participants, we build an AI-enhanced video analysis system incorporating multiple visual analysis modules like person detection, attribute recognition, and action recognition, to assess the performer's body language quality. A two-week field study involving 27 participants shows significant improvements in their social friendships, as indicated by self-reported questionnaires. Moreover, user experiences are investigated to highlight the potential of public video cameras as a novel communication medium for socializing in public spaces.

Paper Structure

This paper contains 22 sections, 1 equation, 7 figures, 2 tables.

Figures (7)

  • Figure 1: Some representative self-expressions using different clothing fashions, accessories and postures, which are termed body languages in this paper. The images are sourced from online news.
  • Figure 2: Basic game mechanics in LIA. The right figure is from an online news, where a woman in Beijing instructed her husband to display a sign of love towards a camera at the lakeside of XiHu (West Lake) during an video live broadcast.
  • Figure 3: The flowchart of LIA gaming process.
  • Figure 4: The pipeline of performance quality evaluation, where $\bigotimes$ denotes the element-wise product between two vectors and $\bigoplus$ denotes the weighted average calculator.
  • Figure 5: Illustrations of the five camera scenes selected for experiencing the LIA.
  • ...and 2 more figures