SSUP-HRI: Social Signaling in Urban Public Human-Robot Interaction dataset

TL;DR

This paper introduces the first dataset showcasing robot deployments in a complete public, non-controlled setting involving urban residents, and annotated a total of 274 observable interactions featuring a wide range of naturalistic human-robot interactions.

Abstract

This paper introduces our dataset featuring human-robot interactions (HRI) in urban public environments. This dataset is rich with social signals that we believe can be modeled to help understand naturalistic human-robot interaction. Our dataset currently comprises approximately 15 hours of video footage recorded from the robots' perspectives, within which we annotated a total of 274 observable interactions featuring a wide range of naturalistic human-robot interactions. The data was collected by two mobile trash barrel robots deployed in Astor Place, New York City, over the course of a week. We invite the HRI community to access and utilize our dataset. To the best of our knowledge, this is the first dataset showcasing robot deployments in a complete public, non-controlled setting involving urban residents.

Figures (3)

• Figure 1: A bird-eye view of our deployment space.
• Figure 2: Exploded diagram of robot.
• Figure 3: LLM generated captions with inputs from our field study.