Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality

Arthur Caetano, Misha Sra

TL;DR

ARfy is presented, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces and makes any generic 3D scene automatically AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.

Abstract

Virtual content placement in physical scenes is a crucial aspect of augmented reality (AR). This task is particularly challenging when the virtual elements must adapt to multiple target physical environments that are unknown during development. AR authors use strategies such as manual placement performed by end-users, automated placement powered by author-defined constraints, and procedural content generation to adapt virtual content to physical spaces. Although effective, these options require human effort or annotated virtual assets. As an alternative, we present ARfy, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces. ARfy does not require intervention by end-users or asset annotation by AR authors. We demonstrate the pipeline capabilities using simulations on a publicly available indoor space dataset. ARfy automatically makes any generic 3D scene AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.

ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality

TL;DR

ARfy is presented, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces and makes any generic 3D scene automatically AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.

Abstract

Virtual content placement in physical scenes is a crucial aspect of augmented reality (AR). This task is particularly challenging when the virtual elements must adapt to multiple target physical environments that are unknown during development. AR authors use strategies such as manual placement performed by end-users, automated placement powered by author-defined constraints, and procedural content generation to adapt virtual content to physical spaces. Although effective, these options require human effort or annotated virtual assets. As an alternative, we present ARfy, a pipeline to support the adaptive placement of virtual content from pre-existing 3D scenes in arbitrary physical spaces. ARfy does not require intervention by end-users or asset annotation by AR authors. We demonstrate the pipeline capabilities using simulations on a publicly available indoor space dataset. ARfy automatically makes any generic 3D scene AR-ready and provides evaluation tools to facilitate future research on adaptive virtual content placement.

Paper Structure

This paper contains 8 sections, 2 figures.

Table of Contents

  1. Introduction
  2. Pipeline Design
  3. Development Stage
  4. Evaluation Stage
  5. Runtime Stage
  6. Demonstration
  7. Discussion, Limitations and Future Work
  8. Conclusion

Figures (2)

  • Figure 1: Runtime: extracting point cloud from physical space to align virtual scene. Development: extracting point cloud from virtual scene to support runtime and evaluation. Evaluation: visualizing placement error of the virtual scene in the test dataset as a heatmap.
  • Figure 2: Top: best alignment with error 0.026 on video id 47332911. Bottom: worst alignment with error 3.639 on video id 45261190.