Exploring Device-Oriented Video Encryption for Hierarchical Privacy Protection in AR Content Sharing
Yongquan Hu, Dongsheng Zheng, Kexin Nie, Junyan Zhang, Wen Hu, Aaron Quigley
TL;DR
The paper addresses privacy risks in AR content sharing across multiple displays by protecting the physical environment visible in AR scenes. It introduces a device-oriented hierarchical privacy approach that performs ROI-based video encryption at the bitstream level, using the ROSS scheme with HEVC tiling to selectively encrypt semantically salient areas. This approach achieves large efficiency gains over pixel-level encryption and adapts encryption intensity to the active AR display (projection, smartphone, or AR glasses). The contributions include pioneering bitstream-level ROI encryption in AR contexts, revealing substantial improvements in encryption speed and data footprint while maintaining real-time AR performance. This work enables privacy-preserving, cross-device AR collaboration with tailored protection per display type.
Abstract
Content sharing across multiple Augmented Reality (AR) displays is becoming commonplace, enhancing team communication and collaboration through devices like smartphones and AR glasses. However, this practice raises significant privacy concerns, especially concerning the physical environment visible in AR, which may include sensitive personal details like facial features and identifiable information. Our research focuses on protecting privacy within AR environments, particularly the physical backgrounds visible during content sharing across three common AR display methods: projection, smartphone, and AR glasses. We analyze the potential privacy risks associated with each method and employ a Region Of Interest (ROI) video encryption system to hierarchically encrypt the physical backdrop based on its safety rating. This study pioneers the integration of ROI video encryption at the bitstream level within AR contexts, providing a more efficient solution than traditional pixel-level encryption by enhancing encryption speed and reducing the required space. Our adaptive system dynamically adjusts the encryption intensity based on the AR display method, ensuring tailored privacy protection.