Hybrid Drawing Solutions in AR Bitmap-to-Vector Techniques on 3D Surfaces
Pengcheng Ding, Yedian Cheng, Mirjana Prpa
TL;DR
This work addresses the need for precise, scalable drawing on 3D surfaces in AR by introducing Draw2Vector, a hybrid tool that combines bitmap sketching with real-time vectorization on 3D models. Implemented on HoloLens 2 with Unity, it enables rapid freehand annotations that are vectorized into editable, scalable curves bound to surface geometry. A user study with engineers and developers demonstrates substantial data-size reductions (~86%) and improved curve smoothness, while highlighting challenges in handling complex geometries and UI responsiveness. Overall, the approach advances AR-assisted engineering workflows by delivering fast, editable, and scalable on-surface drawings suitable for large-scale projects.
Abstract
Recent advancements in augmented reality and virtual reality have significantly enhanced workflows for drawing 3D objects. Despite these technological strides, existing AR tools often lack the necessary precision and struggle to maintain quality when scaled, posing challenges for larger-scale drawing tasks. This paper introduces a novel AR tool that uniquely integrates bitmap drawing and vectorization techniques. This integration allows engineers to perform rapid, real-time drawings directly on 3D models, with the capability to vectorize the data for scalable accuracy and editable points, ensuring no loss in fidelity when modifying or resizing the drawings. We conducted user studies involving professional engineers, designers, and contractors to evaluate the tool's integration into existing workflows, its usability, and its impact on project outcomes. The results demonstrate that our enhancements significantly improve the efficiency of drawing processes. Specifically, the ability to perform quick, editable, and scalable drawings directly on 3D models not only enhances productivity but also ensures adaptability across various project sizes and complexities.