Augmented Reality-Based Smart Structural Health Monitoring System With Accurate 3D Model Alignment

TL;DR

This paper tackles the challenge of efficient, quantitative SHM in civil infrastructure by presenting an AR-based workflow that tightly integrates BIM visualization with automatic 3D model alignment via Vuforia. The framework enables on-site AR visualization, flexible manipulation of 3D models and damage locations, and cloud-based remote collaboration using HoloLens 2. Experimental validation on a lab-scale beam and a full-scale bridge demonstrates accurate model alignment, actionable damage measurements, and faster remote data transfer with 5G compared to 4G. The work addresses gaps in quantitative damage data, large-scale model handling, and real-time collaboration, delivering a practical, field-ready AR SHM solution with clear pathways for future AI-assisted improvements.

Abstract

Structural Health Monitoring (SHM) has become increasingly critical due to the rapid deterioration of civil infrastructure. Traditional methods involving heavy equipment are costly and time-consuming. Recent SHM approaches use advanced non-contact sensors, IoT, and Augmented Reality (AR) glasses for faster inspections and immersive experiences during inspections. However, current methods lack quantitative damage data, remote collaboration support, and accurate 3D model alignment with the real structure. Recognizing these current challenges, this paper proposes an AR-based system that integrates Building Information Modelling (BIM) visualization and follows a flexible manipulation approach of 3D holograms to improve structural condition assessments. The proposed framework utilizes the Vuforia software development toolkit to enable the automatic alignment of 3D models to the real structure, ensuring successful model alignment to assist users in accurately visualizing damage locations. The framework also enables flexible manipulation of damage locations, making it easier for users to identify multiple damage points in the 3D models. The system is validated through lab-scale and full-scale bridge use cases, with data transfer performance analyzed under 4G and 5G conditions for remote collaboration. This study demonstrates that the proposed AR-based SHM framework successfully aligns 3D models with real structures, allowing users to manually adjust models and damage locations. The experimental results confirm its feasibility for remote collaborative inspections, highlighting significant improvements with 5G networks. Nevertheless, performance under 4G remains acceptable, ensuring reliability even without 5G coverage.

Figures (17)

• Figure 1: Traditional flow of BIM for damage assessment.
• Figure 2: Workflow of the proposed AR framework.
• Figure 3: Flowchart illustrating the interaction between Vuforia and AR.
• Figure 7: (a) Large size 3D beam model, (b) small size 3D beam model.
• Figure 8: The user adding a new location marker to the 3D model.