Metadata-free Georegistration of Ground and Airborne Imagery
Adam Bredvik, Scott Richardson, Daniel Crispell
TL;DR
This work addresses the problem of georegistering heterogeneous ground and airborne imagery without relying on sensor metadata. It introduces a metadata-free pipeline that uses $NeRF$-based novel-view rendering to bridge domain gaps, combined with the $RoMa$ dense matcher and per-pixel depth to lift 2D correspondences into $3D$ and estimate a similarity transform. The method aligns airborne data to a satellite DSM first, then registers ground data into the airborne frame, demonstrating robust cross-domain performance across three WRIVA sites with quantitative error metrics. By removing dependence on metadata, the approach enables georeferencing of legacy and diverse datasets, enabling integrated multi-view 3D modeling and realistic novel-view rendering across domains.
Abstract
Heterogeneous collections of ground and airborne imagery can readily be used to create high-quality 3D models and novel viewpoint renderings of the observed scene. Standard photogrammetry pipelines generate models in arbitrary coordinate systems, which is problematic for applications that require georegistered models. Even for applications that do not require georegistered models, georegistration is useful as a mechanism for aligning multiple disconnected models generated from non-overlapping data. The proposed method leverages satellite imagery, an associated digital surface model (DSM), and the novel view generation capabilities of modern 3D modeling techniques (e.g. neural radiance fields) to provide a robust method for georegistering airborne imagery, and a related technique for registering ground-based imagery to models created from airborne imagery. Experiments demonstrate successful georegistration of airborne and ground-based photogrammetric models across a variety of distinct sites. The proposed method does not require use of any metadata other than a satellite-based reference product and therefore has general applicability.
