Augmented Radiance Field: A General Framework for Enhanced Gaussian Splatting

TL;DR

A novel enhanced Gaussian kernel that explicitly models specular effects through view-dependent opacity is proposed that not only surpasses state-of-the-art NeRF methods in rendering performance but also achieves greater parameter efficiency.

Abstract

Due to the real-time rendering performance, 3D Gaussian Splatting (3DGS) has emerged as the leading method for radiance field reconstruction. However, its reliance on spherical harmonics for color encoding inherently limits its ability to separate diffuse and specular components, making it challenging to accurately represent complex reflections. To address this, we propose a novel enhanced Gaussian kernel that explicitly models specular effects through view-dependent opacity. Meanwhile, we introduce an error-driven compensation strategy to improve rendering quality in existing 3DGS scenes. Our method begins with 2D Gaussian initialization and then adaptively inserts and optimizes enhanced Gaussian kernels, ultimately producing an augmented radiance field. Experiments demonstrate that our method not only surpasses state-of-the-art NeRF methods in rendering performance but also achieves greater parameter efficiency. Project page at: https://xiaoxinyyx.github.io/augs.

Figures (10)

• Figure 1: We propose an augmented radiance field, which leverages Gaussian kernels with view-dependent opacity to accurately model specular highlights in the scene (left). It can be seamlessly plugged into existing Gaussian Splatting-based methods as a post enhancement, and notably, even using second-order spherical harmonics (sh=2) is sufficient to capture complex illumination (right).
• Figure 2: Our post-enhancement method for Gaussian Splatting. We begin with image-space refinement using 2D Gaussians to reconstruct regions exhibiting significant errors (left). Leveraging geometric information from depth maps, we then project these 2D Gaussians into world space (middle). The newly added Gaussians feature optimizable view-dependent opacity and are jointly optimized with existing Gaussians to recover challenging view-dependent color (right).
• Figure 3: Inspired by classical Phong shading, we model view-dependent opacity with a cosine-weighted function whose shape is controlled by two parameters: $\beta$, which governs the lobe's sharpness, and $T$, which determines its angular extent. Along with the central orientation of the lobe, each new kernel introduces 5 learnable parameters to a standard Gaussian primitive.
• Figure 4: Qualitative comparison across real captured scenes. Benefiting from the newly designed Gaussian kernel with view-dependent transparency and the rendering loss-driven initialization, our approach surpasses all state-of-the-art explicit and implicit methods on real-world datasets.
• Figure 5: Comparison between Spherical Beta functions in DBS liu2025dbs and opacity lobe. The three Gaussians in the first row model color using three differently oriented spherical beta functions, with maximum function values of 1, 2, and 4, all having an opacity of 0.5. The kernels in the second row use three differently oriented opacity lobes, with the same maximum amplitude and identical color intensity. Our method is more stable and flexible in reconstructing outgoing radiance, as it is less affected by the ordering of Gaussian kernels and has greater numerical stability.