Table of Contents
Fetching ...

STT-GS: Sample-Then-Transmit Edge Gaussian Splatting with Joint Client Selection and Power Control

Zhen Li, Xibin Jin, Guoliang Li, Shuai Wang, Miaowen Wen, Huseyin Arslan, Derrick Wing Kwan Ng, Chengzhong Xu

TL;DR

The paper tackles GS-oriented 3D reconstruction in edge networks by addressing a causality dilemma: the objective for rendering quality depends on data that is only available after transmission. It introduces a two-stage STT-GS framework that first predicts GS loss from pilot data and then optimizes client scheduling and power via a PAMM-based JCSPC approach, augmented by FDC for efficient sampling and PTTM to minimize pilot overhead. Experimental results on real drone LAE datasets demonstrate that STT-GS with FDC/PTTM/PAMM yields notable gains in PSNR, SSIM, and LPIPS over traditional throughput- and learning-focused baselines, while maintaining strict communication budgets. This cross-layer method provides a practical path to high-quality edge GS rendering in distributed, resource-constrained environments by prioritizing data contributions that most improve the GS model.

Abstract

Edge Gaussian splatting (EGS), which aggregates data from distributed clients (e.g., drones) and trains a global GS model at the edge (e.g., ground server), is an emerging paradigm for scene reconstruction in low-altitude economy. Unlike traditional edge resource management methods that emphasize communication throughput or general-purpose learning performance, EGS explicitly aims to maximize the GS qualities, rendering existing approaches inapplicable. To address this problem, this paper formulates a novel GS-oriented objective function that distinguishes the heterogeneous view contributions of different clients. However, evaluating this function in turn requires clients' images, leading to a causality dilemma. To this end, this paper further proposes a sample-then-transmit EGS (or STT-GS for short) strategy, which first samples a subset of images as pilot data from each client for loss prediction. Based on the first-stage evaluation, communication resources are then prioritized towards more valuable clients. To achieve efficient sampling, a feature-domain clustering (FDC) scheme is proposed to select the most representative data and pilot transmission time minimization (PTTM) is adopted to reduce the pilot overhead. Subsequently, we develop a joint client selection and power control (JCSPC) framework to maximize the GS-oriented function under communication resource constraints. Despite the nonconvexity of the problem, we propose a low-complexity efficient solution based on the penalty alternating majorization minimization (PAMM) algorithm. Experiments reveal that the proposed scheme significantly outperforms existing benchmarks on real-world datasets. The GS-oriented objective can be accurately predicted with low sampling ratios (e.g., 10%), and our method achieves an excellent tradeoff between view contributions and communication costs.

STT-GS: Sample-Then-Transmit Edge Gaussian Splatting with Joint Client Selection and Power Control

TL;DR

The paper tackles GS-oriented 3D reconstruction in edge networks by addressing a causality dilemma: the objective for rendering quality depends on data that is only available after transmission. It introduces a two-stage STT-GS framework that first predicts GS loss from pilot data and then optimizes client scheduling and power via a PAMM-based JCSPC approach, augmented by FDC for efficient sampling and PTTM to minimize pilot overhead. Experimental results on real drone LAE datasets demonstrate that STT-GS with FDC/PTTM/PAMM yields notable gains in PSNR, SSIM, and LPIPS over traditional throughput- and learning-focused baselines, while maintaining strict communication budgets. This cross-layer method provides a practical path to high-quality edge GS rendering in distributed, resource-constrained environments by prioritizing data contributions that most improve the GS model.

Abstract

Edge Gaussian splatting (EGS), which aggregates data from distributed clients (e.g., drones) and trains a global GS model at the edge (e.g., ground server), is an emerging paradigm for scene reconstruction in low-altitude economy. Unlike traditional edge resource management methods that emphasize communication throughput or general-purpose learning performance, EGS explicitly aims to maximize the GS qualities, rendering existing approaches inapplicable. To address this problem, this paper formulates a novel GS-oriented objective function that distinguishes the heterogeneous view contributions of different clients. However, evaluating this function in turn requires clients' images, leading to a causality dilemma. To this end, this paper further proposes a sample-then-transmit EGS (or STT-GS for short) strategy, which first samples a subset of images as pilot data from each client for loss prediction. Based on the first-stage evaluation, communication resources are then prioritized towards more valuable clients. To achieve efficient sampling, a feature-domain clustering (FDC) scheme is proposed to select the most representative data and pilot transmission time minimization (PTTM) is adopted to reduce the pilot overhead. Subsequently, we develop a joint client selection and power control (JCSPC) framework to maximize the GS-oriented function under communication resource constraints. Despite the nonconvexity of the problem, we propose a low-complexity efficient solution based on the penalty alternating majorization minimization (PAMM) algorithm. Experiments reveal that the proposed scheme significantly outperforms existing benchmarks on real-world datasets. The GS-oriented objective can be accurately predicted with low sampling ratios (e.g., 10%), and our method achieves an excellent tradeoff between view contributions and communication costs.
Paper Structure (29 sections, 1 theorem, 43 equations, 14 figures, 5 tables, 3 algorithms)

This paper contains 29 sections, 1 theorem, 43 equations, 14 figures, 5 tables, 3 algorithms.

Key Result

Proposition 1

The functions $\{\widehat{\varphi}_1,\widehat{\Phi}_k\}$ satisfy the following: (i) Upper bound: (ii) Convexity: $\widehat{\varphi}_1(\mathbf x|\mathbf x^\star )$ is convex in $\mathbf{x}$, and $\widehat{\Phi}_{k}(\mathbf{x},\bm{\xi}|\bm{\xi}^\star)$ is convex in $(\mathbf{x},\bm{\xi})$. (iii) Local equivalence:

Figures (14)

  • Figure 1: The EGS system with client selection, power allocation, and beamforming receiver.
  • Figure 2: Workflow of STT-GS: (1) FDC-based sampling at clients, (2) transmission of sampled data, (3) loss prediction, (4) PTTM & JCSPC optimization, (5) client selection and power allocation, (6) full data transmission, (7) server-side data aggregation, and (8) global model training. Communication is divided into a sampling stage (blue) and a transmission stage (red).
  • Figure 3: Sampling workflow of FDC.
  • Figure 4:
  • Figure 6:
  • ...and 9 more figures

Theorems & Definitions (3)

  • Remark 1
  • Proposition 1
  • proof