Table of Contents
Fetching ...

Fourier Low-rank and Sparse Tensor for Efficient Tensor Completion

Jingyang Li, Jiuqian Shang, Yang Chen

TL;DR

This paper addresses tensor completion for spatiotemporal data by moving beyond symmetric low-rank models to a Fourier-domain hybrid: low-frequency components are modeled as low-rank and high-frequency components as sparse, forming the Fourier Low-rank and Sparse Tensor (FLoST). The authors derive an efficient, parallelizable estimator that decouples into independent subproblems in the Fourier domain, employs singular value shrinkage for low-rank parts and soft-thresholding for sparse parts, and provide a provable, near-optimal error bound that can be independent of the time dimension. Theoretical guarantees show the estimator achieves favorable sample complexity with dof scaling and improves upon tubal-rank bounds, while numerical experiments on synthetic data and TEC maps demonstrate higher accuracy and lower computational cost compared to baselines. Overall, FLoST offers a physically aligned, scalable approach for reconstructing large spatiotemporal tensors with missing data, delivering interpretable structure and practical impact for TEC and related domains.

Abstract

Tensor completion is crucial in many scientific domains with missing data problems. Traditional low-rank tensor models, including CP, Tucker, and Tensor-Train, exploit low-dimensional structures to recover missing data. However, these methods often treat all tensor modes symmetrically, failing to capture the unique spatiotemporal patterns inherent in scientific data, where the temporal component exhibits both low-frequency stability and high-frequency variations. To address this, we propose a novel model, \underline{F}ourier \underline{Lo}w-rank and \underline{S}parse \underline{T}ensor (FLoST), which decomposes the tensor along the temporal dimension using a Fourier transform. This approach captures low-frequency components with low-rank matrices and high-frequency fluctuations with sparsity, resulting in a hybrid structure that efficiently models both smooth and localized variations. Compared to the well-known tubal-rank model, which assumes low-rankness across all frequency components, FLoST requires significantly fewer parameters, making it computationally more efficient, particularly when the time dimension is large. Through theoretical analysis and empirical experiments, we demonstrate that FLoST outperforms existing tensor completion models in terms of both accuracy and computational efficiency, offering a more interpretable solution for spatiotemporal data reconstruction.

Fourier Low-rank and Sparse Tensor for Efficient Tensor Completion

TL;DR

This paper addresses tensor completion for spatiotemporal data by moving beyond symmetric low-rank models to a Fourier-domain hybrid: low-frequency components are modeled as low-rank and high-frequency components as sparse, forming the Fourier Low-rank and Sparse Tensor (FLoST). The authors derive an efficient, parallelizable estimator that decouples into independent subproblems in the Fourier domain, employs singular value shrinkage for low-rank parts and soft-thresholding for sparse parts, and provide a provable, near-optimal error bound that can be independent of the time dimension. Theoretical guarantees show the estimator achieves favorable sample complexity with dof scaling and improves upon tubal-rank bounds, while numerical experiments on synthetic data and TEC maps demonstrate higher accuracy and lower computational cost compared to baselines. Overall, FLoST offers a physically aligned, scalable approach for reconstructing large spatiotemporal tensors with missing data, delivering interpretable structure and practical impact for TEC and related domains.

Abstract

Tensor completion is crucial in many scientific domains with missing data problems. Traditional low-rank tensor models, including CP, Tucker, and Tensor-Train, exploit low-dimensional structures to recover missing data. However, these methods often treat all tensor modes symmetrically, failing to capture the unique spatiotemporal patterns inherent in scientific data, where the temporal component exhibits both low-frequency stability and high-frequency variations. To address this, we propose a novel model, \underline{F}ourier \underline{Lo}w-rank and \underline{S}parse \underline{T}ensor (FLoST), which decomposes the tensor along the temporal dimension using a Fourier transform. This approach captures low-frequency components with low-rank matrices and high-frequency fluctuations with sparsity, resulting in a hybrid structure that efficiently models both smooth and localized variations. Compared to the well-known tubal-rank model, which assumes low-rankness across all frequency components, FLoST requires significantly fewer parameters, making it computationally more efficient, particularly when the time dimension is large. Through theoretical analysis and empirical experiments, we demonstrate that FLoST outperforms existing tensor completion models in terms of both accuracy and computational efficiency, offering a more interpretable solution for spatiotemporal data reconstruction.
Paper Structure (14 sections, 5 theorems, 54 equations, 4 figures, 1 table, 1 algorithm)

This paper contains 14 sections, 5 theorems, 54 equations, 4 figures, 1 table, 1 algorithm.

Key Result

Theorem 1

Assume the noise ${\mathcal{E}}_{ijt}$ are independently distributed centered sub-Gaussian random variables with proxy variance $\sigma^2$, and $\max_{ijt}|[{\mathcal{T}}_0]_{ijt}|\leq \gamma$. If we choose Then we have with probability exceeding $1-2(M\vee N\vee T)^{-10}$.

Figures (4)

  • Figure 1: Comparison of truncation results using the proposed FLoST model and the tubal-rank model on TEC data.
  • Figure 2: Structure of FLoST in frequency domain.
  • Figure 3: Total electron content (TEC) maps for four representative times between 21–26 June 2019. The VISTA reference (top) is compared with reconstructions from $\textsf{FLoST}$ with $K=100$, $K=400$ and $K=865$; where $K=865$ corresponds to the model without high‑frequency sparsity. Columns list UTC timestamps; horizontal axis is local time (LT), vertical axis latitude. Color bar gives TEC in TEC Unit (TECU).
  • Figure 4: Root‑mean‑square error (RMSE) of the reconstructed tensor per 192‑frame interval. The two facets separate results on the training (observed) and test (missing) data. Colors indicate the subset of pixels used for RMSE evaluation: all pixels or only those whose true value exceeds the 75th, 95th, or 99th percentiles of the ground‑truth tensor. Line style encodes the $K$ value of $\textsf{FLoST}$; $K=865$ corresponds to the model without high‑frequency sparsity. Curves are means of 100 runs with ± 3 s.d. bands. For scale reference, the largest true‑tensor pixel value rounds to 31.

Theorems & Definitions (11)

  • Definition 1
  • Remark 1: Connections with Multi-rank and tubal-rank
  • Theorem 1
  • Corollary 1
  • proof
  • Lemma 1
  • proof
  • Lemma 2
  • proof
  • Lemma 3
  • ...and 1 more