Table of Contents
Fetching ...

Exact Tensor Completion Powered by Slim Transforms

Li Ge, Lin Chen, Yudong Chen, Xue Jiang

TL;DR

This work advances exact tensor completion by enabling recovery with arbitrary linear transforms through a transform-domain tensor framework. By operating directly in the transform domain, it defines a transform-domain tensor algebra (including ⊛, t-SVD, and tensor norms) and proves a high-probability exact recovery guarantee under incoherence, even for non-orthogonal transforms. A key insight is that slim, non-invertible transforms can outperform square transforms, a result supported by an energy-based analysis and ensemble transform design. The authors validate the theory with extensive experiments on random tensors and visual data (MSI and video), showing superior reconstruction and inpainting performance, thereby broadening the practical applicability of tensor completion. The approach also accommodates data-driven and framelet-like transforms, expanding the toolkit for tensor recovery in multiway data applications.

Abstract

In this work, a tensor completion problem is studied, which aims to perfectly recover the tensor from partial observations. The existing theoretical guarantee requires the involved transform to be orthogonal, which hinders its applications. In this paper, jumping out of the constraints of isotropy and self-adjointness, the theoretical guarantee of exact tensor completion with arbitrary linear transforms is established by directly operating the tensors in the transform domain. With the enriched choices of transforms, a new analysis obtained by the proof discloses why slim transforms outperform their square counterparts from a theoretical level. Our model and proof greatly enhance the flexibility of tensor completion and extensive experiments validate the superiority of the proposed method.

Exact Tensor Completion Powered by Slim Transforms

TL;DR

This work advances exact tensor completion by enabling recovery with arbitrary linear transforms through a transform-domain tensor framework. By operating directly in the transform domain, it defines a transform-domain tensor algebra (including ⊛, t-SVD, and tensor norms) and proves a high-probability exact recovery guarantee under incoherence, even for non-orthogonal transforms. A key insight is that slim, non-invertible transforms can outperform square transforms, a result supported by an energy-based analysis and ensemble transform design. The authors validate the theory with extensive experiments on random tensors and visual data (MSI and video), showing superior reconstruction and inpainting performance, thereby broadening the practical applicability of tensor completion. The approach also accommodates data-driven and framelet-like transforms, expanding the toolkit for tensor recovery in multiway data applications.

Abstract

In this work, a tensor completion problem is studied, which aims to perfectly recover the tensor from partial observations. The existing theoretical guarantee requires the involved transform to be orthogonal, which hinders its applications. In this paper, jumping out of the constraints of isotropy and self-adjointness, the theoretical guarantee of exact tensor completion with arbitrary linear transforms is established by directly operating the tensors in the transform domain. With the enriched choices of transforms, a new analysis obtained by the proof discloses why slim transforms outperform their square counterparts from a theoretical level. Our model and proof greatly enhance the flexibility of tensor completion and extensive experiments validate the superiority of the proposed method.
Paper Structure (34 sections, 7 theorems, 56 equations, 26 figures, 1 table, 5 algorithms)

This paper contains 34 sections, 7 theorems, 56 equations, 26 figures, 1 table, 5 algorithms.

Key Result

Theorem 3.4

Suppose $(\mathcal{X}, \mathit{T})$ satisfies eq:inc_cond_U_V-eq:inc_cond_U_V_T with $\mu, \nu > 0$, $\lambda = \max(\mu, \nu)$, then there exist constants $c_0, c_1, c_2> 0$ such that if then $\mathcal{X}$ is the unique optimal solution to eq:program:min_transformed_TNN with probability at least $1 - c_1((n_1 + n_2)N_3)^{-c_2}$, where $\kappa(\mathbf{T}) = \frac{\sigma_{\max}(\mathbf{T})}{\sigma

Figures (26)

  • Figure 1: Tensor basis $\xi_i, \zeta_k$ and $\xi_j^{\text{H}}$ from left to right. The red cubes represent $1$ and rest represent $0$.
  • Figure 2: Exact completion with varying rank (x-axis) and sampling rate (y-axis). The white cube denotes all failure and the magenta cube denotes all success.
  • Figure 3: Exact completion with varying $\text{rank}(\mathit{T}_1(\mathcal{X}))$ (z-axis), $\text{rank}(\mathit{T}_2(\mathcal{X}))$ (y-axis) and sampling rate (x-axis). The white cube denotes all failure and the magenta cube denotes all success.
  • Figure 4: $\Vert \mathcal{P}_{\mathbb{S}}\mathbf{T}(\mathdutchcal{e}_{ijk}) \Vert_{\text{F}}^2 \vee \Vert \mathcal{P}_{\mathbb{S}}\tilde{\mathbf{T}}(\mathdutchcal{e}_{ijk}) \Vert_{\text{F}}^2$
  • Figure 5: $\Vert \mathbf{T}^{\dag}\mathcal{P}_{\mathbb{S}}\mathbf{T}(\mathdutchcal{e}_{ijk}) \Vert_{\text{F}}^2$
  • ...and 21 more figures

Theorems & Definitions (25)

  • Definition 2.1: Tensor-tensor product
  • Definition 2.2: Tensor (conjugate) transpose
  • Definition 2.3: Identity tensor
  • Definition 2.4: Unitary tensor
  • Definition 2.5: T-SVD
  • Definition 2.6: Tensor tubal rank
  • Definition 2.7: Tensor spectral norm
  • Definition 2.8: Tensor nuclear norm
  • Definition 3.1: Tensor basis
  • Definition 3.2: Tensor incoherence conditions
  • ...and 15 more