Table of Contents
Fetching ...

Solving exact and noisy rank-one tensor completion with semidefinite programming

Diego Cifuentes, Zhuorui Li

TL;DR

This work addresses exact and robust recovery for rank-one tensors from partial observations by formulating semidefinite programming relaxations that capitalize on combinatorial propagation conditions of the observation mask $\Omega$. The authors establish four deterministic propagation notions (GS, S, SR, A) with precise implications and demonstrate that, under SR-propagation, a compact SDP with a matrix variable of size $(N{+}1)\times(N{+}1)$ exactly recovers the tensor in the noiseless case and stably recovers it under noise. They further show that, for random masks, these propagation conditions hold whp with sample complexity $O\big(\sqrt{N}\,\mathrm{polylog}\,N\big)$, matching the best known results in the random setting while accommodating structured masks. The approach is extended via weighted and SOS-based variants to broaden the regime of exact recovery, and experiments indicate substantial gains over existing methods in both exact and noisy regimes, including a scalable solver for larger problems and a low-rank extension for practical applications like image inpainting.

Abstract

Consider recovering a rank-one tensor of size $n_1 \times \cdots \times n_d$ from exact or noisy observations of a few of its entries. We tackle this problem via semidefinite programming (SDP). We derive deterministic combinatorial conditions on the observation mask $Ω$ (the set of observed indices) under which our SDPs solve the exact completion and achieve robust recovery in the noisy regime. These conditions can be met with as few as $\bigl(\sum_{i=1}^d n_i\bigr) - d + 1$ observations for special $Ω$. When $Ω$ is uniformly random, our conditions hold with $O\!\bigl((\prod_{i=1}^d n_i)^{1/2}\,\mathrm{polylog}(\prod_{i=1}^d n_i)\bigr)$ observations. Prior works mostly focus on the uniformly random case, ignoring the practical relevance of structured masks. For $d=2$ (matrix completion), our propagation condition holds if and only if the completion problem admits a unique solution. Our results apply to tensors of arbitrary order and cover both exact and noisy settings. In contrast to much of the literature, our guarantees rely solely on the combinatorial structure of the observation mask, without incoherence assumptions on the ground-truth tensor or uniform randomness of the samples. Preliminary computational experiments show that our SDP methods solve tensor completion problems using significantly fewer observations than alternative methods.

Solving exact and noisy rank-one tensor completion with semidefinite programming

TL;DR

This work addresses exact and robust recovery for rank-one tensors from partial observations by formulating semidefinite programming relaxations that capitalize on combinatorial propagation conditions of the observation mask . The authors establish four deterministic propagation notions (GS, S, SR, A) with precise implications and demonstrate that, under SR-propagation, a compact SDP with a matrix variable of size exactly recovers the tensor in the noiseless case and stably recovers it under noise. They further show that, for random masks, these propagation conditions hold whp with sample complexity , matching the best known results in the random setting while accommodating structured masks. The approach is extended via weighted and SOS-based variants to broaden the regime of exact recovery, and experiments indicate substantial gains over existing methods in both exact and noisy regimes, including a scalable solver for larger problems and a low-rank extension for practical applications like image inpainting.

Abstract

Consider recovering a rank-one tensor of size from exact or noisy observations of a few of its entries. We tackle this problem via semidefinite programming (SDP). We derive deterministic combinatorial conditions on the observation mask (the set of observed indices) under which our SDPs solve the exact completion and achieve robust recovery in the noisy regime. These conditions can be met with as few as observations for special . When is uniformly random, our conditions hold with observations. Prior works mostly focus on the uniformly random case, ignoring the practical relevance of structured masks. For (matrix completion), our propagation condition holds if and only if the completion problem admits a unique solution. Our results apply to tensors of arbitrary order and cover both exact and noisy settings. In contrast to much of the literature, our guarantees rely solely on the combinatorial structure of the observation mask, without incoherence assumptions on the ground-truth tensor or uniform randomness of the samples. Preliminary computational experiments show that our SDP methods solve tensor completion problems using significantly fewer observations than alternative methods.

Paper Structure

This paper contains 32 sections, 18 theorems, 131 equations, 6 figures, 2 tables, 2 algorithms.

Key Result

Proposition 1

A set $\Omega \subseteq {\llbracket N \rrbracket}$ satisfies unique recovery if and only if the matrix $V_{\Omega}^{\mathbb{F}_2}$ from ind_mat has rank $n-d + 1$ (over $\mathbb{F}_2$).

Figures (6)

  • Figure 1: A square (left) and a generalized square (right).
  • Figure 2: Percentage of random completion problems that are recovered exactly by the methods: \ref{['eq:sdp2']}, \ref{['eq:weighted_sdp']}, SDP Potechin-Steurer potechin2017exact, alternating minimization. The $x$ axes is the number of observations used.
  • Figure 3: Relative Distance (with 45% - 55% quantile) obtained by the methods: \ref{['eq:sdp-p']}, SDP Potechin-Steurer potechin2017exact, alternating minimization. The $x$ axes is the number of observations used.
  • Figure 4: Relative Distance (with 45% - 55% quantile) obtained by the methods: \ref{['eq:sdp-p']}, SDP Potechin-Steurer potechin2017exact, alternating minimization. The $x$ axes is the number of observations used.
  • Figure 5: Application to image inpainting: ${\llbracket N \rrbracket} = {256\times 256\times 3}$
  • ...and 1 more figures

Theorems & Definitions (55)

  • Proposition 1
  • proof
  • Example 1
  • Example 2: GS holds
  • Example 3: GS fails
  • Example 4: S holds
  • Example 5: S fails
  • Example 6: SR holds
  • Example 7: SR fails
  • Remark
  • ...and 45 more