Table of Contents
Fetching ...

Accelerated Tensor Completion via Trace-Regularized Fully-Connected Tensor Network

Wenchao Xie, Qingsong Wang, Chengcheng Yan, Zheng Peng

TL;DR

This work tackles the challenge of recovering local details in high-dimensional tensor completion by integrating trace regularization into the fully-connected tensor network ($\mathrm{FCTN}$) framework. The proposed AFCTNLR model leverages trace penalties on mode-$k$ unfoldings with a periodically modified negative Laplacian to promote smoothness of the FCTN factors, improving local detail recovery without sacrificing global low-rank structure. A proximal alternating minimization (PAM) algorithm solves the model, and an intermediate tensor reutilization mechanism reduces runtime by 10%–30% while preserving accuracy; convergence to a critical point is theoretically established under the K-Ł property. Empirical results on color videos and multi-temporal hyperspectral images show that AFCTNLR yields superior PSNR/SSIM and competitive runtimes compared with state-of-the-art baselines, demonstrating practical impact for high-dimensional tensor completion tasks.

Abstract

The fully-connected tensor network (FCTN) decomposition has gained prominence in the field of tensor completion owing to its powerful capacity to capture the low-rank characteristics of tensors. Nevertheless, the recovery of local details in the reconstructed tensor still leaves scope for enhancement. In this paper, we propose efficient tensor completion model that incorporates trace regularization within the FCTN decomposition framework. The trace regularization is constructed based on the mode-$k$ unfolding of the FCTN factors combined with periodically modified negative laplacian. The trace regularization promotes the smoothness of the FCTN factors through discrete second-order derivative penalties, thereby enhancing the continuity and local recovery performance of the reconstructed tensor. To solve the proposed model, we develop an efficient algorithm within the proximal alternating minimization (PAM) framework and theoretically prove its convergence. To reduce the runtime of the proposed algorithm, we design an intermediate tensor reuse mechanism that can decrease runtime by 10\%-30\% without affecting image recovery, with more significant improvements for larger-scale data. A comprehensive complexity analysis reveals that the mechanism attains a reduced computational complexity. Numerical experiments demonstrate that the proposed method outperforms existing approaches.

Accelerated Tensor Completion via Trace-Regularized Fully-Connected Tensor Network

TL;DR

This work tackles the challenge of recovering local details in high-dimensional tensor completion by integrating trace regularization into the fully-connected tensor network () framework. The proposed AFCTNLR model leverages trace penalties on mode- unfoldings with a periodically modified negative Laplacian to promote smoothness of the FCTN factors, improving local detail recovery without sacrificing global low-rank structure. A proximal alternating minimization (PAM) algorithm solves the model, and an intermediate tensor reutilization mechanism reduces runtime by 10%–30% while preserving accuracy; convergence to a critical point is theoretically established under the K-Ł property. Empirical results on color videos and multi-temporal hyperspectral images show that AFCTNLR yields superior PSNR/SSIM and competitive runtimes compared with state-of-the-art baselines, demonstrating practical impact for high-dimensional tensor completion tasks.

Abstract

The fully-connected tensor network (FCTN) decomposition has gained prominence in the field of tensor completion owing to its powerful capacity to capture the low-rank characteristics of tensors. Nevertheless, the recovery of local details in the reconstructed tensor still leaves scope for enhancement. In this paper, we propose efficient tensor completion model that incorporates trace regularization within the FCTN decomposition framework. The trace regularization is constructed based on the mode- unfolding of the FCTN factors combined with periodically modified negative laplacian. The trace regularization promotes the smoothness of the FCTN factors through discrete second-order derivative penalties, thereby enhancing the continuity and local recovery performance of the reconstructed tensor. To solve the proposed model, we develop an efficient algorithm within the proximal alternating minimization (PAM) framework and theoretically prove its convergence. To reduce the runtime of the proposed algorithm, we design an intermediate tensor reuse mechanism that can decrease runtime by 10\%-30\% without affecting image recovery, with more significant improvements for larger-scale data. A comprehensive complexity analysis reveals that the mechanism attains a reduced computational complexity. Numerical experiments demonstrate that the proposed method outperforms existing approaches.
Paper Structure (14 sections, 2 theorems, 44 equations, 9 figures, 10 tables, 2 algorithms)

This paper contains 14 sections, 2 theorems, 44 equations, 9 figures, 10 tables, 2 algorithms.

Key Result

Theorem 1

(Fast solution of the Sylvester matrix equation Sylvester1867Zheng2022) Suppose that $\mathbf{M} \in \mathbb{R}^{m \times m}, \mathbf{N} \in \mathbb{R}^{n \times n}$ and $\mathbf{X}, \mathbf{Y} \in \mathbb{R}^{m \times n}$. If $\mathbf{I}_{n} \otimes \mathbf{M}+\mathbf{N}^{T} \otimes \mathbf{I}_{m}$ has a unique solution. In addition, if $\mathbf{M}$ and $\mathbf{N}$ can be decomposed into where

Figures (9)

  • Figure 1: The fourth-order FCTN decomposition of tensor.
  • Figure 2: Common intermediate tensor of $\mathcal{M}_1$ and $\mathcal{M}_2$.
  • Figure 3: Common intermediate tensor of $\mathcal{M}_3$ and $\mathcal{M}_4$.
  • Figure 4: Generate $\operatorname{FCTN}\left(\left\{\mathcal{A}_{k}^{(t+1)}\right\}_{k=1}^{4}\right)$ using $\mathcal{M}_{4}^{(t)}$.
  • Figure 5: Distinct combinations for generating $\operatorname{FCTN}\left(\left\{\mathcal{A}_{k}^{(t+1)}\right\}_{k=1}^{4}\right)$.
  • ...and 4 more figures

Theorems & Definitions (3)

  • Theorem 1
  • Theorem 2
  • proof