Table of Contents
Fetching ...

Convergence of non-linear diagonal frame filtering for regularizing inverse problems

Andrea Ebner, Markus Haltmeier

TL;DR

This work extends diagonal frame filtering for ill-posed inverse problems from linear to general non-linear filters. By formulating nonlinear regularizing filters φ_α and showing their proximity-operator structure, the authors connect non-linear filtered DFDs to variational regularization and to plug-and-play regularization, establishing stability and weak convergence under broad conditions. They present two analytical routes: a stationary reduction to variational regularization and a direct analysis that relaxes the stationarity assumptions, both yielding convergence results to the true solution x^+ as the noise level δ and parameter α vanish with δ^2/α → 0. The paper also discusses a PnP perspective, showing how nonlinear DFD can be interpreted as a PnP scheme with diagonal denoisers, and provides numerical demonstrations comparing nonlinear filters to soft-thresholding. Collectively, the results broaden the theoretical foundation for nonlinear, frame-based regularization techniques in inverse problems and highlight practical connections to PnP methods.

Abstract

Inverse problems are key issues in several scientific areas, including signal processing and medical imaging. Since inverse problems typically suffer from instability with respect to data perturbations, a variety of regularization techniques have been proposed. In particular, the use of filtered diagonal frame decompositions has proven to be effective and computationally efficient. However, existing convergence analysis applies only to linear filters and a few non-linear filters such as soft thresholding. In this paper, we analyze filtered diagonal frame decompositions with general non-linear filters. In particular, our results generalize SVD-based spectral filtering from linear to non-linear filters as a special case. As a first approach, we establish a connection between non-linear diagonal frame filtering and variational regularization, allowing us to use results from variational regularization to derive the convergence of non-linear spectral filtering. In the second approach, as our main theoretical results, we relax the assumptions involved in the variational case while still deriving convergence. Furthermore, we discuss connections between non-linear filtering and plug-and-play regularization and explore potential benefits of this relationship.

Convergence of non-linear diagonal frame filtering for regularizing inverse problems

TL;DR

This work extends diagonal frame filtering for ill-posed inverse problems from linear to general non-linear filters. By formulating nonlinear regularizing filters φ_α and showing their proximity-operator structure, the authors connect non-linear filtered DFDs to variational regularization and to plug-and-play regularization, establishing stability and weak convergence under broad conditions. They present two analytical routes: a stationary reduction to variational regularization and a direct analysis that relaxes the stationarity assumptions, both yielding convergence results to the true solution x^+ as the noise level δ and parameter α vanish with δ^2/α → 0. The paper also discusses a PnP perspective, showing how nonlinear DFD can be interpreted as a PnP scheme with diagonal denoisers, and provides numerical demonstrations comparing nonlinear filters to soft-thresholding. Collectively, the results broaden the theoretical foundation for nonlinear, frame-based regularization techniques in inverse problems and highlight practical connections to PnP methods.

Abstract

Inverse problems are key issues in several scientific areas, including signal processing and medical imaging. Since inverse problems typically suffer from instability with respect to data perturbations, a variety of regularization techniques have been proposed. In particular, the use of filtered diagonal frame decompositions has proven to be effective and computationally efficient. However, existing convergence analysis applies only to linear filters and a few non-linear filters such as soft thresholding. In this paper, we analyze filtered diagonal frame decompositions with general non-linear filters. In particular, our results generalize SVD-based spectral filtering from linear to non-linear filters as a special case. As a first approach, we establish a connection between non-linear diagonal frame filtering and variational regularization, allowing us to use results from variational regularization to derive the convergence of non-linear spectral filtering. In the second approach, as our main theoretical results, we relax the assumptions involved in the variational case while still deriving convergence. Furthermore, we discuss connections between non-linear filtering and plug-and-play regularization and explore potential benefits of this relationship.
Paper Structure (24 sections, 18 theorems, 51 equations, 5 figures)

This paper contains 24 sections, 18 theorems, 51 equations, 5 figures.

Key Result

Lemma 2.1

Let $\mathcal{R} \in \Gamma_0(\mathbb{X})$ and $\varphi \colon \mathbb{R} \to \mathbb{R}$.

Figures (5)

  • Figure 1: Example of functional and its proximity operator on the real line. The dashed line always represents the identity function. The wavy line represents infinity.
  • Figure 2: Illustration of the filter $(\varphi_\alpha)_{\alpha > 0}$ from Example \ref{['ex:caseA']} that is generated by a single filter function $\varphi_1$ and satisfies Assumption \ref{['ass:A']}.
  • Figure 3: Illustration of the filter of Example \ref{['ex:caseB']} that satisfies Assumption \ref{['ass:B']} but not Assumption \ref{['ass:A']}.
  • Figure 4: On the left, filter functions for Example \ref{['ex:caseA']} and \ref{['ex:caseB']} (with $\kappa_\lambda=1/4$ and $\alpha=1/10$), as well as the soft thresholding filter, are displayed. On the right, the plot illustrates the $\ell^2$-error of reconstructions under varying percentages of added noise. A linear parameter choice is applied.
  • Figure 5: Illustration of the filter $(\varphi_\alpha)_{\alpha > 0}$ from Example \ref{['ex:caseC']} that satisfies Assumption \ref{['ass:C']} and does not satisfy Assumption \ref{['ass:A']}.

Theorems & Definitions (48)

  • Lemma 2.1: Properties of proximity operators
  • Remark 2.2: Proximity operators on the real line
  • Lemma 2.3
  • proof
  • Lemma 2.4
  • proof
  • Lemma 2.5
  • proof
  • Definition 2.6: Diagonal drame decomposition, DFD
  • Definition 3.1: Non-linear regularizing filter
  • ...and 38 more