Table of Contents
Fetching ...

Semi-parametric Bernstein-von Mises in Linear Inverse Problems

Adel Magra, Aad van der Vaart, Harry van Zanten

TL;DR

The paper develops a semi-parametric Bernstein-von Mises theorem for the marginal posterior of a scalar θ in linear inverse problems with a parameter-dependent operator K_θ, under a two-observation white-noise model. The core approach leverages a local asymptotic normality expansion and a least favorable direction γ_{θ,f} to characterize bias and prior-insensitivity, yielding asymptotic normality of the θ-posterior with efficient information, despite an infinite-dimensional nuisance f. The authors instantiate the theory in two canonical applications—the heat equation for thermal diffusivity and a semi-blind deconvolution problem—and analyze the theorem under Gaussian process and p-exponential priors, providing contraction-rate conditions and explicit forms for the least favorable direction. They further complement the theory with posterior simulations that illustrate the zone of valid BvM behavior and the impact of prior regularity on uncertainty quantification. Overall, the work bridges Bayesian and frequentist perspectives in semi-parametric inverse problems with operator uncertainty, enabling valid uncertainty quantification for θ in challenging ill-posed settings.

Abstract

We consider a Bayesian approach for the recovery of scalar parameters arising in inverse problems. We consider a general signal-in white noise model where we have access to two independent noisy observations of a function, and of a linear transformation of the function. The linear operator is unknown up to a scalar parameter. We present a Bernstein-von Mises theorem for the marginal posterior of the scalar under regularity assumptions of the operator. We further derive Bernstein-von Mises results for different priors and apply them to two concrete examples: the recovery of the thermal diffusivity in a heat equation problem, and the recovery of a location parameter in a semi-blind deconvolution problem.

Semi-parametric Bernstein-von Mises in Linear Inverse Problems

TL;DR

The paper develops a semi-parametric Bernstein-von Mises theorem for the marginal posterior of a scalar θ in linear inverse problems with a parameter-dependent operator K_θ, under a two-observation white-noise model. The core approach leverages a local asymptotic normality expansion and a least favorable direction γ_{θ,f} to characterize bias and prior-insensitivity, yielding asymptotic normality of the θ-posterior with efficient information, despite an infinite-dimensional nuisance f. The authors instantiate the theory in two canonical applications—the heat equation for thermal diffusivity and a semi-blind deconvolution problem—and analyze the theorem under Gaussian process and p-exponential priors, providing contraction-rate conditions and explicit forms for the least favorable direction. They further complement the theory with posterior simulations that illustrate the zone of valid BvM behavior and the impact of prior regularity on uncertainty quantification. Overall, the work bridges Bayesian and frequentist perspectives in semi-parametric inverse problems with operator uncertainty, enabling valid uncertainty quantification for θ in challenging ill-posed settings.

Abstract

We consider a Bayesian approach for the recovery of scalar parameters arising in inverse problems. We consider a general signal-in white noise model where we have access to two independent noisy observations of a function, and of a linear transformation of the function. The linear operator is unknown up to a scalar parameter. We present a Bernstein-von Mises theorem for the marginal posterior of the scalar under regularity assumptions of the operator. We further derive Bernstein-von Mises results for different priors and apply them to two concrete examples: the recovery of the thermal diffusivity in a heat equation problem, and the recovery of a location parameter in a semi-blind deconvolution problem.
Paper Structure (16 sections, 12 theorems, 85 equations, 3 figures, 1 algorithm)

This paper contains 16 sections, 12 theorems, 85 equations, 3 figures, 1 algorithm.

Key Result

Lemma 2.1

If the preceding display holds, then for every $g\in H$ and $n\rightarrow \infty$, with $\dot W^{(1)}$ and $\dot W^{(2)}$ defined in eq: obs1--eq: obs2, in $P_{\theta,f}^n$-probability, Furthermore, the Fisher information $\|g\|^2 + \|\dot K_\theta f + K_\theta g\|^2$ is minimized over $g$ at $g=-\gamma_{\theta,f}$ given by If $\dot K_\theta f\not=0$, then the minimal value $\tilde{I}_{\theta,f}

Figures (3)

  • Figure 1: Approximations of the marginal posterior of $\theta$ obtained when running algorithm \ref{['alg:MH']} on three different datasets with $\alpha=1$. The red line marks the true value of $\theta$ while the blue curve is the theoretical limiting distribution in Theorem \ref{['thm: main']}. That is, a normal distribution centered at an efficient estimator (here the posterior mean) with variance the efficient Fisher information.
  • Figure 2: Approximations of the marginal posterior of $\theta$ for priors with regularity $\alpha$ equal to (from left to right) 2.6, 3.0 and 3.4. All three values of $\alpha$ are outside the BvM zone predicted by Theorem \ref{['thm: main']} The approximations are realized for the same dataset.
  • Figure 3: Trace plots of $\theta$ for two MH algorithm runs. The blue lines mark the burn in period selected.

Theorems & Definitions (25)

  • Lemma 2.1
  • Theorem 2.3
  • Corollary 2.4
  • proof
  • Corollary 2.5
  • proof
  • Lemma 2.6
  • Proposition 3.1
  • proof : Proof
  • Proposition 3.2
  • ...and 15 more