Table of Contents
Fetching ...

An Uncertainty-aware, Mesh-free Numerical Method for Kolmogorov PDEs

Daisuke Inoue, Yuji Ito, Takahito Kashiwabara, Norikazu Saito, Hiroaki Yoshida

TL;DR

The paper tackles solving high-dimensional Kolmogorov PDEs while quantifying numerical uncertainty. It presents an uncertainty-aware, mesh-free approach that couples Feynman–Kac Monte Carlo sampling with heteroscedastic Gaussian Process Regression, enabling both a posterior mean solution and a posterior variance-based uncertainty measure. A theoretical contribution provides an a priori lower bound on the posterior variance (IMSE) and a probabilistic bound on the noise estimate, guiding performance expectations. Empirical results on heat, advection–diffusion, and HJB equations in 10 dimensions show improved accuracy and reduced uncertainty, validating the method against standard GPR and linear interpolation. The work advances uncertainty-aware numerical PDEs and suggests adaptive, information-driven sampling to further enhance efficiency.

Abstract

This study introduces an uncertainty-aware, mesh-free numerical method for solving Kolmogorov PDEs. In the proposed method, we use Gaussian process regression (GPR) to smoothly interpolate pointwise solutions that are obtained by Monte Carlo methods based on the Feynman-Kac formula. The proposed method has two main advantages: 1. uncertainty assessment, which is facilitated by the probabilistic nature of GPR, and 2. mesh-free computation, which allows efficient handling of high-dimensional PDEs. The quality of the solution is improved by adjusting the kernel function and incorporating noise information from the Monte Carlo samples into the GPR noise model. The performance of the method is rigorously analyzed based on a theoretical lower bound on the posterior variance, which serves as a measure of the error between the numerical and true solutions. Extensive tests on three representative PDEs demonstrate the high accuracy and robustness of the method compared to existing methods.

An Uncertainty-aware, Mesh-free Numerical Method for Kolmogorov PDEs

TL;DR

The paper tackles solving high-dimensional Kolmogorov PDEs while quantifying numerical uncertainty. It presents an uncertainty-aware, mesh-free approach that couples Feynman–Kac Monte Carlo sampling with heteroscedastic Gaussian Process Regression, enabling both a posterior mean solution and a posterior variance-based uncertainty measure. A theoretical contribution provides an a priori lower bound on the posterior variance (IMSE) and a probabilistic bound on the noise estimate, guiding performance expectations. Empirical results on heat, advection–diffusion, and HJB equations in 10 dimensions show improved accuracy and reduced uncertainty, validating the method against standard GPR and linear interpolation. The work advances uncertainty-aware numerical PDEs and suggests adaptive, information-driven sampling to further enhance efficiency.

Abstract

This study introduces an uncertainty-aware, mesh-free numerical method for solving Kolmogorov PDEs. In the proposed method, we use Gaussian process regression (GPR) to smoothly interpolate pointwise solutions that are obtained by Monte Carlo methods based on the Feynman-Kac formula. The proposed method has two main advantages: 1. uncertainty assessment, which is facilitated by the probabilistic nature of GPR, and 2. mesh-free computation, which allows efficient handling of high-dimensional PDEs. The quality of the solution is improved by adjusting the kernel function and incorporating noise information from the Monte Carlo samples into the GPR noise model. The performance of the method is rigorously analyzed based on a theoretical lower bound on the posterior variance, which serves as a measure of the error between the numerical and true solutions. Extensive tests on three representative PDEs demonstrate the high accuracy and robustness of the method compared to existing methods.
Paper Structure (11 sections, 8 theorems, 61 equations, 3 figures)

This paper contains 11 sections, 8 theorems, 61 equations, 3 figures.

Key Result

Proposition 1

Suppose that Asmp:pde holds. Then, eq:BPDEeq:BPDE-terminal have a unique viscosity solution.

Figures (3)

  • Figure 1: Squared $L^2$-norm error and IMSE when each method is applied to the 10-dimensional heat equation. Blue (solid): HSGPR / Orange (dash-dot): GPR / Green (dotted): linear interpolation / Red (dashed): lower bound of IMSE in HSGPR. The error bars represent the standard error of the calculation results for 50 different seeds used in the FK sampling. When varying the sample size $M$, the number of observation points $N$ is set as $N=20$, and when varying the number of observation points $N$, the sample size $M$ is set as $M=800$.
  • Figure 2: Squared $L^2$-norm error and IMSE when each method is applied to the 10-dimensional advection-diffusion equation. Blue (solid): HSGPR / Orange (dash-dot): GPR / Green (dotted): linear interpolation / Red (dashed): lower bound of IMSE in HSGPR. The error bars represent the standard error of the calculation results for 50 different seeds used in the FK sampling. When varying the sample size $M$, we set the number of observation points $N$ as $N=20$, and when varying the number of observation points $N$, we set the sample size $M$ as $M=800$.
  • Figure 3: Squared $L^2$-norm error and IMSE when each method is applied to the 10-dimensional HJB equation. Blue (solid): HSGPR / Orange (dash-dot): GPR / Green (dotted): linear interpolation / Red (dashed): lower bound of IMSE in HSGPR. The error bars represent the standard error of the calculation results for 50 different seeds used in the FK sampling. When varying the sample size $M$, we set the number of observation points $N$ as $N=20$, and when varying the number of observation points $N$, we set the sample size $M$ as $M=800$.

Theorems & Definitions (20)

  • Proposition 1: Ref. Yong1999Stochastic
  • Remark 1
  • Proposition 2: Ref. Goldberg1997Regression
  • Remark 2
  • Proposition 3: RKHSs of Matérn kernels: Sobolev spaces Kanagawa2018GaussianWendland2004Scattereda
  • Proposition 4: Feynman--Kac formula for Kolmogorov PDE Yong1999Stochastic
  • Remark 3
  • Theorem 1
  • Remark 4
  • Remark 5
  • ...and 10 more