Table of Contents
Fetching ...

A derivative-free localized stochastic method for very high-dimensional semilinear parabolic PDEs

Shuixin Fang, Changtao Sheng, Bihao Su, Tao Zhou

TL;DR

The paper presents a mesh-free, derivative-free, matrix-free localized stochastic framework to solve very high-dimensional semilinear parabolic PDEs by leveraging a martingale-based FBSDE formulation, stochastic forward particle dynamics, local linear regression for gradient reconstruction, and Newton iterations for nonlinear scalar updates. It provides a rigorous error bound of the form $O(\Delta t) + O(\Delta t\,e^{-cM\varepsilon^d})$, showing first-order temporal accuracy with exponential decay in the particle count $M$, and demonstrates scalable performance up to dimension $d=10{,}000$ with linear cost in $N\cdot M$ and $d$. Numerical experiments on Allen–Cahn, Burgers, and Hamilton–Jacobi type equations confirm accuracy, stability, and the method’s robustness to dimensionality, with strong results achieved on a standard laptop. The approach offers a practical, interpretable alternative to mesh-based or neural-network–driven methods, avoiding global bases and gradient computations while enabling high-dimensional PDE solvability and rigorous error control.

Abstract

We develop a mesh-free, derivative-free, matrix-free, and highly parallel localized stochastic method for high-dimensional semilinear parabolic PDEs. The efficiency of the proposed method is built upon four essential components: (i) a martingale formulation of the forward backward stochastic differential equation (FBSDE); (ii) a small scale stochastic particle method for local linear regression (LLR); (iii) a decoupling strategy with a matrix-free solver for the weighted least-squares system used to compute $\nabla u$; (iv) a Newton iteration for solving the univariate nonlinear system in $u$. Unlike traditional deterministic methods that rely on global information, this localized computational scheme not only provides explicit pointwise evaluations of $u$ and $\nabla u$ but, more importantly, is naturally suited for parallelization across particles. In addition, the algorithm avoids the need for spatial meshes and global basis functions required by classical deterministic approaches, as well as the derivative-dependent and lengthy training procedures often encountered in machine learning. More importantly, we rigorously analyze the error bound of the proposed scheme, which is fully explicit in both the particle number $M$ and the time step size $Δt$. Numerical results conducted for problem dimensions ranging from $d=100$ to $d=10000$ consistently verify the efficiency and accuracy of the proposed method. Remarkably, all computations are carried out efficiently on a standard personal computer, without requiring any specialized hardware. These results confirm that the proposed method is built upon a principled design that not only extends the practically solvable range of ultra-high-dimensional PDEs but also maintains rigorous error control and ease of implementation.

A derivative-free localized stochastic method for very high-dimensional semilinear parabolic PDEs

TL;DR

The paper presents a mesh-free, derivative-free, matrix-free localized stochastic framework to solve very high-dimensional semilinear parabolic PDEs by leveraging a martingale-based FBSDE formulation, stochastic forward particle dynamics, local linear regression for gradient reconstruction, and Newton iterations for nonlinear scalar updates. It provides a rigorous error bound of the form , showing first-order temporal accuracy with exponential decay in the particle count , and demonstrates scalable performance up to dimension with linear cost in and . Numerical experiments on Allen–Cahn, Burgers, and Hamilton–Jacobi type equations confirm accuracy, stability, and the method’s robustness to dimensionality, with strong results achieved on a standard laptop. The approach offers a practical, interpretable alternative to mesh-based or neural-network–driven methods, avoiding global bases and gradient computations while enabling high-dimensional PDE solvability and rigorous error control.

Abstract

We develop a mesh-free, derivative-free, matrix-free, and highly parallel localized stochastic method for high-dimensional semilinear parabolic PDEs. The efficiency of the proposed method is built upon four essential components: (i) a martingale formulation of the forward backward stochastic differential equation (FBSDE); (ii) a small scale stochastic particle method for local linear regression (LLR); (iii) a decoupling strategy with a matrix-free solver for the weighted least-squares system used to compute ; (iv) a Newton iteration for solving the univariate nonlinear system in . Unlike traditional deterministic methods that rely on global information, this localized computational scheme not only provides explicit pointwise evaluations of and but, more importantly, is naturally suited for parallelization across particles. In addition, the algorithm avoids the need for spatial meshes and global basis functions required by classical deterministic approaches, as well as the derivative-dependent and lengthy training procedures often encountered in machine learning. More importantly, we rigorously analyze the error bound of the proposed scheme, which is fully explicit in both the particle number and the time step size . Numerical results conducted for problem dimensions ranging from to consistently verify the efficiency and accuracy of the proposed method. Remarkably, all computations are carried out efficiently on a standard personal computer, without requiring any specialized hardware. These results confirm that the proposed method is built upon a principled design that not only extends the practically solvable range of ultra-high-dimensional PDEs but also maintains rigorous error control and ease of implementation.

Paper Structure

This paper contains 13 sections, 12 theorems, 119 equations, 4 figures, 3 tables, 1 algorithm.

Key Result

Lemma 2.1

\newlabelLipcond0 Suppose Assumption ass:HLG holds. We further assume that $\sigma\sigma^\top$ is uniformly nondegenerate, i.e., there exists $\lambda>0$ such that then the FBSDE admits a unique adapted solution $(X,Y,Z)\in \mathcal{S}^2(\mathbb{R}^d)\times \mathcal{S}^2(\mathbb{R})\times \mathcal{H}^2(\mathbb{R}^d),$ where $\mathcal{S}^2$ denotes the space of square‐integrable continuous adapte

Figures (4)

  • Figure 1: Numerical error for \ref{['AC100']} in Case 1 of the 100-dimensional Allen--Cahn equation at $\boldsymbol{x}=(0,\dots,0)$ with $T=0.3$. The reference value of the exact solution is $u(0,\boldsymbol{x})\approx0.0528$ as reported in HanJentzenE2018. Left: absolute errors; Right: relative errors.
  • Figure 2: Relative errors for the Allen--Cahn equation in Case 2 with $T=1$. Top: $d=100$; Bottom: $d=1000$. Left: compute error at $\boldsymbol{x}=(0,\dots,0)$; Right: compute error at $\boldsymbol{x}=(0.1,\dots,0.1)$.
  • Figure 3: Numerical error for 10000-dimensional Burger's equation \ref{['Burgers']} at point $\boldsymbol{x} = (0,0,\cdots,0)$ with $T=0.3$. Left: absolute errors; Right: relative errors.
  • Figure 4: Relative error of the problem \ref{['RDequation']} against different $\Delta t$ at point $\boldsymbol{x} = (0,0,\cdots, 0)$ with $T=0.5$. Left: $d=500$; Right: $d=2000$.

Theorems & Definitions (25)

  • Lemma 2.1
  • Remark 2.1
  • Remark 2.2
  • Remark 2.3
  • Lemma 3.1
  • Lemma 3.2
  • Lemma 3.3
  • Proof 1
  • Lemma 3.4
  • Proof 2
  • ...and 15 more