Table of Contents
Fetching ...

Simultaneously Solving FBSDEs and their Associated Semilinear Elliptic PDEs with Small Neural Operators

Takashi Furuya, Anastasis Kratsios

TL;DR

This work addresses the challenge of solving infinite families of forward-backwards stochastic differential equations (FBSDEs) by learning a single solution-operator map with neural operators. The authors introduce forward-backwards neural operators (FBNOs) that approximate the mapping from terminal/boundary data $(g,f_0)$ to the FBSDE solution $(Y_{ullet},Z_{ullet})$ across a large family, leveraging a PDE-FBSDE correspondence. A key technical advance is a convolutional neural operator with domain lifting that captures both the singular and smooth parts of the Green’s function, enabling uniform approximation guarantees with sublinear complexity in the reciprocal error. The paper proves two main results: (i) the FBNO can approximate the entire FBSDE family with controlled error and computational depth, and (ii) the corresponding class of semilinear elliptic PDEs can be uniformly approximated by a NO, with explicit depth, width, and rank bounds. Domain lifting channels are shown to be crucial for achieving favorable convergence rates, linking operator learning theory with deep PDE structure to produce practically scalable solvers for large model families.

Abstract

Forward-backwards stochastic differential equations (FBSDEs) play an important role in optimal control, game theory, economics, mathematical finance, and in reinforcement learning. Unfortunately, the available FBSDE solvers operate on \textit{individual} FBSDEs, meaning that they cannot provide a computationally feasible strategy for solving large families of FBSDEs, as these solvers must be re-run several times. \textit{Neural operators} (NOs) offer an alternative approach for \textit{simultaneously solving} large families of decoupled FBSDEs by directly approximating the solution operator mapping \textit{inputs:} terminal conditions and dynamics of the backwards process to \textit{outputs:} solutions to the associated FBSDE. Though universal approximation theorems (UATs) guarantee the existence of such NOs, these NOs are unrealistically large. Upon making only a few simple theoretically-guided tweaks to the standard convolutional NO build, we confirm that ``small'' NOs can uniformly approximate the solution operator to structured families of FBSDEs with random terminal time, uniformly on suitable compact sets determined by Sobolev norms using a logarithmic depth, a constant width, and a polynomial rank in the reciprocal approximation error. This result is rooted in our second result, and main contribution to the NOs for PDE literature, showing that our convolutional NOs of similar depth and width but grow only \textit{quadratically} (at a dimension-free rate) when uniformly approximating the solution operator of the associated class of semilinear Elliptic PDEs to these families of FBSDEs. A key insight into how NOs work we uncover is that the convolutional layers of our NO can approximately implement the fixed point iteration used to prove the existence of a unique solution to these semilinear Elliptic PDEs.

Simultaneously Solving FBSDEs and their Associated Semilinear Elliptic PDEs with Small Neural Operators

TL;DR

This work addresses the challenge of solving infinite families of forward-backwards stochastic differential equations (FBSDEs) by learning a single solution-operator map with neural operators. The authors introduce forward-backwards neural operators (FBNOs) that approximate the mapping from terminal/boundary data to the FBSDE solution across a large family, leveraging a PDE-FBSDE correspondence. A key technical advance is a convolutional neural operator with domain lifting that captures both the singular and smooth parts of the Green’s function, enabling uniform approximation guarantees with sublinear complexity in the reciprocal error. The paper proves two main results: (i) the FBNO can approximate the entire FBSDE family with controlled error and computational depth, and (ii) the corresponding class of semilinear elliptic PDEs can be uniformly approximated by a NO, with explicit depth, width, and rank bounds. Domain lifting channels are shown to be crucial for achieving favorable convergence rates, linking operator learning theory with deep PDE structure to produce practically scalable solvers for large model families.

Abstract

Forward-backwards stochastic differential equations (FBSDEs) play an important role in optimal control, game theory, economics, mathematical finance, and in reinforcement learning. Unfortunately, the available FBSDE solvers operate on \textit{individual} FBSDEs, meaning that they cannot provide a computationally feasible strategy for solving large families of FBSDEs, as these solvers must be re-run several times. \textit{Neural operators} (NOs) offer an alternative approach for \textit{simultaneously solving} large families of decoupled FBSDEs by directly approximating the solution operator mapping \textit{inputs:} terminal conditions and dynamics of the backwards process to \textit{outputs:} solutions to the associated FBSDE. Though universal approximation theorems (UATs) guarantee the existence of such NOs, these NOs are unrealistically large. Upon making only a few simple theoretically-guided tweaks to the standard convolutional NO build, we confirm that ``small'' NOs can uniformly approximate the solution operator to structured families of FBSDEs with random terminal time, uniformly on suitable compact sets determined by Sobolev norms using a logarithmic depth, a constant width, and a polynomial rank in the reciprocal approximation error. This result is rooted in our second result, and main contribution to the NOs for PDE literature, showing that our convolutional NOs of similar depth and width but grow only \textit{quadratically} (at a dimension-free rate) when uniformly approximating the solution operator of the associated class of semilinear Elliptic PDEs to these families of FBSDEs. A key insight into how NOs work we uncover is that the convolutional layers of our NO can approximately implement the fixed point iteration used to prove the existence of a unique solution to these semilinear Elliptic PDEs.

Paper Structure

This paper contains 44 sections, 21 theorems, 192 equations, 1 figure, 1 table.

Key Result

Theorem 1

Let $\gamma\in P_d^+$, let $s \in \mathbb{N}$ such that $s > 4 + \lceil \frac{d}{p} \rceil$ and suppose that Assumptions ass:gamma, ass:semilinear-term, ass:p-p-prime, ass:sigma_s_k_p__regularity, and ass:choice-delta-p hold. For every "convergence rate" $r > 0$ there is an integer $k\in \mathcal{O} where $\lesssim$ hides a constant, depending on $s, \sigma, k, p,\mathcal{D}, d, \alpha$, and $\gam

Figures (1)

  • Figure 1: Neural Operator Workflow: First, a convolutional NO is used to solve the Elliptic Dirichlet problem associated with the FBSDE in \ref{['eq:FBSDE']} for the boundary data/terminal condition $(g)$ and the perturbation to the dynamics of the backwards process/source data $(f_0)$. Each convolutional layer here encodes the relevant Green's function, and their composition encodes a fixed point iteration converging rapidly to the solution $u$ to the Elliptic PDE determined by $g$ and $f_0$. The solution $u$ and its gradient $\nabla u$ are evaluated at the forwards process $X_{\cdot}$, in \ref{['eq:FBSDE_ForwardProcess']}, yielding an approximate solution pair $(Y_{\cdot},Z_{\cdot}) \stackrel{\hbox{\upshape\tiny def.}}{=} (u(X_{\cdot}),\nabla u(X_{\cdot}))$ to the BSDE. The forward process is implemented by a non-singular neural SDE.

Theorems & Definitions (32)

  • Definition 1: Neural Network
  • Definition 2: Non-Singular Neural SDE
  • Definition 3: Convolutional Neural Operator
  • Definition 4: Forward-Backwards Neural Operator (FBNO)
  • Remark 1: The Freedom in Assumption \ref{['ass:sigma_s_k_p__regularity']}
  • Theorem 1: Exponential Approximation Rates for \ref{['eq:SolutionOperator_FBSDE']} Operator to Certain FBSDEs
  • Theorem 2: Sobolev Approximation Rates for the Family of Semilinear PDEs \ref{['eq:semilinear']}-\ref{['eq:semilinear:BC']}
  • Corollary 1: Uniform Approximation Rates for the Family of Semilinear PDEs \ref{['eq:semilinear']}-\ref{['eq:semilinear:BC']}
  • Lemma 1: Well-Posedness SDE
  • Lemma 2: Implementation of Forward Process
  • ...and 22 more