Table of Contents
Fetching ...

Neural Implicit Solution Formula for Efficiently Solving Hamilton-Jacobi Equations

Yesom Park, Stanley Osher

TL;DR

This work addresses solving high-dimensional Hamilton-Jacobi PDEs by introducing a novel implicit solution formula derived from the characteristic equations, which avoids Legendre transforms and explicit trajectory integration. A mesh-free neural solver based on implicit neural representations learns the solution as a Lipschitz function by minimizing the residual of the implicit formula over randomly sampled spacetime collocation points, enabling scalable inference up to 40 dimensions. The authors extend the framework to state-dependent Hamiltonians using a short-time, piecewise-linear characteristic approximation and a time-marching algorithm, achieving accurate viscosity solutions for both convex and nonconvex problems. Overall, the approach bridges the method of characteristics, Hopf-Lax/Bellman principles, and modern neural solvers to deliver a practical, scalable tool for high-dimensional HJ PDEs with broad potential in optimal control, level-set methods, and related dynamics.

Abstract

This paper presents an implicit solution formula for the Hamilton-Jacobi partial differential equation (HJ PDE). The formula is derived using the method of characteristics and is shown to coincide with the Hopf and Lax formulas in the case where either the Hamiltonian or the initial function is convex. It provides a simple and efficient numerical approach for computing the viscosity solution of HJ PDEs, bypassing the need for the Legendre transform of the Hamiltonian or the initial condition, and the explicit computation of individual characteristic trajectories. A deep learning-based methodology is proposed to learn this implicit solution formula, leveraging the mesh-free nature of deep learning to ensure scalability for high-dimensional problems. Building upon this framework, an algorithm is developed that approximates the characteristic curves piecewise linearly for state-dependent Hamiltonians. Extensive experimental results demonstrate that the proposed method delivers highly accurate solutions, even for nonconvex Hamiltonians, and exhibits remarkable scalability, achieving computational efficiency for problems up to 40 dimensions.

Neural Implicit Solution Formula for Efficiently Solving Hamilton-Jacobi Equations

TL;DR

This work addresses solving high-dimensional Hamilton-Jacobi PDEs by introducing a novel implicit solution formula derived from the characteristic equations, which avoids Legendre transforms and explicit trajectory integration. A mesh-free neural solver based on implicit neural representations learns the solution as a Lipschitz function by minimizing the residual of the implicit formula over randomly sampled spacetime collocation points, enabling scalable inference up to 40 dimensions. The authors extend the framework to state-dependent Hamiltonians using a short-time, piecewise-linear characteristic approximation and a time-marching algorithm, achieving accurate viscosity solutions for both convex and nonconvex problems. Overall, the approach bridges the method of characteristics, Hopf-Lax/Bellman principles, and modern neural solvers to deliver a practical, scalable tool for high-dimensional HJ PDEs with broad potential in optimal control, level-set methods, and related dynamics.

Abstract

This paper presents an implicit solution formula for the Hamilton-Jacobi partial differential equation (HJ PDE). The formula is derived using the method of characteristics and is shown to coincide with the Hopf and Lax formulas in the case where either the Hamiltonian or the initial function is convex. It provides a simple and efficient numerical approach for computing the viscosity solution of HJ PDEs, bypassing the need for the Legendre transform of the Hamiltonian or the initial condition, and the explicit computation of individual characteristic trajectories. A deep learning-based methodology is proposed to learn this implicit solution formula, leveraging the mesh-free nature of deep learning to ensure scalability for high-dimensional problems. Building upon this framework, an algorithm is developed that approximates the characteristic curves piecewise linearly for state-dependent Hamiltonians. Extensive experimental results demonstrate that the proposed method delivers highly accurate solutions, even for nonconvex Hamiltonians, and exhibits remarkable scalability, achieving computational efficiency for problems up to 40 dimensions.

Paper Structure

This paper contains 17 sections, 2 theorems, 76 equations, 13 figures, 2 tables, 1 algorithm.

Key Result

Theorem 2.1

Assume the Hamiltonian $H$ is differentiable and satisfies and the initial function $g$ is l.s.c. Then, the continuous function $u$ that satisfies the implicit solution formula eq:implicit_character is the viscosity solution of eq:hj a.e.

Figures (13)

  • Figure 1: Iso-contours of the numerical solution to two-dimensional collision of circles in \ref{['ex:collision']}. The predicted zero leve lsets are represented by red curves.
  • Figure 2: The numerical results for \ref{['ex:cos']}.
  • Figure 3: The numerical solution for \ref{['ex:sin']}
  • Figure 4: The numerical solution for \ref{['ex:multiply']}
  • Figure 5: The numerical solution for \ref{['ex:eikonal']}
  • ...and 8 more figures

Theorems & Definitions (24)

  • Theorem 2.1
  • Proof 1
  • Theorem 2.2
  • Proof 2
  • Example 2.1
  • Remark 2.3
  • Remark 3.1
  • Example 4.1: Burgers' equation
  • Example 4.2: Concave Hamiltonian
  • Example 4.3: Level set Propagation
  • ...and 14 more