Table of Contents
Fetching ...

Koopman Regularization

Ido Cohen

TL;DR

Koopman Regularization addresses learning governing vector fields from sparse and corrupted samples by exploiting the geometry of Koopman eigenfunctions. It reformulates the KPDE as an optimization objective while enforcing functional independence as a geometric constraint through a barrier-method approach, enabling denoising, generalization, and dimensionality reduction. A minimal set of $N$ functionally independent eigenfunctions (or UVMs) yields a parsimonious yet exact representation of the dynamics. Experiments on linear/nonlinear 2D systems and the Lorenz butterfly demonstrate effective denoising, accurate generalization from sparse data, and compact dimensionality reduction, with measurable improvements in SNR and MSE.

Abstract

\emph{Koopman Regularization} is a constrained optimization-based method to learn the governing equations from sparse and corrupted samples of the vector field. \emph{Koopman Regularization} extracts a functionally independent set of Koopman eigenfunctions from the samples. This set implements the principle of parsimony, since, even though its cardinality is finite, it restores the dynamics precisely. \emph{Koopman Regularization} formulates the Koopman Partial Differential Equation as the objective function and the condition of functional independence as the feasible region. Then, this work suggests a barrier method-based algorithm to solve this constrained optimization problem that yields promising results in denoising, generalization, and dimensionality reduction.

Koopman Regularization

TL;DR

Koopman Regularization addresses learning governing vector fields from sparse and corrupted samples by exploiting the geometry of Koopman eigenfunctions. It reformulates the KPDE as an optimization objective while enforcing functional independence as a geometric constraint through a barrier-method approach, enabling denoising, generalization, and dimensionality reduction. A minimal set of functionally independent eigenfunctions (or UVMs) yields a parsimonious yet exact representation of the dynamics. Experiments on linear/nonlinear 2D systems and the Lorenz butterfly demonstrate effective denoising, accurate generalization from sparse data, and compact dimensionality reduction, with measurable improvements in SNR and MSE.

Abstract

\emph{Koopman Regularization} is a constrained optimization-based method to learn the governing equations from sparse and corrupted samples of the vector field. \emph{Koopman Regularization} extracts a functionally independent set of Koopman eigenfunctions from the samples. This set implements the principle of parsimony, since, even though its cardinality is finite, it restores the dynamics precisely. \emph{Koopman Regularization} formulates the Koopman Partial Differential Equation as the objective function and the condition of functional independence as the feasible region. Then, this work suggests a barrier method-based algorithm to solve this constrained optimization problem that yields promising results in denoising, generalization, and dimensionality reduction.
Paper Structure (36 sections, 40 equations, 6 figures, 1 table, 2 algorithms)

This paper contains 36 sections, 40 equations, 6 figures, 1 table, 2 algorithms.

Figures (6)

  • Figure 1: NN Configuration -- $N$ inputs, $N$ outputs, three hidden layers with $100$ notes each. Fully connected with $tanh$ as an activation function.
  • Figure 2: Noise Reduction - noisy (blue), ground truth (black), and restored (red) vector fields are depicted.
  • Figure 3: Noise Reduction Quality -- Left to right, unit manifolds, contours, and noise histograms before and after Koopman Regularization
  • Figure 4: Noise Reduction Quality -- SNR Improvement.$Y$ axis -- SNR level in $[dB]$. $X$ axis -- number of experiment. Red Bars -- SNR level in $[dB]$ before Koopman Regularization. Blue Bars -- SNR level in $[dB]$ after Koopman Regularization.
  • Figure 5: Generalization - sparse samples (blue), ground truth (black), generalized (red) of the vector fields are presented.
  • ...and 1 more figures

Theorems & Definitions (13)

  • Definition 2.1: Functionally Independent Set (FIS)
  • Definition 2.2: $N$ Dimension Nonlinear Dynamic
  • Definition 2.3: Orbit of an initial point
  • Definition 2.4: Measurement
  • Definition 2.5: Koopman Operator
  • Definition 2.6: KEF
  • Definition 2.7: Koopman Partial Differential Equation (KPDE)
  • Definition 2.8: Conservation Laws
  • Definition 2.9: Unit Velocity Measurement (UVM)
  • Definition 2.10: General Form Solution of KPDE
  • ...and 3 more