Table of Contents
Fetching ...

Flow matching for stochastic linear control systems

Yuhang Mei, Mohammad Al-Jarrah, Amirhossein Taghvaei, Yongxin Chen

TL;DR

The paper addresses steering an initial distribution $P_0$ to a target distribution $P_1$ under deterministic or stochastic linear dynamics using a flow-matching framework that operates through control channels. It constructs an interpolating probability flow $P_t$ and defines a feedback law $k(t,\xi)=\mathbb{E}\left[\frac{d X^z_t}{dt}\middle| X^z_t=\xi\right]$, enabling distributional interpolation; analytical solutions are provided for Gaussian and Gaussian-mixture targets, and a least-squares neural-network procedure approximates the law in general. The method extends flow matching to linear control systems, yielding the same control law for both deterministic and stochastic cases, with numerical experiments in 2D and higher dimensions demonstrating capability to steer mixtures and scale with dimension. This work has practical implications for robotic swarms and stochastic thermodynamics, where control inputs constrain the evolution of probability densities and efficient distribution steering is valuable.

Abstract

This paper addresses the problem of steering an initial probability distribution to a target probability distribution through a deterministic or stochastic linear control system. Our proposed approach is inspired by the flow matching methodology, with the difference that we can only affect the flow through the given control channels. The motivation comes from applications such as robotic swarms and stochastic thermodynamics, where agents or particles can only be manipulated through control actions. The feedback control law that achieves the task is characterized as the conditional expectation of the control inputs for the stochastic bridges that respect the given control system dynamics. Explicit forms are derived for special cases, and a numerical procedure is presented to approximate the control law, illustrated with examples.

Flow matching for stochastic linear control systems

TL;DR

The paper addresses steering an initial distribution to a target distribution under deterministic or stochastic linear dynamics using a flow-matching framework that operates through control channels. It constructs an interpolating probability flow and defines a feedback law , enabling distributional interpolation; analytical solutions are provided for Gaussian and Gaussian-mixture targets, and a least-squares neural-network procedure approximates the law in general. The method extends flow matching to linear control systems, yielding the same control law for both deterministic and stochastic cases, with numerical experiments in 2D and higher dimensions demonstrating capability to steer mixtures and scale with dimension. This work has practical implications for robotic swarms and stochastic thermodynamics, where control inputs constrain the evolution of probability densities and efficient distribution steering is valuable.

Abstract

This paper addresses the problem of steering an initial probability distribution to a target probability distribution through a deterministic or stochastic linear control system. Our proposed approach is inspired by the flow matching methodology, with the difference that we can only affect the flow through the given control channels. The motivation comes from applications such as robotic swarms and stochastic thermodynamics, where agents or particles can only be manipulated through control actions. The feedback control law that achieves the task is characterized as the conditional expectation of the control inputs for the stochastic bridges that respect the given control system dynamics. Explicit forms are derived for special cases, and a numerical procedure is presented to approximate the control law, illustrated with examples.

Paper Structure

This paper contains 11 sections, 4 theorems, 33 equations, 3 figures.

Key Result

proposition 1

Problem problem:cont-det is solved with the control input resulting into the interpolating trajectory Moreover, eq:u-det is the control input with minimum $L_2$-norm $\int_0^1\|u_t\|^2\,\mathrm{d} t$ among all the control inputs that solve Problem problem:cont-det.

Figures (3)

  • Figure 1: Interpolations for three linear control systems with modeling parameters specified in \ref{['eq:2d_systems']}.
  • Figure 2: Numerical results for three 2-dimensional linear control systems, with model parameters \ref{['eq:2d_systems']}-(a)-(b)-(c). First row: numerical result for \ref{['eq:2d_systems']}-(a). The left panel shows the trajectories $\{X^i_t\}_{i=1}^{N'}$ generated from the prediction stage of the algorithm. The second panel compares the exact target density with a kernel density approximation of the generated samples $\{X^i_1\}_{i=1}^{N'}$. The right panel shows the MMD distance between generated samples $\{X^i_t\}_{i=1}^{N'}$ and training samples $\{X^{z^i}_t\}_{i=1}^{N}$. The second and third rows show similar results for models \ref{['eq:2d_systems']}-(b) and (c), respectively.
  • Figure 3: Numerical results for four dimensional (first row) and eight dimensional (second row) mass-springs systems. The left panel shows the approximated and exact densities, at $t=1$, projected onto the last two components. The panel at the center shows the MMD distance, and the right panel shows the W2 distance between the generated samples and training samples as a function of time t.

Theorems & Definitions (11)

  • proposition 1
  • remark 1
  • remark 2
  • proposition 2
  • remark 3
  • proof
  • remark 4
  • theorem 1
  • proof
  • corollary 1
  • ...and 1 more