Table of Contents
Fetching ...

Reduced variance random batch methods for nonlocal PDEs

Lorenzo Pareschi, Mattia Zanella

TL;DR

This work addresses the computational burden of simulating large systems of interacting particles governed by nonlocal Vlasov-Fokker-Planck-type equations. It extends Random Batch Methods (RBM) with a variance-reduction technique based on a control variate using a surrogate model, achieving reduced variance without sacrificing the mean-field consistency. The proposed rvRBM method is demonstrated across models of opinion dynamics and swarming (including bounded confidence and Cucker-Smale), showing substantial computational savings and improved accuracy at similar costs to standard RBM. The approach offers a practical path to scalable, accurate simulations of nonlocal PDEs describing collective behavior and motivates future enhancements such as multilevel implementations.

Abstract

Random Batch Methods (RBM) for mean-field interacting particle systems enable the reduction of the quadratic computational cost associated with particle interactions to a near-linear cost. The essence of these algorithms lies in the random partitioning of the particle ensemble into smaller batches at each time step. The interaction of each particle within these batches is then evolved until the subsequent time step. This approach effectively decreases the computational cost by an order of magnitude while increasing the amount of fluctuations due to the random partitioning. In this work, we propose a variance reduction technique for RBM applied to nonlocal PDEs of Fokker-Planck type based on a control variate strategy. The core idea is to construct a surrogate model that can be computed on the full set of particles at a linear cost while maintaining enough correlations with the original particle dynamics. Examples from models of collective behavior in opinion spreading and swarming dynamics demonstrate the great potential of the present approach.

Reduced variance random batch methods for nonlocal PDEs

TL;DR

This work addresses the computational burden of simulating large systems of interacting particles governed by nonlocal Vlasov-Fokker-Planck-type equations. It extends Random Batch Methods (RBM) with a variance-reduction technique based on a control variate using a surrogate model, achieving reduced variance without sacrificing the mean-field consistency. The proposed rvRBM method is demonstrated across models of opinion dynamics and swarming (including bounded confidence and Cucker-Smale), showing substantial computational savings and improved accuracy at similar costs to standard RBM. The approach offers a practical path to scalable, accurate simulations of nonlocal PDEs describing collective behavior and motivates future enhancements such as multilevel implementations.

Abstract

Random Batch Methods (RBM) for mean-field interacting particle systems enable the reduction of the quadratic computational cost associated with particle interactions to a near-linear cost. The essence of these algorithms lies in the random partitioning of the particle ensemble into smaller batches at each time step. The interaction of each particle within these batches is then evolved until the subsequent time step. This approach effectively decreases the computational cost by an order of magnitude while increasing the amount of fluctuations due to the random partitioning. In this work, we propose a variance reduction technique for RBM applied to nonlocal PDEs of Fokker-Planck type based on a control variate strategy. The core idea is to construct a surrogate model that can be computed on the full set of particles at a linear cost while maintaining enough correlations with the original particle dynamics. Examples from models of collective behavior in opinion spreading and swarming dynamics demonstrate the great potential of the present approach.
Paper Structure (15 sections, 3 theorems, 72 equations, 10 figures, 2 algorithms)

This paper contains 15 sections, 3 theorems, 72 equations, 10 figures, 2 algorithms.

Key Result

Theorem 1

The root-mean square error is such that for each $t\ge0$ where $\sigma_\varphi^2 = \textrm{Var}(\varphi)$ and

Figures (10)

  • Figure 1: Test 1a. Evolution of the densities for the deterministic BC model in \ref{['eq:BCMF']} by means of a particle approach defined in \ref{['eq:BCparticles']} with interaction function with threshold $\delta = 1$ (top row), $\delta = 0.5$ (bottom row). We considered $N = 10^5$ particles with initial distribution defined in \ref{['eq:f0BC']} and we compare the evolution of the approximated densities obtained with RBM and rvRBM with a subset of interacting particles of size $M=5$ or $M=10$. The surrogate interaction function is here considered $\tilde{P}(v_i) \equiv 1$.
  • Figure 2: Test 1a. Evolution of the absolute error defined in \ref{['eq:error']} for the bounded confidence model solved through RBM and rvRBM with $M = 5$ (left column) or $M=10$ (right column). We considered $\delta=1$ (top row) and $\delta = 0.5$ (bottom row).
  • Figure 3: Test 1a. Evolution of $\lambda^*$ for the model \ref{['eq:BCMF']} approximated through a rvRBM strategy with $M=5,10$ and $\delta = 1$ (left), $\delta = 0.5$ (right).
  • Figure 4: Test 1a. Comparison of the errors produced by RBM and rvRBM with surrogate models obtained with $\tilde{P}\equiv 1$ (case 1) or $\tilde{P}(v_i) = 1-v_i^2$ (case 2). We considered a fixed batch size $M = 5$ (left) and $M = 10$ (right) and variable size of the sample $N \in \{10,\dots,10^4\}$. The error is computed from the bounded confidence model \ref{['eq:BCparticles']} with $\delta = 1$ at time $T = 5$.
  • Figure 5: Test 1b. Top row: comparison of the reconstructed distributions at time $t = 1$ and $t = 5$ for the bounded confidence model with $\delta = 0.5$ using RBM or rvRBM with $\tilde{P}(v_i)\equiv 1$ (case 1) or $\tilde{P}(v_i) = (v_i-\frac{1}{2})(v_i+\frac{1}{2})$. The batch size is $M = 10$ and the initial sample has been obtained from \ref{['eq:f0_2c']}. Bottom row: evolution of the absolute errors \ref{['eq:error']} for the bounded confidence model solved through RBM and rvRBM with $M = 5$ (left) or $M = 10$ (right).
  • ...and 5 more figures

Theorems & Definitions (6)

  • Theorem 1
  • Theorem 2
  • proof
  • Theorem 3
  • Remark 1
  • Remark 2