Table of Contents
Fetching ...

Interpolatory Dynamical Low-Rank Approximation: Theoretical Foundations and Algorithms

Benjamin Carrel, Daniel Kressner, Hei Yin Lam, Bart Vandereycken

TL;DR

The paper develops DLRA-DEIM, a continuous-time framework that replaces orthogonal tangent projections in dynamical low-rank approximation with DEIM-based oblique projections to address nonlinear evaluation costs. It establishes existence, exactness, and error bounds for the resulting differential inclusion, with an explicit polytope characterization in the QDEIM case, and introduces PRK-DEIM (and PERK-DEIM for exponential integrators) to maintain high-order accuracy at reduced cost. The methodology extends to low-order tensor differential equations in Tucker format, with Tucker PRK-DEIM and tensor-specific DEIM index selection, backed by theoretical error bounds and numerical experiments on nonlinear Schrödinger and Allen–Cahn equations. The results demonstrate substantial computational savings with minimal accuracy loss, broadening the applicability of DLRA to large-scale nonlinear and tensor-structured dynamics.

Abstract

Dynamical low-rank approximation (DLRA) is a widely used paradigm for solving large-scale matrix differential equations, as they arise, for example, from the discretization of time-dependent partial differential equations on tensorized domains. Through orthogonally projecting the dynamics onto the tangent space of a low-dimensional manifold, DLRA achieves a significant reduction of the storage required to represent the solution. However, the need for evaluating the velocity field can make it challenging to attain a corresponding reduction of computational cost in the presence of nonlinearities. In this work, we address this challenge by replacing orthogonal tangent space projections with oblique, data-sparse projections selected by a discrete empirical interpolation method (DEIM). At the continuous-time level, this leads to DLRA-DEIM, a well-posed differential inclusion (in the Filippov sense) that captures the discontinuities induced by changes in the indices selected by DEIM. We establish an existence result, exactness property and error bound for DLRA-DEIM that match existing results for DLRA. For the particular case of QDEIM, a popular variant of DEIM, we provide an explicit convex-polytope characterization of the differential inclusion. Building on DLRA-DEIM, we propose a new class of projected integrators, called PRK-DEIM, that combines explicit Runge--Kutta methods with DEIM-based projections. We analyze the convergence order of PRK-DEIM and show that it matches the accuracy of previously proposed projected Runge-Kutta methods, while being significantly cheaper. Extensions to exponential Runge--Kutta methods and low-order tensor differential equations demonstrate the versatility of our framework.

Interpolatory Dynamical Low-Rank Approximation: Theoretical Foundations and Algorithms

TL;DR

The paper develops DLRA-DEIM, a continuous-time framework that replaces orthogonal tangent projections in dynamical low-rank approximation with DEIM-based oblique projections to address nonlinear evaluation costs. It establishes existence, exactness, and error bounds for the resulting differential inclusion, with an explicit polytope characterization in the QDEIM case, and introduces PRK-DEIM (and PERK-DEIM for exponential integrators) to maintain high-order accuracy at reduced cost. The methodology extends to low-order tensor differential equations in Tucker format, with Tucker PRK-DEIM and tensor-specific DEIM index selection, backed by theoretical error bounds and numerical experiments on nonlinear Schrödinger and Allen–Cahn equations. The results demonstrate substantial computational savings with minimal accuracy loss, broadening the applicability of DLRA to large-scale nonlinear and tensor-structured dynamics.

Abstract

Dynamical low-rank approximation (DLRA) is a widely used paradigm for solving large-scale matrix differential equations, as they arise, for example, from the discretization of time-dependent partial differential equations on tensorized domains. Through orthogonally projecting the dynamics onto the tangent space of a low-dimensional manifold, DLRA achieves a significant reduction of the storage required to represent the solution. However, the need for evaluating the velocity field can make it challenging to attain a corresponding reduction of computational cost in the presence of nonlinearities. In this work, we address this challenge by replacing orthogonal tangent space projections with oblique, data-sparse projections selected by a discrete empirical interpolation method (DEIM). At the continuous-time level, this leads to DLRA-DEIM, a well-posed differential inclusion (in the Filippov sense) that captures the discontinuities induced by changes in the indices selected by DEIM. We establish an existence result, exactness property and error bound for DLRA-DEIM that match existing results for DLRA. For the particular case of QDEIM, a popular variant of DEIM, we provide an explicit convex-polytope characterization of the differential inclusion. Building on DLRA-DEIM, we propose a new class of projected integrators, called PRK-DEIM, that combines explicit Runge--Kutta methods with DEIM-based projections. We analyze the convergence order of PRK-DEIM and show that it matches the accuracy of previously proposed projected Runge-Kutta methods, while being significantly cheaper. Extensions to exponential Runge--Kutta methods and low-order tensor differential equations demonstrate the versatility of our framework.
Paper Structure (28 sections, 21 theorems, 119 equations, 5 figures, 4 tables, 2 algorithms)

This paper contains 28 sections, 21 theorems, 119 equations, 5 figures, 4 tables, 2 algorithms.

Key Result

Theorem 1

Under Assumptions ass: one-sided F and ass: epsilon close, the difference between the solution $X(t)$ to the DLRA eq: DLRA and the solution $A(t)$ to the full-order model eq: full order model satisfies

Figures (5)

  • Figure 1: Relative error between reference solution and DLRA, using the different DEIM techniques from Table \ref{['tab:algo_comparison']}, for a discretized Allen-Cahn equation.
  • Figure 2: Illustration of the set $\mathcal{F}(Y)$ in DLRA-DEIM \ref{['eq:DI']} with QDEIM for the matrix $Y$ in \ref{['eq:smallY']}.
  • Figure 3: Relative error at $T = 1$ of various PRK and PRK-DEIM methods with ARP applied to the Schrödinger equation \ref{['eq: schrodinger']} with approximation rank $r=8$.
  • Figure 4: Discrete nonlinear Schrödinger equation \ref{['eq: tensor schrodinger']}: Frobenius norm error of Tucker PRK-QDEIM methods vs time-step size at $T=1.01$ for fixed rank (left panel) and varying rank (right panel).
  • Figure 5: Results for 3D Allen--Cahn equation. Left: Relative error for Tucker PRK2-SRRQR $(\eta=2, h=10^{-3})$ error and best low rank approximation of reference solution. Right: Relative error of oblique and orthogonal projections of the vector field at the HOSVD truncation of the reference solution.

Theorems & Definitions (40)

  • Theorem 1: Accuracy of DLRA kieri2019projection
  • Example 1
  • Theorem 2
  • proof
  • Lemma 3
  • proof
  • Lemma 4
  • proof
  • Lemma 5
  • proof
  • ...and 30 more