Table of Contents
Fetching ...

On the Private Estimation of Smooth Transport Maps

Clément Lalanne, Franck Iutzeler, Jean-Michel Loubes, Julien Chhor

TL;DR

This paper addresses the problem of privately estimating smooth optimal transport maps between distributions from samples by leveraging Brenier potentials and their gradients. It develops a differentially private estimator built on the empirical semi-dual and a wavelet-based subspace approximation, yielding an $L^2$ error rate of $n^{-1} \vee n^{- rac{2\alpha}{2\alpha-2+d}} \vee (n\epsilon)^{- rac{2\alpha}{2\alpha+d}}$ (up to polylog terms) and provides a matching (up to constants) lower bound under DP. A practical discretization approach is proposed to implement the estimator, and experiments on a Gaussian attraction/repulsion model illustrate the method's behavior under privacy constraints. The work highlights the privacy-utility trade-off in private OT estimation and opens avenues for further improvements via regularization and scalable algorithms.

Abstract

Estimating optimal transport maps between two distributions from respective samples is an important element for many machine learning methods. To do so, rather than extending discrete transport maps, it has been shown that estimating the Brenier potential of the transport problem and obtaining a transport map through its gradient is near minimax optimal for smooth problems. In this paper, we investigate the private estimation of such potentials and transport maps with respect to the distribution samples.We propose a differentially private transport map estimator achieving an $L^2$ error of at most $n^{-1} \vee n^{-\frac{2 α}{2 α- 2 + d}} \vee (nε)^{-\frac{2 α}{2 α+ d}} $ up to poly-logarithmic terms where $n$ is the sample size, $ε$ is the desired level of privacy, $α$ is the smoothness of the true transport map, and $d$ is the dimension of the feature space. We also provide a lower bound for the problem.

On the Private Estimation of Smooth Transport Maps

TL;DR

This paper addresses the problem of privately estimating smooth optimal transport maps between distributions from samples by leveraging Brenier potentials and their gradients. It develops a differentially private estimator built on the empirical semi-dual and a wavelet-based subspace approximation, yielding an error rate of (up to polylog terms) and provides a matching (up to constants) lower bound under DP. A practical discretization approach is proposed to implement the estimator, and experiments on a Gaussian attraction/repulsion model illustrate the method's behavior under privacy constraints. The work highlights the privacy-utility trade-off in private OT estimation and opens avenues for further improvements via regularization and scalable algorithms.

Abstract

Estimating optimal transport maps between two distributions from respective samples is an important element for many machine learning methods. To do so, rather than extending discrete transport maps, it has been shown that estimating the Brenier potential of the transport problem and obtaining a transport map through its gradient is near minimax optimal for smooth problems. In this paper, we investigate the private estimation of such potentials and transport maps with respect to the distribution samples.We propose a differentially private transport map estimator achieving an error of at most up to poly-logarithmic terms where is the sample size, is the desired level of privacy, is the smoothness of the true transport map, and is the dimension of the feature space. We also provide a lower bound for the problem.

Paper Structure

This paper contains 45 sections, 16 theorems, 109 equations, 2 figures.

Key Result

Theorem 2.4

For any $\alpha>1$, the minimax rate of smooth optimal transport map estimation is Moreover, if $P\in\mathcal{M}$ and $T_0\in\mathcal{T}_{\alpha}$, the estimator $\hat{T}_J \vcentcolon= \nabla \hat{f}_J$ defined above achieves this rate up to polylogarithmic factors. Here, the constants also hide a dependence on $R$.

Figures (2)

  • Figure 1: Kernel density estimators of the samples used in the experiments
  • Figure 2: Optimal Transport Map VS Estimated Private Map

Theorems & Definitions (35)

  • Definition 2.1: Admissible source distributions
  • Definition 2.2: Admissible smooth transport maps
  • Definition 2.3: Admissible potentials
  • Theorem 2.4: Th. 2 of hutter2021minimax
  • Lemma 2.5
  • proof
  • Definition 3.1: Differential Privacy dwork2006calibrating
  • Lemma 3.2: Report Noisy Argmin with Laplace Noise
  • Lemma 3.3: Sensitivity of the semi-dual objective
  • proof
  • ...and 25 more