Method of Moments for Estimation of Noisy Curves
Phillip Lo, Yuehaw Khoo
TL;DR
This work tackles the problem of recovering a high-dimensional piecewise-linear curve from a highly noisy Gaussian sample cloud. It proves a fundamental $O(σ^6)$ lower bound on the sample complexity and shows that recovery is locally well-posed when relying on the third moment, enabling algorithms that fit a curve via a third-moment tensor. The proposed two-phase algorithm combines unbiased moment estimation, tensor power method-based subspace recovery, reordering of predicted subspaces, and a final relaxed-moment optimization, with numerical validation demonstrating strong performance in high-noise regimes. The findings offer a principled, moment-based approach to curve recovery in high dimensions and provide a foundation for extending to more general curve classes and robustness analyses.
Abstract
In this paper, we study the problem of recovering a ground truth high dimensional piecewise linear curve $C^*(t):[0, 1]\to\mathbb{R}^d$ from a high noise Gaussian point cloud with covariance $σ^2I$ centered around the curve. We establish that the sample complexity of recovering $C^*$ from data scales with order at least $σ^6$. We then show that recovery of a piecewise linear curve from the third moment is locally well-posed, and hence $O(σ^6)$ samples is also sufficient for recovery. We propose methods to recover a curve from data based on a fitting to the third moment tensor with a careful initialization strategy and conduct some numerical experiments verifying the ability of our methods to recover curves. All code for our numerical experiments is publicly available on GitHub.
