Table of Contents
Fetching ...

Deep Centralization for the Circumcentered Reflection Method

Pablo Barros

TL;DR

This work extends centralized CRM to ecCRM by incorporating an admissible operator $T$ and a relaxation schedule $\alpha_k$ for two-set CFPs, preserving global convergence and achieving linear rates with potential for superlinear speed on smooth intersections. The framework reduces computation to a small number of projections per iteration and allows modular kernel choices, including deep kernels that amplify contraction. Theoretical results establish Fejér monotonicity and linear convergence under mild regularity, with superlinear behavior under favorable geometry and kernel choices. Empirical tests on matrix completion and ellipsoids demonstrate meaningful runtime and iteration reductions from deeper centralization and vanishing-step strategies, highlighting practical gains in large-scale convex feasibility problems.

Abstract

We introduce the extended centralized circumcentered reflection method (ecCRM), a framework for two-set convex feasibility that encompasses the classical centralized CRM (cCRM) of Behling, Bello-Cruz, Iusem and Santos as a special case. Our method replaces the fixed centralization step of cCRM with an admissible operator $T$ and a parameter $α$, allowing control over computational cost and step quality. We show that ecCRM retains global convergence, linear rates under mild regularity, and superlinearity for smooth manifolds. Numerical experiments on large-scale matrix completion indicate that deeper operators can dramatically reduce overall runtime, and tests on high-dimensional ellipsoids show that vanishing step sizes can yield significant acceleration, validating the practical utility of both algorithmic components of ecCRM.

Deep Centralization for the Circumcentered Reflection Method

TL;DR

This work extends centralized CRM to ecCRM by incorporating an admissible operator and a relaxation schedule for two-set CFPs, preserving global convergence and achieving linear rates with potential for superlinear speed on smooth intersections. The framework reduces computation to a small number of projections per iteration and allows modular kernel choices, including deep kernels that amplify contraction. Theoretical results establish Fejér monotonicity and linear convergence under mild regularity, with superlinear behavior under favorable geometry and kernel choices. Empirical tests on matrix completion and ellipsoids demonstrate meaningful runtime and iteration reductions from deeper centralization and vanishing-step strategies, highlighting practical gains in large-scale convex feasibility problems.

Abstract

We introduce the extended centralized circumcentered reflection method (ecCRM), a framework for two-set convex feasibility that encompasses the classical centralized CRM (cCRM) of Behling, Bello-Cruz, Iusem and Santos as a special case. Our method replaces the fixed centralization step of cCRM with an admissible operator and a parameter , allowing control over computational cost and step quality. We show that ecCRM retains global convergence, linear rates under mild regularity, and superlinearity for smooth manifolds. Numerical experiments on large-scale matrix completion indicate that deeper operators can dramatically reduce overall runtime, and tests on high-dimensional ellipsoids show that vanishing step sizes can yield significant acceleration, validating the practical utility of both algorithmic components of ecCRM.

Paper Structure

This paper contains 8 sections, 12 theorems, 57 equations, 1 figure, 2 tables.

Key Result

Lemma 1.3

Take any $y\in Y$, any $\alpha\in (0,1)$, and define $z := \alpha y + (1-\alpha) P_X y.$ Then:

Figures (1)

  • Figure 1: Convergence on $\mathbb{R}^{2000}$ Ellipsoids.

Theorems & Definitions (30)

  • Definition 1.2: Centralized points
  • Lemma 1.3: Centralization procedure
  • proof
  • Proposition 1.4
  • proof
  • Definition 2.1: Circumcenter
  • Definition 2.2: PCRM operator
  • Definition 2.3: ecCRM operator
  • Definition 2.4: ecCRM method
  • Remark 2.5: Computational note and examples
  • ...and 20 more