Table of Contents
Fetching ...

The Mirror-Prox Sliding Method for Non-smooth decentralized saddle-point problems

Ilya Kuruzov, Alexander Rogozin, Demyan Yarmoshik, Alexander Gasnikov

TL;DR

This work obtains an algorithm for non-smooth decentralized saddle-point problems through a specific penalization method and this sliding, which approaches lower bounds for several communication rounds and calls of (sub-)gradient per node.

Abstract

The saddle-point optimization problems have a lot of practical applications. This paper focuses on such non-smooth problems in decentralized case. This work contains generalization of recently proposed sliding for centralized problem. Through specific penalization method and this sliding we obtain algorithm for non-smooth decentralized saddle-point problems. Note, the proposed method approaches lower bounds both for number of communication rounds and calls of (sub-)gradient per node.

The Mirror-Prox Sliding Method for Non-smooth decentralized saddle-point problems

TL;DR

This work obtains an algorithm for non-smooth decentralized saddle-point problems through a specific penalization method and this sliding, which approaches lower bounds for several communication rounds and calls of (sub-)gradient per node.

Abstract

The saddle-point optimization problems have a lot of practical applications. This paper focuses on such non-smooth problems in decentralized case. This work contains generalization of recently proposed sliding for centralized problem. Through specific penalization method and this sliding we obtain algorithm for non-smooth decentralized saddle-point problems. Note, the proposed method approaches lower bounds both for number of communication rounds and calls of (sub-)gradient per node.
Paper Structure (8 sections, 14 theorems, 77 equations, 4 algorithms)

This paper contains 8 sections, 14 theorems, 77 equations, 4 algorithms.

Key Result

Lemma 2.3

For any $\gamma_k \in [0, 1]$, we have

Theorems & Definitions (26)

  • Lemma 2.3
  • Lemma 2.4
  • proof
  • Lemma 2.5
  • proof
  • Theorem 2.6
  • proof
  • Lemma 2.8
  • proof
  • Lemma 2.9
  • ...and 16 more