
Overrelaxed Sinkhorn-Knopp Algorithm for Regularized Optimal Transport
Thibault, Alexis; Chizat, Lénaïc; Dossal, Charles; Papadakis, Nicolas (2017), Overrelaxed Sinkhorn-Knopp Algorithm for Regularized Optimal Transport, NIPS'17 Workshop on Optimal Transport & Machine Learning, 2017-12, Long Beach, United States
View/ Open
Type
Communication / ConférenceDate
2017Conference title
NIPS'17 Workshop on Optimal Transport & Machine LearningConference date
2017-12Conference city
Long BeachConference country
United StatesMetadata
Show full item recordAuthor(s)
Thibault, AlexisEcole Normale Supérieure
Chizat, Lénaïc
CEntre de REcherches en MAthématiques de la DEcision [CEREMADE]
Dossal, Charles
Institut de Mathématiques de Toulouse UMR5219 [IMT]
Papadakis, Nicolas
Institut de Mathématiques de Bordeaux [IMB]
Abstract (EN)
This article describes a method for quickly computing the solution to the regularized optimal transport problem. It generalizes and improves upon the widely-used iterative Bregman projections algorithm (or Sinkhorn-Knopp algorithm). The idea is to overrelax the Bregman projection operators, allowing for faster convergence. In practice this corresponds to elevating the diagonal scaling factors to a given power, at each step of the algorithm. We propose a simple method for establishing global convergence by ensuring the decrease of a Lyapunov function at each step. An adaptive choice of overrelaxation parameter based on the Lyapunov function is constructed. We also suggest a heuristic to choose a suitable asymptotic overrelaxation parameter, based on a local convergence analysis. Our numerical experiments show a gain in convergence speed by an order of magnitude in certain regimes.Subjects / Keywords
Sinkhorn-Knopp AlgorithmRelated items
Showing items related by title and author.
-
Ferradans, Sira; Papadakis, Nicolas; Peyré, Gabriel; Aujol, Jean-François (2014) Article accepté pour publication ou publié
-
Ferradans, Sira; Papadakis, Nicolas; Rabin, Julien; Peyré, Gabriel; Aujol, Jean-François (2013) Communication / Conférence
-
Chizat, Lénaïc; Peyré, Gabriel; Schmitzer, Bernhard; Vialard, François-Xavier (2018) Article accepté pour publication ou publié
-
Chizat, Lénaïc (2017-11-10) Thèse
-
Chizat, Lénaïc; Peyré, Gabriel; Schmitzer, Bernhard; Vialard, François-Xavier (2010) Article accepté pour publication ou publié