Cargando…

Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †

The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT w...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Shuchan, Stavrou, Photios A., Skoglund, Mikael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8871052/
https://www.ncbi.nlm.nih.gov/pubmed/35205600
http://dx.doi.org/10.3390/e24020306
_version_ 1784656904000110592
author Wang, Shuchan
Stavrou, Photios A.
Skoglund, Mikael
author_facet Wang, Shuchan
Stavrou, Photios A.
Skoglund, Mikael
author_sort Wang, Shuchan
collection PubMed
description The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT with an extra entropic constraint or regularization, called entropic OT. Despite its convenience in computation, entropic OT still lacks sufficient theoretical support. In this paper, we show that the quadratic cost in entropic OT can be upper-bounded using entropy power inequality (EPI)-type bounds. First, we prove an HWI-type inequality by making use of the infinitesimal displacement convexity of the OT map. Second, we derive two Talagrand-type inequalities using the saturation of EPI that corresponds to a numerical term in our expressions. These two new inequalities are shown to generalize two previous results obtained by Bolley et al. and Bai et al. Using the new Talagrand-type inequalities, we also show that the geometry observed by Sinkhorn distance is smoothed in the sense of measure concentration. Finally, we corroborate our results with various simulation studies.
format Online
Article
Text
id pubmed-8871052
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88710522022-02-25 Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † Wang, Shuchan Stavrou, Photios A. Skoglund, Mikael Entropy (Basel) Article The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT with an extra entropic constraint or regularization, called entropic OT. Despite its convenience in computation, entropic OT still lacks sufficient theoretical support. In this paper, we show that the quadratic cost in entropic OT can be upper-bounded using entropy power inequality (EPI)-type bounds. First, we prove an HWI-type inequality by making use of the infinitesimal displacement convexity of the OT map. Second, we derive two Talagrand-type inequalities using the saturation of EPI that corresponds to a numerical term in our expressions. These two new inequalities are shown to generalize two previous results obtained by Bolley et al. and Bai et al. Using the new Talagrand-type inequalities, we also show that the geometry observed by Sinkhorn distance is smoothed in the sense of measure concentration. Finally, we corroborate our results with various simulation studies. MDPI 2022-02-21 /pmc/articles/PMC8871052/ /pubmed/35205600 http://dx.doi.org/10.3390/e24020306 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Shuchan
Stavrou, Photios A.
Skoglund, Mikael
Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
title Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
title_full Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
title_fullStr Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
title_full_unstemmed Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
title_short Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
title_sort generalizations of talagrand inequality for sinkhorn distance using entropy power inequality †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8871052/
https://www.ncbi.nlm.nih.gov/pubmed/35205600
http://dx.doi.org/10.3390/e24020306
work_keys_str_mv AT wangshuchan generalizationsoftalagrandinequalityforsinkhorndistanceusingentropypowerinequality
AT stavrouphotiosa generalizationsoftalagrandinequalityforsinkhorndistanceusingentropypowerinequality
AT skoglundmikael generalizationsoftalagrandinequalityforsinkhorndistanceusingentropypowerinequality