Cargando…
Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality †
The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT w...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8871052/ https://www.ncbi.nlm.nih.gov/pubmed/35205600 http://dx.doi.org/10.3390/e24020306 |
_version_ | 1784656904000110592 |
---|---|
author | Wang, Shuchan Stavrou, Photios A. Skoglund, Mikael |
author_facet | Wang, Shuchan Stavrou, Photios A. Skoglund, Mikael |
author_sort | Wang, Shuchan |
collection | PubMed |
description | The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT with an extra entropic constraint or regularization, called entropic OT. Despite its convenience in computation, entropic OT still lacks sufficient theoretical support. In this paper, we show that the quadratic cost in entropic OT can be upper-bounded using entropy power inequality (EPI)-type bounds. First, we prove an HWI-type inequality by making use of the infinitesimal displacement convexity of the OT map. Second, we derive two Talagrand-type inequalities using the saturation of EPI that corresponds to a numerical term in our expressions. These two new inequalities are shown to generalize two previous results obtained by Bolley et al. and Bai et al. Using the new Talagrand-type inequalities, we also show that the geometry observed by Sinkhorn distance is smoothed in the sense of measure concentration. Finally, we corroborate our results with various simulation studies. |
format | Online Article Text |
id | pubmed-8871052 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-88710522022-02-25 Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † Wang, Shuchan Stavrou, Photios A. Skoglund, Mikael Entropy (Basel) Article The distance that compares the difference between two probability distributions plays a fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a theoretical framework to study such distances. Recent advances in OT theory include a generalization of classical OT with an extra entropic constraint or regularization, called entropic OT. Despite its convenience in computation, entropic OT still lacks sufficient theoretical support. In this paper, we show that the quadratic cost in entropic OT can be upper-bounded using entropy power inequality (EPI)-type bounds. First, we prove an HWI-type inequality by making use of the infinitesimal displacement convexity of the OT map. Second, we derive two Talagrand-type inequalities using the saturation of EPI that corresponds to a numerical term in our expressions. These two new inequalities are shown to generalize two previous results obtained by Bolley et al. and Bai et al. Using the new Talagrand-type inequalities, we also show that the geometry observed by Sinkhorn distance is smoothed in the sense of measure concentration. Finally, we corroborate our results with various simulation studies. MDPI 2022-02-21 /pmc/articles/PMC8871052/ /pubmed/35205600 http://dx.doi.org/10.3390/e24020306 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Shuchan Stavrou, Photios A. Skoglund, Mikael Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † |
title | Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † |
title_full | Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † |
title_fullStr | Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † |
title_full_unstemmed | Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † |
title_short | Generalizations of Talagrand Inequality for Sinkhorn Distance Using Entropy Power Inequality † |
title_sort | generalizations of talagrand inequality for sinkhorn distance using entropy power inequality † |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8871052/ https://www.ncbi.nlm.nih.gov/pubmed/35205600 http://dx.doi.org/10.3390/e24020306 |
work_keys_str_mv | AT wangshuchan generalizationsoftalagrandinequalityforsinkhorndistanceusingentropypowerinequality AT stavrouphotiosa generalizationsoftalagrandinequalityforsinkhorndistanceusingentropypowerinequality AT skoglundmikael generalizationsoftalagrandinequalityforsinkhorndistanceusingentropypowerinequality |