Cargando…
Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Was...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8001134/ https://www.ncbi.nlm.nih.gov/pubmed/33802490 http://dx.doi.org/10.3390/e23030302 |
_version_ | 1783671158964486144 |
---|---|
author | Tong, Qijun Kobayashi, Kei |
author_facet | Tong, Qijun Kobayashi, Kei |
author_sort | Tong, Qijun |
collection | PubMed |
description | The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Wasserstein distance is costly, entropy-regularized optimal transport was proposed to computationally efficiently approximate the Wasserstein distance. The purpose of this study is to understand the theoretical aspect of entropy-regularized optimal transport. In this paper, we focus on entropy-regularized optimal transport on multivariate normal distributions and q-normal distributions. We obtain the explicit form of the entropy-regularized optimal transport cost on multivariate normal and q-normal distributions; this provides a perspective to understand the effect of entropy regularization, which was previously known only experimentally. Furthermore, we obtain the entropy-regularized Kantorovich estimator for the probability measure that satisfies certain conditions. We also demonstrate how the Wasserstein distance, optimal coupling, geometric structure, and statistical efficiency are affected by entropy regularization in some experiments. In particular, our results about the explicit form of the optimal coupling of the Tsallis entropy-regularized optimal transport on multivariate q-normal distributions and the entropy-regularized Kantorovich estimator are novel and will become the first step towards the understanding of a more general setting. |
format | Online Article Text |
id | pubmed-8001134 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-80011342021-03-28 Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions Tong, Qijun Kobayashi, Kei Entropy (Basel) Article The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Wasserstein distance is costly, entropy-regularized optimal transport was proposed to computationally efficiently approximate the Wasserstein distance. The purpose of this study is to understand the theoretical aspect of entropy-regularized optimal transport. In this paper, we focus on entropy-regularized optimal transport on multivariate normal distributions and q-normal distributions. We obtain the explicit form of the entropy-regularized optimal transport cost on multivariate normal and q-normal distributions; this provides a perspective to understand the effect of entropy regularization, which was previously known only experimentally. Furthermore, we obtain the entropy-regularized Kantorovich estimator for the probability measure that satisfies certain conditions. We also demonstrate how the Wasserstein distance, optimal coupling, geometric structure, and statistical efficiency are affected by entropy regularization in some experiments. In particular, our results about the explicit form of the optimal coupling of the Tsallis entropy-regularized optimal transport on multivariate q-normal distributions and the entropy-regularized Kantorovich estimator are novel and will become the first step towards the understanding of a more general setting. MDPI 2021-03-03 /pmc/articles/PMC8001134/ /pubmed/33802490 http://dx.doi.org/10.3390/e23030302 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ). |
spellingShingle | Article Tong, Qijun Kobayashi, Kei Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions |
title | Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions |
title_full | Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions |
title_fullStr | Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions |
title_full_unstemmed | Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions |
title_short | Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions |
title_sort | entropy-regularized optimal transport on multivariate normal and q-normal distributions |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8001134/ https://www.ncbi.nlm.nih.gov/pubmed/33802490 http://dx.doi.org/10.3390/e23030302 |
work_keys_str_mv | AT tongqijun entropyregularizedoptimaltransportonmultivariatenormalandqnormaldistributions AT kobayashikei entropyregularizedoptimaltransportonmultivariatenormalandqnormaldistributions |