Cargando…

Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions

The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Was...

Descripción completa

Detalles Bibliográficos
Autores principales: Tong, Qijun, Kobayashi, Kei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8001134/
https://www.ncbi.nlm.nih.gov/pubmed/33802490
http://dx.doi.org/10.3390/e23030302
_version_ 1783671158964486144
author Tong, Qijun
Kobayashi, Kei
author_facet Tong, Qijun
Kobayashi, Kei
author_sort Tong, Qijun
collection PubMed
description The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Wasserstein distance is costly, entropy-regularized optimal transport was proposed to computationally efficiently approximate the Wasserstein distance. The purpose of this study is to understand the theoretical aspect of entropy-regularized optimal transport. In this paper, we focus on entropy-regularized optimal transport on multivariate normal distributions and q-normal distributions. We obtain the explicit form of the entropy-regularized optimal transport cost on multivariate normal and q-normal distributions; this provides a perspective to understand the effect of entropy regularization, which was previously known only experimentally. Furthermore, we obtain the entropy-regularized Kantorovich estimator for the probability measure that satisfies certain conditions. We also demonstrate how the Wasserstein distance, optimal coupling, geometric structure, and statistical efficiency are affected by entropy regularization in some experiments. In particular, our results about the explicit form of the optimal coupling of the Tsallis entropy-regularized optimal transport on multivariate q-normal distributions and the entropy-regularized Kantorovich estimator are novel and will become the first step towards the understanding of a more general setting.
format Online
Article
Text
id pubmed-8001134
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80011342021-03-28 Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions Tong, Qijun Kobayashi, Kei Entropy (Basel) Article The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions from other distances or divergences. Although computing the Wasserstein distance is costly, entropy-regularized optimal transport was proposed to computationally efficiently approximate the Wasserstein distance. The purpose of this study is to understand the theoretical aspect of entropy-regularized optimal transport. In this paper, we focus on entropy-regularized optimal transport on multivariate normal distributions and q-normal distributions. We obtain the explicit form of the entropy-regularized optimal transport cost on multivariate normal and q-normal distributions; this provides a perspective to understand the effect of entropy regularization, which was previously known only experimentally. Furthermore, we obtain the entropy-regularized Kantorovich estimator for the probability measure that satisfies certain conditions. We also demonstrate how the Wasserstein distance, optimal coupling, geometric structure, and statistical efficiency are affected by entropy regularization in some experiments. In particular, our results about the explicit form of the optimal coupling of the Tsallis entropy-regularized optimal transport on multivariate q-normal distributions and the entropy-regularized Kantorovich estimator are novel and will become the first step towards the understanding of a more general setting. MDPI 2021-03-03 /pmc/articles/PMC8001134/ /pubmed/33802490 http://dx.doi.org/10.3390/e23030302 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ).
spellingShingle Article
Tong, Qijun
Kobayashi, Kei
Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
title Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
title_full Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
title_fullStr Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
title_full_unstemmed Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
title_short Entropy-Regularized Optimal Transport on Multivariate Normal and q-normal Distributions
title_sort entropy-regularized optimal transport on multivariate normal and q-normal distributions
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8001134/
https://www.ncbi.nlm.nih.gov/pubmed/33802490
http://dx.doi.org/10.3390/e23030302
work_keys_str_mv AT tongqijun entropyregularizedoptimaltransportonmultivariatenormalandqnormaldistributions
AT kobayashikei entropyregularizedoptimaltransportonmultivariatenormalandqnormaldistributions