Cargando…
Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
Stochastic separation theorems play important roles in high-dimensional data analysis and machine learning. It turns out that in high dimensional space, any point of a random set of points can be separated from other points by a hyperplane with high probability, even if the number of points is expon...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7712262/ https://www.ncbi.nlm.nih.gov/pubmed/33287049 http://dx.doi.org/10.3390/e22111281 |
_version_ | 1783618334130962432 |
---|---|
author | Sidorov, Sergey Zolotykh, Nikolai |
author_facet | Sidorov, Sergey Zolotykh, Nikolai |
author_sort | Sidorov, Sergey |
collection | PubMed |
description | Stochastic separation theorems play important roles in high-dimensional data analysis and machine learning. It turns out that in high dimensional space, any point of a random set of points can be separated from other points by a hyperplane with high probability, even if the number of points is exponential in terms of dimensions. This and similar facts can be used for constructing correctors for artificial intelligent systems, for determining the intrinsic dimensionality of data and for explaining various natural intelligence phenomena. In this paper, we refine the estimations for the number of points and for the probability in stochastic separation theorems, thereby strengthening some results obtained earlier. We propose the boundaries for linear and Fisher separability, when the points are drawn randomly, independently and uniformly from a d-dimensional spherical layer and from the cube. These results allow us to better outline the applicability limits of the stochastic separation theorems in applications. |
format | Online Article Text |
id | pubmed-7712262 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-77122622021-02-24 Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube Sidorov, Sergey Zolotykh, Nikolai Entropy (Basel) Article Stochastic separation theorems play important roles in high-dimensional data analysis and machine learning. It turns out that in high dimensional space, any point of a random set of points can be separated from other points by a hyperplane with high probability, even if the number of points is exponential in terms of dimensions. This and similar facts can be used for constructing correctors for artificial intelligent systems, for determining the intrinsic dimensionality of data and for explaining various natural intelligence phenomena. In this paper, we refine the estimations for the number of points and for the probability in stochastic separation theorems, thereby strengthening some results obtained earlier. We propose the boundaries for linear and Fisher separability, when the points are drawn randomly, independently and uniformly from a d-dimensional spherical layer and from the cube. These results allow us to better outline the applicability limits of the stochastic separation theorems in applications. MDPI 2020-11-12 /pmc/articles/PMC7712262/ /pubmed/33287049 http://dx.doi.org/10.3390/e22111281 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Sidorov, Sergey Zolotykh, Nikolai Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube |
title | Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube |
title_full | Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube |
title_fullStr | Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube |
title_full_unstemmed | Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube |
title_short | Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube |
title_sort | linear and fisher separability of random points in the d-dimensional spherical layer and inside the d-dimensional cube |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7712262/ https://www.ncbi.nlm.nih.gov/pubmed/33287049 http://dx.doi.org/10.3390/e22111281 |
work_keys_str_mv | AT sidorovsergey linearandfisherseparabilityofrandompointsintheddimensionalsphericallayerandinsidetheddimensionalcube AT zolotykhnikolai linearandfisherseparabilityofrandompointsintheddimensionalsphericallayerandinsidetheddimensionalcube |