Cargando…

Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube

Stochastic separation theorems play important roles in high-dimensional data analysis and machine learning. It turns out that in high dimensional space, any point of a random set of points can be separated from other points by a hyperplane with high probability, even if the number of points is expon...

Descripción completa

Detalles Bibliográficos
Autores principales: Sidorov, Sergey, Zolotykh, Nikolai
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7712262/
https://www.ncbi.nlm.nih.gov/pubmed/33287049
http://dx.doi.org/10.3390/e22111281
_version_ 1783618334130962432
author Sidorov, Sergey
Zolotykh, Nikolai
author_facet Sidorov, Sergey
Zolotykh, Nikolai
author_sort Sidorov, Sergey
collection PubMed
description Stochastic separation theorems play important roles in high-dimensional data analysis and machine learning. It turns out that in high dimensional space, any point of a random set of points can be separated from other points by a hyperplane with high probability, even if the number of points is exponential in terms of dimensions. This and similar facts can be used for constructing correctors for artificial intelligent systems, for determining the intrinsic dimensionality of data and for explaining various natural intelligence phenomena. In this paper, we refine the estimations for the number of points and for the probability in stochastic separation theorems, thereby strengthening some results obtained earlier. We propose the boundaries for linear and Fisher separability, when the points are drawn randomly, independently and uniformly from a d-dimensional spherical layer and from the cube. These results allow us to better outline the applicability limits of the stochastic separation theorems in applications.
format Online
Article
Text
id pubmed-7712262
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-77122622021-02-24 Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube Sidorov, Sergey Zolotykh, Nikolai Entropy (Basel) Article Stochastic separation theorems play important roles in high-dimensional data analysis and machine learning. It turns out that in high dimensional space, any point of a random set of points can be separated from other points by a hyperplane with high probability, even if the number of points is exponential in terms of dimensions. This and similar facts can be used for constructing correctors for artificial intelligent systems, for determining the intrinsic dimensionality of data and for explaining various natural intelligence phenomena. In this paper, we refine the estimations for the number of points and for the probability in stochastic separation theorems, thereby strengthening some results obtained earlier. We propose the boundaries for linear and Fisher separability, when the points are drawn randomly, independently and uniformly from a d-dimensional spherical layer and from the cube. These results allow us to better outline the applicability limits of the stochastic separation theorems in applications. MDPI 2020-11-12 /pmc/articles/PMC7712262/ /pubmed/33287049 http://dx.doi.org/10.3390/e22111281 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Sidorov, Sergey
Zolotykh, Nikolai
Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
title Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
title_full Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
title_fullStr Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
title_full_unstemmed Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
title_short Linear and Fisher Separability of Random Points in the d-Dimensional Spherical Layer and Inside the d-Dimensional Cube
title_sort linear and fisher separability of random points in the d-dimensional spherical layer and inside the d-dimensional cube
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7712262/
https://www.ncbi.nlm.nih.gov/pubmed/33287049
http://dx.doi.org/10.3390/e22111281
work_keys_str_mv AT sidorovsergey linearandfisherseparabilityofrandompointsintheddimensionalsphericallayerandinsidetheddimensionalcube
AT zolotykhnikolai linearandfisherseparabilityofrandompointsintheddimensionalsphericallayerandinsidetheddimensionalcube