Cargando…
Fluctuation-based outlier detection
Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we show that outliers are susceptible to a mechanism called fluctu...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9918462/ https://www.ncbi.nlm.nih.gov/pubmed/36765095 http://dx.doi.org/10.1038/s41598-023-29549-1 |
_version_ | 1784886614051258368 |
---|---|
author | Du, Xusheng Zuo, Enguang Chu, Zheng He, Zhenzhen Yu, Jiong |
author_facet | Du, Xusheng Zuo, Enguang Chu, Zheng He, Zhenzhen Yu, Jiong |
author_sort | Du, Xusheng |
collection | PubMed |
description | Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we show that outliers are susceptible to a mechanism called fluctuation. This article proposes a method called fluctuation-based outlier detection (FBOD) that achieves a low linear time complexity and detects outliers purely based on the concept of fluctuation without employing any distance, density or isolation measure. Fundamentally different from all existing methods. FBOD first converts the Euclidean structure datasets into graphs by using random links, then propagates the feature value according to the connection of the graph. Finally, by comparing the difference between the fluctuation of an object and its neighbors, FBOD determines the object with a larger difference as an outlier. The results of experiments comparing FBOD with eight state-of-the-art algorithms on eight real-worlds tabular datasets and three video datasets show that FBOD outperforms its competitors in the majority of cases and that FBOD has only 5% of the execution time of the fastest algorithm. The experiment codes are available at: https://github.com/FluctuationOD/Fluctuation-based-Outlier-Detection. |
format | Online Article Text |
id | pubmed-9918462 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-99184622023-02-12 Fluctuation-based outlier detection Du, Xusheng Zuo, Enguang Chu, Zheng He, Zhenzhen Yu, Jiong Sci Rep Article Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we show that outliers are susceptible to a mechanism called fluctuation. This article proposes a method called fluctuation-based outlier detection (FBOD) that achieves a low linear time complexity and detects outliers purely based on the concept of fluctuation without employing any distance, density or isolation measure. Fundamentally different from all existing methods. FBOD first converts the Euclidean structure datasets into graphs by using random links, then propagates the feature value according to the connection of the graph. Finally, by comparing the difference between the fluctuation of an object and its neighbors, FBOD determines the object with a larger difference as an outlier. The results of experiments comparing FBOD with eight state-of-the-art algorithms on eight real-worlds tabular datasets and three video datasets show that FBOD outperforms its competitors in the majority of cases and that FBOD has only 5% of the execution time of the fastest algorithm. The experiment codes are available at: https://github.com/FluctuationOD/Fluctuation-based-Outlier-Detection. Nature Publishing Group UK 2023-02-10 /pmc/articles/PMC9918462/ /pubmed/36765095 http://dx.doi.org/10.1038/s41598-023-29549-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Du, Xusheng Zuo, Enguang Chu, Zheng He, Zhenzhen Yu, Jiong Fluctuation-based outlier detection |
title | Fluctuation-based outlier detection |
title_full | Fluctuation-based outlier detection |
title_fullStr | Fluctuation-based outlier detection |
title_full_unstemmed | Fluctuation-based outlier detection |
title_short | Fluctuation-based outlier detection |
title_sort | fluctuation-based outlier detection |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9918462/ https://www.ncbi.nlm.nih.gov/pubmed/36765095 http://dx.doi.org/10.1038/s41598-023-29549-1 |
work_keys_str_mv | AT duxusheng fluctuationbasedoutlierdetection AT zuoenguang fluctuationbasedoutlierdetection AT chuzheng fluctuationbasedoutlierdetection AT hezhenzhen fluctuationbasedoutlierdetection AT yujiong fluctuationbasedoutlierdetection |