Cargando…

Fluctuation-based outlier detection

Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we show that outliers are susceptible to a mechanism called fluctu...

Descripción completa

Detalles Bibliográficos
Autores principales: Du, Xusheng, Zuo, Enguang, Chu, Zheng, He, Zhenzhen, Yu, Jiong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9918462/
https://www.ncbi.nlm.nih.gov/pubmed/36765095
http://dx.doi.org/10.1038/s41598-023-29549-1
_version_ 1784886614051258368
author Du, Xusheng
Zuo, Enguang
Chu, Zheng
He, Zhenzhen
Yu, Jiong
author_facet Du, Xusheng
Zuo, Enguang
Chu, Zheng
He, Zhenzhen
Yu, Jiong
author_sort Du, Xusheng
collection PubMed
description Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we show that outliers are susceptible to a mechanism called fluctuation. This article proposes a method called fluctuation-based outlier detection (FBOD) that achieves a low linear time complexity and detects outliers purely based on the concept of fluctuation without employing any distance, density or isolation measure. Fundamentally different from all existing methods. FBOD first converts the Euclidean structure datasets into graphs by using random links, then propagates the feature value according to the connection of the graph. Finally, by comparing the difference between the fluctuation of an object and its neighbors, FBOD determines the object with a larger difference as an outlier. The results of experiments comparing FBOD with eight state-of-the-art algorithms on eight real-worlds tabular datasets and three video datasets show that FBOD outperforms its competitors in the majority of cases and that FBOD has only 5% of the execution time of the fastest algorithm. The experiment codes are available at: https://github.com/FluctuationOD/Fluctuation-based-Outlier-Detection.
format Online
Article
Text
id pubmed-9918462
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-99184622023-02-12 Fluctuation-based outlier detection Du, Xusheng Zuo, Enguang Chu, Zheng He, Zhenzhen Yu, Jiong Sci Rep Article Outlier detection is an important topic in machine learning and has been used in a wide range of applications. Outliers are objects that are few in number and deviate from the majority of objects. As a result of these two properties, we show that outliers are susceptible to a mechanism called fluctuation. This article proposes a method called fluctuation-based outlier detection (FBOD) that achieves a low linear time complexity and detects outliers purely based on the concept of fluctuation without employing any distance, density or isolation measure. Fundamentally different from all existing methods. FBOD first converts the Euclidean structure datasets into graphs by using random links, then propagates the feature value according to the connection of the graph. Finally, by comparing the difference between the fluctuation of an object and its neighbors, FBOD determines the object with a larger difference as an outlier. The results of experiments comparing FBOD with eight state-of-the-art algorithms on eight real-worlds tabular datasets and three video datasets show that FBOD outperforms its competitors in the majority of cases and that FBOD has only 5% of the execution time of the fastest algorithm. The experiment codes are available at: https://github.com/FluctuationOD/Fluctuation-based-Outlier-Detection. Nature Publishing Group UK 2023-02-10 /pmc/articles/PMC9918462/ /pubmed/36765095 http://dx.doi.org/10.1038/s41598-023-29549-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Du, Xusheng
Zuo, Enguang
Chu, Zheng
He, Zhenzhen
Yu, Jiong
Fluctuation-based outlier detection
title Fluctuation-based outlier detection
title_full Fluctuation-based outlier detection
title_fullStr Fluctuation-based outlier detection
title_full_unstemmed Fluctuation-based outlier detection
title_short Fluctuation-based outlier detection
title_sort fluctuation-based outlier detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9918462/
https://www.ncbi.nlm.nih.gov/pubmed/36765095
http://dx.doi.org/10.1038/s41598-023-29549-1
work_keys_str_mv AT duxusheng fluctuationbasedoutlierdetection
AT zuoenguang fluctuationbasedoutlierdetection
AT chuzheng fluctuationbasedoutlierdetection
AT hezhenzhen fluctuationbasedoutlierdetection
AT yujiong fluctuationbasedoutlierdetection