Cargando…
Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturin...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206313/ http://dx.doi.org/10.1007/978-3-030-47436-2_52 |
_version_ | 1783530392496635904 |
---|---|
author | Fan, Haoyi Zhang, Fengbin Wang, Ruidong Xi, Liang Li, Zuoyong |
author_facet | Fan, Haoyi Zhang, Fengbin Wang, Ruidong Xi, Liang Li, Zuoyong |
author_sort | Fan, Haoyi |
collection | PubMed |
description | Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns from which the abnormal ones deviate. In this paper, we propose a method of Correlation aware unsupervised Anomaly detection via Deep Gaussian Mixture Model (CADGMM), which captures the complex correlation among data points for high-quality low-dimensional representation learning. More specifically, the relations among data samples are correlated firstly in forms of a graph structure, in which, the node denotes the sample and the edge denotes the correlation between two samples from the feature space. Then, a dual-encoder that consists of a graph encoder and a feature encoder, is employed to encode both the feature and correlation information of samples into the low-dimensional latent space jointly, followed by a decoder for data reconstruction. Finally, a separate estimation network as a Gaussian Mixture Model is utilized to estimate the density of the learned latent vector, and the anomalies can be detected by measuring the energy of the samples. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method. |
format | Online Article Text |
id | pubmed-7206313 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
record_format | MEDLINE/PubMed |
spelling | pubmed-72063132020-05-08 Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection Fan, Haoyi Zhang, Fengbin Wang, Ruidong Xi, Liang Li, Zuoyong Advances in Knowledge Discovery and Data Mining Article Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns from which the abnormal ones deviate. In this paper, we propose a method of Correlation aware unsupervised Anomaly detection via Deep Gaussian Mixture Model (CADGMM), which captures the complex correlation among data points for high-quality low-dimensional representation learning. More specifically, the relations among data samples are correlated firstly in forms of a graph structure, in which, the node denotes the sample and the edge denotes the correlation between two samples from the feature space. Then, a dual-encoder that consists of a graph encoder and a feature encoder, is employed to encode both the feature and correlation information of samples into the low-dimensional latent space jointly, followed by a decoder for data reconstruction. Finally, a separate estimation network as a Gaussian Mixture Model is utilized to estimate the density of the learned latent vector, and the anomalies can be detected by measuring the energy of the samples. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method. 2020-04-17 /pmc/articles/PMC7206313/ http://dx.doi.org/10.1007/978-3-030-47436-2_52 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Fan, Haoyi Zhang, Fengbin Wang, Ruidong Xi, Liang Li, Zuoyong Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection |
title | Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection |
title_full | Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection |
title_fullStr | Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection |
title_full_unstemmed | Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection |
title_short | Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection |
title_sort | correlation-aware deep generative model for unsupervised anomaly detection |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206313/ http://dx.doi.org/10.1007/978-3-030-47436-2_52 |
work_keys_str_mv | AT fanhaoyi correlationawaredeepgenerativemodelforunsupervisedanomalydetection AT zhangfengbin correlationawaredeepgenerativemodelforunsupervisedanomalydetection AT wangruidong correlationawaredeepgenerativemodelforunsupervisedanomalydetection AT xiliang correlationawaredeepgenerativemodelforunsupervisedanomalydetection AT lizuoyong correlationawaredeepgenerativemodelforunsupervisedanomalydetection |