Cargando…

Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection

Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturin...

Descripción completa

Detalles Bibliográficos
Autores principales: Fan, Haoyi, Zhang, Fengbin, Wang, Ruidong, Xi, Liang, Li, Zuoyong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206313/
http://dx.doi.org/10.1007/978-3-030-47436-2_52
_version_ 1783530392496635904
author Fan, Haoyi
Zhang, Fengbin
Wang, Ruidong
Xi, Liang
Li, Zuoyong
author_facet Fan, Haoyi
Zhang, Fengbin
Wang, Ruidong
Xi, Liang
Li, Zuoyong
author_sort Fan, Haoyi
collection PubMed
description Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns from which the abnormal ones deviate. In this paper, we propose a method of Correlation aware unsupervised Anomaly detection via Deep Gaussian Mixture Model (CADGMM), which captures the complex correlation among data points for high-quality low-dimensional representation learning. More specifically, the relations among data samples are correlated firstly in forms of a graph structure, in which, the node denotes the sample and the edge denotes the correlation between two samples from the feature space. Then, a dual-encoder that consists of a graph encoder and a feature encoder, is employed to encode both the feature and correlation information of samples into the low-dimensional latent space jointly, followed by a decoder for data reconstruction. Finally, a separate estimation network as a Gaussian Mixture Model is utilized to estimate the density of the learned latent vector, and the anomalies can be detected by measuring the energy of the samples. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method.
format Online
Article
Text
id pubmed-7206313
institution National Center for Biotechnology Information
language English
publishDate 2020
record_format MEDLINE/PubMed
spelling pubmed-72063132020-05-08 Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection Fan, Haoyi Zhang, Fengbin Wang, Ruidong Xi, Liang Li, Zuoyong Advances in Knowledge Discovery and Data Mining Article Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns from which the abnormal ones deviate. In this paper, we propose a method of Correlation aware unsupervised Anomaly detection via Deep Gaussian Mixture Model (CADGMM), which captures the complex correlation among data points for high-quality low-dimensional representation learning. More specifically, the relations among data samples are correlated firstly in forms of a graph structure, in which, the node denotes the sample and the edge denotes the correlation between two samples from the feature space. Then, a dual-encoder that consists of a graph encoder and a feature encoder, is employed to encode both the feature and correlation information of samples into the low-dimensional latent space jointly, followed by a decoder for data reconstruction. Finally, a separate estimation network as a Gaussian Mixture Model is utilized to estimate the density of the learned latent vector, and the anomalies can be detected by measuring the energy of the samples. Extensive experiments on real-world datasets demonstrate the effectiveness of the proposed method. 2020-04-17 /pmc/articles/PMC7206313/ http://dx.doi.org/10.1007/978-3-030-47436-2_52 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Fan, Haoyi
Zhang, Fengbin
Wang, Ruidong
Xi, Liang
Li, Zuoyong
Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
title Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
title_full Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
title_fullStr Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
title_full_unstemmed Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
title_short Correlation-Aware Deep Generative Model for Unsupervised Anomaly Detection
title_sort correlation-aware deep generative model for unsupervised anomaly detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7206313/
http://dx.doi.org/10.1007/978-3-030-47436-2_52
work_keys_str_mv AT fanhaoyi correlationawaredeepgenerativemodelforunsupervisedanomalydetection
AT zhangfengbin correlationawaredeepgenerativemodelforunsupervisedanomalydetection
AT wangruidong correlationawaredeepgenerativemodelforunsupervisedanomalydetection
AT xiliang correlationawaredeepgenerativemodelforunsupervisedanomalydetection
AT lizuoyong correlationawaredeepgenerativemodelforunsupervisedanomalydetection