Cargando…

Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection

Graph neural networks have been widely used by multivariate time series-based anomaly detection algorithms to model the dependencies of system sensors. Previous studies have focused on learning the fixed dependency patterns between sensors. However, they ignore that the inter-sensor and temporal dep...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Chunzhi, Xing, Shaowen, Gao, Rong, Yan, Lingyu, Xiong, Naixue, Wang, Ruoxi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9919045/
https://www.ncbi.nlm.nih.gov/pubmed/36772143
http://dx.doi.org/10.3390/s23031104
_version_ 1784886726650494976
author Wang, Chunzhi
Xing, Shaowen
Gao, Rong
Yan, Lingyu
Xiong, Naixue
Wang, Ruoxi
author_facet Wang, Chunzhi
Xing, Shaowen
Gao, Rong
Yan, Lingyu
Xiong, Naixue
Wang, Ruoxi
author_sort Wang, Chunzhi
collection PubMed
description Graph neural networks have been widely used by multivariate time series-based anomaly detection algorithms to model the dependencies of system sensors. Previous studies have focused on learning the fixed dependency patterns between sensors. However, they ignore that the inter-sensor and temporal dependencies of time series are highly nonlinear and dynamic, leading to inevitable false alarms. In this paper, we propose a novel disentangled dynamic deviation transformer network ([Formula: see text]) for anomaly detection of multivariate time series, which jointly exploits multiscale dynamic inter-sensor dependencies and long-term temporal dependencies to improve the accuracy of multivariate time series prediction. Specifically, to disentangle the multiscale graph convolution, we design a novel disentangled multiscale aggregation scheme to better represent the hidden dependencies between sensors to learn fixed inter-sensor dependencies based on static topology. To capture dynamic inter-sensor dependencies determined by real-time monitoring situations and unexpected anomalies, we introduce a self-attention mechanism to model dynamic directed interactions in various potential subspaces influenced by various factors. In addition, complex temporal correlations across multiple time steps are simulated by processing the time series in parallel. Experiments on three real datasets show that the proposed [Formula: see text] significantly outperforms the state-of-the-art methods.
format Online
Article
Text
id pubmed-9919045
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99190452023-02-12 Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection Wang, Chunzhi Xing, Shaowen Gao, Rong Yan, Lingyu Xiong, Naixue Wang, Ruoxi Sensors (Basel) Article Graph neural networks have been widely used by multivariate time series-based anomaly detection algorithms to model the dependencies of system sensors. Previous studies have focused on learning the fixed dependency patterns between sensors. However, they ignore that the inter-sensor and temporal dependencies of time series are highly nonlinear and dynamic, leading to inevitable false alarms. In this paper, we propose a novel disentangled dynamic deviation transformer network ([Formula: see text]) for anomaly detection of multivariate time series, which jointly exploits multiscale dynamic inter-sensor dependencies and long-term temporal dependencies to improve the accuracy of multivariate time series prediction. Specifically, to disentangle the multiscale graph convolution, we design a novel disentangled multiscale aggregation scheme to better represent the hidden dependencies between sensors to learn fixed inter-sensor dependencies based on static topology. To capture dynamic inter-sensor dependencies determined by real-time monitoring situations and unexpected anomalies, we introduce a self-attention mechanism to model dynamic directed interactions in various potential subspaces influenced by various factors. In addition, complex temporal correlations across multiple time steps are simulated by processing the time series in parallel. Experiments on three real datasets show that the proposed [Formula: see text] significantly outperforms the state-of-the-art methods. MDPI 2023-01-18 /pmc/articles/PMC9919045/ /pubmed/36772143 http://dx.doi.org/10.3390/s23031104 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Chunzhi
Xing, Shaowen
Gao, Rong
Yan, Lingyu
Xiong, Naixue
Wang, Ruoxi
Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection
title Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection
title_full Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection
title_fullStr Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection
title_full_unstemmed Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection
title_short Disentangled Dynamic Deviation Transformer Networks for Multivariate Time Series Anomaly Detection
title_sort disentangled dynamic deviation transformer networks for multivariate time series anomaly detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9919045/
https://www.ncbi.nlm.nih.gov/pubmed/36772143
http://dx.doi.org/10.3390/s23031104
work_keys_str_mv AT wangchunzhi disentangleddynamicdeviationtransformernetworksformultivariatetimeseriesanomalydetection
AT xingshaowen disentangleddynamicdeviationtransformernetworksformultivariatetimeseriesanomalydetection
AT gaorong disentangleddynamicdeviationtransformernetworksformultivariatetimeseriesanomalydetection
AT yanlingyu disentangleddynamicdeviationtransformernetworksformultivariatetimeseriesanomalydetection
AT xiongnaixue disentangleddynamicdeviationtransformernetworksformultivariatetimeseriesanomalydetection
AT wangruoxi disentangleddynamicdeviationtransformernetworksformultivariatetimeseriesanomalydetection