Cargando…

Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer

Anomalies are infrequent in nature, but detecting these anomalies could be crucial for the proper functioning of any system. The rarity of anomalies could be a challenge for their detection as detection models are required to depend on the relations of the datapoints with their adjacent datapoints....

Descripción completa

Detalles Bibliográficos
Autores principales: Baidya, Ranjai, Jeong, Heon
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675229/
https://www.ncbi.nlm.nih.gov/pubmed/38005658
http://dx.doi.org/10.3390/s23229272
_version_ 1785149795830071296
author Baidya, Ranjai
Jeong, Heon
author_facet Baidya, Ranjai
Jeong, Heon
author_sort Baidya, Ranjai
collection PubMed
description Anomalies are infrequent in nature, but detecting these anomalies could be crucial for the proper functioning of any system. The rarity of anomalies could be a challenge for their detection as detection models are required to depend on the relations of the datapoints with their adjacent datapoints. In this work, we use the rarity of anomalies to detect them. For this, we introduce the reversible instance normalized anomaly transformer (RINAT). Rooted in the foundational principles of the anomaly transformer, RINAT incorporates both prior and series associations for each time point. The prior association uses a learnable Gaussian kernel to ensure a thorough understanding of the adjacent concentration inductive bias. In contrast, the series association method uses self-attention techniques to specifically focus on the original raw data. Furthermore, because anomalies are rare in nature, we utilize normalized data to identify series associations and employ non-normalized data to uncover prior associations. This approach enhances the modelled series associations and, consequently, improves the association discrepancies.
format Online
Article
Text
id pubmed-10675229
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106752292023-11-19 Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer Baidya, Ranjai Jeong, Heon Sensors (Basel) Article Anomalies are infrequent in nature, but detecting these anomalies could be crucial for the proper functioning of any system. The rarity of anomalies could be a challenge for their detection as detection models are required to depend on the relations of the datapoints with their adjacent datapoints. In this work, we use the rarity of anomalies to detect them. For this, we introduce the reversible instance normalized anomaly transformer (RINAT). Rooted in the foundational principles of the anomaly transformer, RINAT incorporates both prior and series associations for each time point. The prior association uses a learnable Gaussian kernel to ensure a thorough understanding of the adjacent concentration inductive bias. In contrast, the series association method uses self-attention techniques to specifically focus on the original raw data. Furthermore, because anomalies are rare in nature, we utilize normalized data to identify series associations and employ non-normalized data to uncover prior associations. This approach enhances the modelled series associations and, consequently, improves the association discrepancies. MDPI 2023-11-19 /pmc/articles/PMC10675229/ /pubmed/38005658 http://dx.doi.org/10.3390/s23229272 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Baidya, Ranjai
Jeong, Heon
Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer
title Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer
title_full Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer
title_fullStr Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer
title_full_unstemmed Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer
title_short Anomaly Detection in Time Series Data Using Reversible Instance Normalized Anomaly Transformer
title_sort anomaly detection in time series data using reversible instance normalized anomaly transformer
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675229/
https://www.ncbi.nlm.nih.gov/pubmed/38005658
http://dx.doi.org/10.3390/s23229272
work_keys_str_mv AT baidyaranjai anomalydetectionintimeseriesdatausingreversibleinstancenormalizedanomalytransformer
AT jeongheon anomalydetectionintimeseriesdatausingreversibleinstancenormalizedanomalytransformer