Cargando…

MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network

Precipitation nowcasting is mainly achieved by the radar echo extrapolation method. Due to the timing characteristics of radar echo extrapolation, convolutional recurrent neural networks (ConvRNNs) have been used to solve the task. Most ConvRNNs have been proven to perform far better than traditiona...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Shengchun, Wang, Tianyang, Wang, Sihong, Fang, Zixiong, Huang, Jingui, Zhou, Zuxi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10575230/
https://www.ncbi.nlm.nih.gov/pubmed/37836895
http://dx.doi.org/10.3390/s23198065
_version_ 1785120876742574080
author Wang, Shengchun
Wang, Tianyang
Wang, Sihong
Fang, Zixiong
Huang, Jingui
Zhou, Zuxi
author_facet Wang, Shengchun
Wang, Tianyang
Wang, Sihong
Fang, Zixiong
Huang, Jingui
Zhou, Zuxi
author_sort Wang, Shengchun
collection PubMed
description Precipitation nowcasting is mainly achieved by the radar echo extrapolation method. Due to the timing characteristics of radar echo extrapolation, convolutional recurrent neural networks (ConvRNNs) have been used to solve the task. Most ConvRNNs have been proven to perform far better than traditional optical flow methods, but they still have fatal problems. These models lack differentiation in the prediction of echoes of different intensities, which leads to the omission of responses from regions with high intensities. Moreover, because it is difficult for these models to capture long-term feature dependencies among multiple echo maps, the extrapolation effect declines sharply over time. This paper proposes an embedded multi-layer attention module (MLAM) to address the shortcomings of ConvRNNs. Specifically, an MLAM mainly enhances attention to critical regions in echo images and the processing of long-term spatiotemporal features through the interaction between input and memory features in the current moment. Comprehensive experiments were conducted on the radar dataset HKO-7 provided by the Hong Kong Observatory and the radar dataset HMB provided by the Hunan Meteorological Bureau. Experiments show that ConvRNNs embedded with MLAMs achieve more advanced results than standard ConvRNNs.
format Online
Article
Text
id pubmed-10575230
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-105752302023-10-14 MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network Wang, Shengchun Wang, Tianyang Wang, Sihong Fang, Zixiong Huang, Jingui Zhou, Zuxi Sensors (Basel) Article Precipitation nowcasting is mainly achieved by the radar echo extrapolation method. Due to the timing characteristics of radar echo extrapolation, convolutional recurrent neural networks (ConvRNNs) have been used to solve the task. Most ConvRNNs have been proven to perform far better than traditional optical flow methods, but they still have fatal problems. These models lack differentiation in the prediction of echoes of different intensities, which leads to the omission of responses from regions with high intensities. Moreover, because it is difficult for these models to capture long-term feature dependencies among multiple echo maps, the extrapolation effect declines sharply over time. This paper proposes an embedded multi-layer attention module (MLAM) to address the shortcomings of ConvRNNs. Specifically, an MLAM mainly enhances attention to critical regions in echo images and the processing of long-term spatiotemporal features through the interaction between input and memory features in the current moment. Comprehensive experiments were conducted on the radar dataset HKO-7 provided by the Hong Kong Observatory and the radar dataset HMB provided by the Hunan Meteorological Bureau. Experiments show that ConvRNNs embedded with MLAMs achieve more advanced results than standard ConvRNNs. MDPI 2023-09-25 /pmc/articles/PMC10575230/ /pubmed/37836895 http://dx.doi.org/10.3390/s23198065 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Shengchun
Wang, Tianyang
Wang, Sihong
Fang, Zixiong
Huang, Jingui
Zhou, Zuxi
MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network
title MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network
title_full MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network
title_fullStr MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network
title_full_unstemmed MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network
title_short MLAM: Multi-Layer Attention Module for Radar Extrapolation Based on Spatiotemporal Sequence Neural Network
title_sort mlam: multi-layer attention module for radar extrapolation based on spatiotemporal sequence neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10575230/
https://www.ncbi.nlm.nih.gov/pubmed/37836895
http://dx.doi.org/10.3390/s23198065
work_keys_str_mv AT wangshengchun mlammultilayerattentionmoduleforradarextrapolationbasedonspatiotemporalsequenceneuralnetwork
AT wangtianyang mlammultilayerattentionmoduleforradarextrapolationbasedonspatiotemporalsequenceneuralnetwork
AT wangsihong mlammultilayerattentionmoduleforradarextrapolationbasedonspatiotemporalsequenceneuralnetwork
AT fangzixiong mlammultilayerattentionmoduleforradarextrapolationbasedonspatiotemporalsequenceneuralnetwork
AT huangjingui mlammultilayerattentionmoduleforradarextrapolationbasedonspatiotemporalsequenceneuralnetwork
AT zhouzuxi mlammultilayerattentionmoduleforradarextrapolationbasedonspatiotemporalsequenceneuralnetwork