Cargando…

Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection

Humans rely on clean water for their health, well-being, and various socio-economic activities. During the past few years, the COVID-19 pandemic has been a constant reminder of about the importance of hygiene and sanitation for public health. The most common approach to securing clean water supplies...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Hao, Zech, Johannes, Hong, Danfeng, Ghamisi, Pedram, Schultz, Michael, Zipf, Alexander
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Author(s). Published by Elsevier B.V. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9626640/
https://www.ncbi.nlm.nih.gov/pubmed/36338308
http://dx.doi.org/10.1016/j.jag.2022.102804
_version_ 1784822781175660544
author Li, Hao
Zech, Johannes
Hong, Danfeng
Ghamisi, Pedram
Schultz, Michael
Zipf, Alexander
author_facet Li, Hao
Zech, Johannes
Hong, Danfeng
Ghamisi, Pedram
Schultz, Michael
Zipf, Alexander
author_sort Li, Hao
collection PubMed
description Humans rely on clean water for their health, well-being, and various socio-economic activities. During the past few years, the COVID-19 pandemic has been a constant reminder of about the importance of hygiene and sanitation for public health. The most common approach to securing clean water supplies for this purpose is via wastewater treatment. To date, an effective method of detecting wastewater treatment plants (WWTP) accurately and automatically via remote sensing is unavailable. In this paper, we provide a solution to this task by proposing a novel joint deep learning (JDL) method that consists of a fine-tuned object detection network and a multi-task residual attention network (RAN). By leveraging OpenStreetMap (OSM) and multimodal remote sensing (RS) data, our JDL method is able to simultaneously tackle two different tasks: land use land cover (LULC) and WWTP classification. Moreover, JDL exploits the complementary effects between these tasks for a performance gain. We train JDL using 4,187 WWTP features and 4,200 LULC samples and validate the performance of the proposed method over a selected area around Stuttgart with 723 WWTP features and 1,200 LULC samples to generate an LULC classification map and a WWTP detection map. Extensive experiments conducted with different comparative methods demonstrate the effectiveness and efficiency of our JDL method in automatic WWTP detection in comparison with single-modality/single-task or traditional survey methods. Moreover, lessons learned pave the way for future works to simultaneously and effectively address multiple large-scale mapping tasks (e.g., both mapping LULC and detecting WWTP) from multimodal RS data via deep learning.
format Online
Article
Text
id pubmed-9626640
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher The Author(s). Published by Elsevier B.V.
record_format MEDLINE/PubMed
spelling pubmed-96266402022-11-02 Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection Li, Hao Zech, Johannes Hong, Danfeng Ghamisi, Pedram Schultz, Michael Zipf, Alexander Int J Appl Earth Obs Geoinf Article Humans rely on clean water for their health, well-being, and various socio-economic activities. During the past few years, the COVID-19 pandemic has been a constant reminder of about the importance of hygiene and sanitation for public health. The most common approach to securing clean water supplies for this purpose is via wastewater treatment. To date, an effective method of detecting wastewater treatment plants (WWTP) accurately and automatically via remote sensing is unavailable. In this paper, we provide a solution to this task by proposing a novel joint deep learning (JDL) method that consists of a fine-tuned object detection network and a multi-task residual attention network (RAN). By leveraging OpenStreetMap (OSM) and multimodal remote sensing (RS) data, our JDL method is able to simultaneously tackle two different tasks: land use land cover (LULC) and WWTP classification. Moreover, JDL exploits the complementary effects between these tasks for a performance gain. We train JDL using 4,187 WWTP features and 4,200 LULC samples and validate the performance of the proposed method over a selected area around Stuttgart with 723 WWTP features and 1,200 LULC samples to generate an LULC classification map and a WWTP detection map. Extensive experiments conducted with different comparative methods demonstrate the effectiveness and efficiency of our JDL method in automatic WWTP detection in comparison with single-modality/single-task or traditional survey methods. Moreover, lessons learned pave the way for future works to simultaneously and effectively address multiple large-scale mapping tasks (e.g., both mapping LULC and detecting WWTP) from multimodal RS data via deep learning. The Author(s). Published by Elsevier B.V. 2022-06 2022-05-15 /pmc/articles/PMC9626640/ /pubmed/36338308 http://dx.doi.org/10.1016/j.jag.2022.102804 Text en © 2022 The Author(s) Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.
spellingShingle Article
Li, Hao
Zech, Johannes
Hong, Danfeng
Ghamisi, Pedram
Schultz, Michael
Zipf, Alexander
Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection
title Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection
title_full Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection
title_fullStr Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection
title_full_unstemmed Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection
title_short Leveraging OpenStreetMap and Multimodal Remote Sensing Data with Joint Deep Learning for Wastewater Treatment Plants Detection
title_sort leveraging openstreetmap and multimodal remote sensing data with joint deep learning for wastewater treatment plants detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9626640/
https://www.ncbi.nlm.nih.gov/pubmed/36338308
http://dx.doi.org/10.1016/j.jag.2022.102804
work_keys_str_mv AT lihao leveragingopenstreetmapandmultimodalremotesensingdatawithjointdeeplearningforwastewatertreatmentplantsdetection
AT zechjohannes leveragingopenstreetmapandmultimodalremotesensingdatawithjointdeeplearningforwastewatertreatmentplantsdetection
AT hongdanfeng leveragingopenstreetmapandmultimodalremotesensingdatawithjointdeeplearningforwastewatertreatmentplantsdetection
AT ghamisipedram leveragingopenstreetmapandmultimodalremotesensingdatawithjointdeeplearningforwastewatertreatmentplantsdetection
AT schultzmichael leveragingopenstreetmapandmultimodalremotesensingdatawithjointdeeplearningforwastewatertreatmentplantsdetection
AT zipfalexander leveragingopenstreetmapandmultimodalremotesensingdatawithjointdeeplearningforwastewatertreatmentplantsdetection