Cargando…
A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly aff...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Royal Society of Chemistry
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9078568/ https://www.ncbi.nlm.nih.gov/pubmed/35539871 http://dx.doi.org/10.1039/c7ra13202f |
_version_ | 1784702362149978112 |
---|---|
author | Li, Jingwei Tong, Yifei Guan, Li Wu, Shaofeng Li, Dongbo |
author_facet | Li, Jingwei Tong, Yifei Guan, Li Wu, Shaofeng Li, Dongbo |
author_sort | Li, Jingwei |
collection | PubMed |
description | When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly affects the subsequent quantitative analysis and information mining. Choosing an appropriate denoising method is key to improve the spectral analysis accuracy and promote the spectral analysis ability. In this paper, a new UV-visible absorption spectrum denoising method is proposed: a denoising method based on ensemble empirical mode decomposition (EEMD) and improved universal threshold filtering (EEMD-based method). The noisy UV-visible absorption spectrum signal is firstly decomposed into a finite set of band limited signals called intrinsic mode functions (IMFs) via EEMD. Spearman's rank correlation coefficient (Spearman's rho) is then used as a criterion for the IMFs dominated by noise or useful signals, and the improved universal threshold filtering method is applied to the noise dominant IMFs to eliminate the noise. Finally, the denoised UV-visible absorption spectrum signal is reconstructed. In order to discuss the effectiveness of the EEMD-based denoising method proposed in this paper, we compare it with various wavelet-based threshold denoising methods. Both methods have been implemented on synthetic signals with diverse waveforms (‘Blocks’, ‘Bumps’ and ‘Heavy sine’). It is demonstrated that the proposed method outperforms the wavelet-based methods. Then, the measured UV-visible absorption spectra with different SNR were denoised by the wavelet and proposed methods. The method proposed also performs well in the spectrum denoising experiment. |
format | Online Article Text |
id | pubmed-9078568 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | The Royal Society of Chemistry |
record_format | MEDLINE/PubMed |
spelling | pubmed-90785682022-05-09 A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter Li, Jingwei Tong, Yifei Guan, Li Wu, Shaofeng Li, Dongbo RSC Adv Chemistry When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly affects the subsequent quantitative analysis and information mining. Choosing an appropriate denoising method is key to improve the spectral analysis accuracy and promote the spectral analysis ability. In this paper, a new UV-visible absorption spectrum denoising method is proposed: a denoising method based on ensemble empirical mode decomposition (EEMD) and improved universal threshold filtering (EEMD-based method). The noisy UV-visible absorption spectrum signal is firstly decomposed into a finite set of band limited signals called intrinsic mode functions (IMFs) via EEMD. Spearman's rank correlation coefficient (Spearman's rho) is then used as a criterion for the IMFs dominated by noise or useful signals, and the improved universal threshold filtering method is applied to the noise dominant IMFs to eliminate the noise. Finally, the denoised UV-visible absorption spectrum signal is reconstructed. In order to discuss the effectiveness of the EEMD-based denoising method proposed in this paper, we compare it with various wavelet-based threshold denoising methods. Both methods have been implemented on synthetic signals with diverse waveforms (‘Blocks’, ‘Bumps’ and ‘Heavy sine’). It is demonstrated that the proposed method outperforms the wavelet-based methods. Then, the measured UV-visible absorption spectra with different SNR were denoised by the wavelet and proposed methods. The method proposed also performs well in the spectrum denoising experiment. The Royal Society of Chemistry 2018-02-23 /pmc/articles/PMC9078568/ /pubmed/35539871 http://dx.doi.org/10.1039/c7ra13202f Text en This journal is © The Royal Society of Chemistry https://creativecommons.org/licenses/by-nc/3.0/ |
spellingShingle | Chemistry Li, Jingwei Tong, Yifei Guan, Li Wu, Shaofeng Li, Dongbo A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter |
title | A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter |
title_full | A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter |
title_fullStr | A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter |
title_full_unstemmed | A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter |
title_short | A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter |
title_sort | uv-visible absorption spectrum denoising method based on eemd and an improved universal threshold filter |
topic | Chemistry |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9078568/ https://www.ncbi.nlm.nih.gov/pubmed/35539871 http://dx.doi.org/10.1039/c7ra13202f |
work_keys_str_mv | AT lijingwei auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT tongyifei auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT guanli auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT wushaofeng auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT lidongbo auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT lijingwei uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT tongyifei uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT guanli uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT wushaofeng uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter AT lidongbo uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter |