Cargando…

Automated spectroscopic modelling with optimised convolutional neural networks

Convolutional neural networks (CNN) for spectroscopic modelling are currently tuned manually, and the effects of their hyperparameters are not analysed. These can result in sub-optimal models. Here, we propose an approach to tune one-dimensional CNN (1D-CNNs) automatically. It consists of a parametr...

Descripción completa

Detalles Bibliográficos
Autores principales: Shen, Zefang, Viscarra Rossel, R. A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794546/
https://www.ncbi.nlm.nih.gov/pubmed/33420224
http://dx.doi.org/10.1038/s41598-020-80486-9
_version_ 1783634234688143360
author Shen, Zefang
Viscarra Rossel, R. A.
author_facet Shen, Zefang
Viscarra Rossel, R. A.
author_sort Shen, Zefang
collection PubMed
description Convolutional neural networks (CNN) for spectroscopic modelling are currently tuned manually, and the effects of their hyperparameters are not analysed. These can result in sub-optimal models. Here, we propose an approach to tune one-dimensional CNN (1D-CNNs) automatically. It consists of a parametric representation of 1D-CNNs and an optimisation of hyperparameters to maximise a model’s performance. We used a large European soil spectroscopic database to demonstrate our approach for estimating soil organic carbon (SOC) contents. To assess the optimisation, we compared it to random search, and to understand the effects of the hyperparameters, we calculated their importance using functional Analysis of Variance. Compared to random search, the optimisation produced better final results and showed faster convergence. The optimal model produced the most accurate estimates of SOC with [Formula: see text] (s.d.) and [Formula: see text] (s.d.). The hyperparameters associated with model training and architecture critically affected the model’s performance, while those related to the spectral preprocessing had little effect. The optimisation searched through a complex hyperparameter space and returned an optimal 1D-CNN. Our approach simplified the development of 1D-CNNs for spectroscopic modelling by automatically selecting hyperparameters and preprocessing methods. Hyperparameter importance analysis shed light on the tuning process and increased the model’s reliability.
format Online
Article
Text
id pubmed-7794546
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-77945462021-01-12 Automated spectroscopic modelling with optimised convolutional neural networks Shen, Zefang Viscarra Rossel, R. A. Sci Rep Article Convolutional neural networks (CNN) for spectroscopic modelling are currently tuned manually, and the effects of their hyperparameters are not analysed. These can result in sub-optimal models. Here, we propose an approach to tune one-dimensional CNN (1D-CNNs) automatically. It consists of a parametric representation of 1D-CNNs and an optimisation of hyperparameters to maximise a model’s performance. We used a large European soil spectroscopic database to demonstrate our approach for estimating soil organic carbon (SOC) contents. To assess the optimisation, we compared it to random search, and to understand the effects of the hyperparameters, we calculated their importance using functional Analysis of Variance. Compared to random search, the optimisation produced better final results and showed faster convergence. The optimal model produced the most accurate estimates of SOC with [Formula: see text] (s.d.) and [Formula: see text] (s.d.). The hyperparameters associated with model training and architecture critically affected the model’s performance, while those related to the spectral preprocessing had little effect. The optimisation searched through a complex hyperparameter space and returned an optimal 1D-CNN. Our approach simplified the development of 1D-CNNs for spectroscopic modelling by automatically selecting hyperparameters and preprocessing methods. Hyperparameter importance analysis shed light on the tuning process and increased the model’s reliability. Nature Publishing Group UK 2021-01-08 /pmc/articles/PMC7794546/ /pubmed/33420224 http://dx.doi.org/10.1038/s41598-020-80486-9 Text en © The Author(s) 2021 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Shen, Zefang
Viscarra Rossel, R. A.
Automated spectroscopic modelling with optimised convolutional neural networks
title Automated spectroscopic modelling with optimised convolutional neural networks
title_full Automated spectroscopic modelling with optimised convolutional neural networks
title_fullStr Automated spectroscopic modelling with optimised convolutional neural networks
title_full_unstemmed Automated spectroscopic modelling with optimised convolutional neural networks
title_short Automated spectroscopic modelling with optimised convolutional neural networks
title_sort automated spectroscopic modelling with optimised convolutional neural networks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794546/
https://www.ncbi.nlm.nih.gov/pubmed/33420224
http://dx.doi.org/10.1038/s41598-020-80486-9
work_keys_str_mv AT shenzefang automatedspectroscopicmodellingwithoptimisedconvolutionalneuralnetworks
AT viscarrarosselra automatedspectroscopicmodellingwithoptimisedconvolutionalneuralnetworks