Cargando…
Automated spectroscopic modelling with optimised convolutional neural networks
Convolutional neural networks (CNN) for spectroscopic modelling are currently tuned manually, and the effects of their hyperparameters are not analysed. These can result in sub-optimal models. Here, we propose an approach to tune one-dimensional CNN (1D-CNNs) automatically. It consists of a parametr...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794546/ https://www.ncbi.nlm.nih.gov/pubmed/33420224 http://dx.doi.org/10.1038/s41598-020-80486-9 |
_version_ | 1783634234688143360 |
---|---|
author | Shen, Zefang Viscarra Rossel, R. A. |
author_facet | Shen, Zefang Viscarra Rossel, R. A. |
author_sort | Shen, Zefang |
collection | PubMed |
description | Convolutional neural networks (CNN) for spectroscopic modelling are currently tuned manually, and the effects of their hyperparameters are not analysed. These can result in sub-optimal models. Here, we propose an approach to tune one-dimensional CNN (1D-CNNs) automatically. It consists of a parametric representation of 1D-CNNs and an optimisation of hyperparameters to maximise a model’s performance. We used a large European soil spectroscopic database to demonstrate our approach for estimating soil organic carbon (SOC) contents. To assess the optimisation, we compared it to random search, and to understand the effects of the hyperparameters, we calculated their importance using functional Analysis of Variance. Compared to random search, the optimisation produced better final results and showed faster convergence. The optimal model produced the most accurate estimates of SOC with [Formula: see text] (s.d.) and [Formula: see text] (s.d.). The hyperparameters associated with model training and architecture critically affected the model’s performance, while those related to the spectral preprocessing had little effect. The optimisation searched through a complex hyperparameter space and returned an optimal 1D-CNN. Our approach simplified the development of 1D-CNNs for spectroscopic modelling by automatically selecting hyperparameters and preprocessing methods. Hyperparameter importance analysis shed light on the tuning process and increased the model’s reliability. |
format | Online Article Text |
id | pubmed-7794546 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-77945462021-01-12 Automated spectroscopic modelling with optimised convolutional neural networks Shen, Zefang Viscarra Rossel, R. A. Sci Rep Article Convolutional neural networks (CNN) for spectroscopic modelling are currently tuned manually, and the effects of their hyperparameters are not analysed. These can result in sub-optimal models. Here, we propose an approach to tune one-dimensional CNN (1D-CNNs) automatically. It consists of a parametric representation of 1D-CNNs and an optimisation of hyperparameters to maximise a model’s performance. We used a large European soil spectroscopic database to demonstrate our approach for estimating soil organic carbon (SOC) contents. To assess the optimisation, we compared it to random search, and to understand the effects of the hyperparameters, we calculated their importance using functional Analysis of Variance. Compared to random search, the optimisation produced better final results and showed faster convergence. The optimal model produced the most accurate estimates of SOC with [Formula: see text] (s.d.) and [Formula: see text] (s.d.). The hyperparameters associated with model training and architecture critically affected the model’s performance, while those related to the spectral preprocessing had little effect. The optimisation searched through a complex hyperparameter space and returned an optimal 1D-CNN. Our approach simplified the development of 1D-CNNs for spectroscopic modelling by automatically selecting hyperparameters and preprocessing methods. Hyperparameter importance analysis shed light on the tuning process and increased the model’s reliability. Nature Publishing Group UK 2021-01-08 /pmc/articles/PMC7794546/ /pubmed/33420224 http://dx.doi.org/10.1038/s41598-020-80486-9 Text en © The Author(s) 2021 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Shen, Zefang Viscarra Rossel, R. A. Automated spectroscopic modelling with optimised convolutional neural networks |
title | Automated spectroscopic modelling with optimised convolutional neural networks |
title_full | Automated spectroscopic modelling with optimised convolutional neural networks |
title_fullStr | Automated spectroscopic modelling with optimised convolutional neural networks |
title_full_unstemmed | Automated spectroscopic modelling with optimised convolutional neural networks |
title_short | Automated spectroscopic modelling with optimised convolutional neural networks |
title_sort | automated spectroscopic modelling with optimised convolutional neural networks |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7794546/ https://www.ncbi.nlm.nih.gov/pubmed/33420224 http://dx.doi.org/10.1038/s41598-020-80486-9 |
work_keys_str_mv | AT shenzefang automatedspectroscopicmodellingwithoptimisedconvolutionalneuralnetworks AT viscarrarosselra automatedspectroscopicmodellingwithoptimisedconvolutionalneuralnetworks |