Cargando…
Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
In the field of sensors, in areas such as industrial, clinical, or environment, it is common to find one dimensional (1D) formatted data (e.g., electrocardiogram, temperature, power consumption). A very promising technique for modelling this information is the use of One Dimensional Convolutional Ne...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659883/ https://www.ncbi.nlm.nih.gov/pubmed/34883994 http://dx.doi.org/10.3390/s21237990 |
_version_ | 1784613069446447104 |
---|---|
author | Rala Cordeiro, João Raimundo, António Postolache, Octavian Sebastião, Pedro |
author_facet | Rala Cordeiro, João Raimundo, António Postolache, Octavian Sebastião, Pedro |
author_sort | Rala Cordeiro, João |
collection | PubMed |
description | In the field of sensors, in areas such as industrial, clinical, or environment, it is common to find one dimensional (1D) formatted data (e.g., electrocardiogram, temperature, power consumption). A very promising technique for modelling this information is the use of One Dimensional Convolutional Neural Networks (1D CNN), which introduces a new challenge, namely how to define the best architecture for a 1D CNN. This manuscript addresses the concept of One Dimensional Neural Architecture Search (1D NAS), an approach that automates the search for the best combination of Neuronal Networks hyperparameters (model architecture), including both structural and training hyperparameters, for optimising 1D CNNs. This work includes the implementation of search processes for 1D CNN architectures based on five strategies: greedy, random, Bayesian, hyperband, and genetic approaches to perform, collect, and analyse the results obtained by each strategy scenario. For the analysis, we conducted 125 experiments, followed by a thorough evaluation from multiple perspectives, including the best-performing model in terms of accuracy, consistency, variability, total running time, and computational resource consumption. Finally, by presenting the optimised 1D CNN architecture, the results for the manuscript’s research question (a real-life clinical case) were provided. |
format | Online Article Text |
id | pubmed-8659883 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-86598832021-12-10 Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements Rala Cordeiro, João Raimundo, António Postolache, Octavian Sebastião, Pedro Sensors (Basel) Article In the field of sensors, in areas such as industrial, clinical, or environment, it is common to find one dimensional (1D) formatted data (e.g., electrocardiogram, temperature, power consumption). A very promising technique for modelling this information is the use of One Dimensional Convolutional Neural Networks (1D CNN), which introduces a new challenge, namely how to define the best architecture for a 1D CNN. This manuscript addresses the concept of One Dimensional Neural Architecture Search (1D NAS), an approach that automates the search for the best combination of Neuronal Networks hyperparameters (model architecture), including both structural and training hyperparameters, for optimising 1D CNNs. This work includes the implementation of search processes for 1D CNN architectures based on five strategies: greedy, random, Bayesian, hyperband, and genetic approaches to perform, collect, and analyse the results obtained by each strategy scenario. For the analysis, we conducted 125 experiments, followed by a thorough evaluation from multiple perspectives, including the best-performing model in terms of accuracy, consistency, variability, total running time, and computational resource consumption. Finally, by presenting the optimised 1D CNN architecture, the results for the manuscript’s research question (a real-life clinical case) were provided. MDPI 2021-11-30 /pmc/articles/PMC8659883/ /pubmed/34883994 http://dx.doi.org/10.3390/s21237990 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Rala Cordeiro, João Raimundo, António Postolache, Octavian Sebastião, Pedro Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements |
title | Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements |
title_full | Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements |
title_fullStr | Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements |
title_full_unstemmed | Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements |
title_short | Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements |
title_sort | neural architecture search for 1d cnns—different approaches tests and measurements |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659883/ https://www.ncbi.nlm.nih.gov/pubmed/34883994 http://dx.doi.org/10.3390/s21237990 |
work_keys_str_mv | AT ralacordeirojoao neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements AT raimundoantonio neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements AT postolacheoctavian neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements AT sebastiaopedro neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements |