Cargando…

Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements

In the field of sensors, in areas such as industrial, clinical, or environment, it is common to find one dimensional (1D) formatted data (e.g., electrocardiogram, temperature, power consumption). A very promising technique for modelling this information is the use of One Dimensional Convolutional Ne...

Descripción completa

Detalles Bibliográficos
Autores principales: Rala Cordeiro, João, Raimundo, António, Postolache, Octavian, Sebastião, Pedro
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659883/
https://www.ncbi.nlm.nih.gov/pubmed/34883994
http://dx.doi.org/10.3390/s21237990
_version_ 1784613069446447104
author Rala Cordeiro, João
Raimundo, António
Postolache, Octavian
Sebastião, Pedro
author_facet Rala Cordeiro, João
Raimundo, António
Postolache, Octavian
Sebastião, Pedro
author_sort Rala Cordeiro, João
collection PubMed
description In the field of sensors, in areas such as industrial, clinical, or environment, it is common to find one dimensional (1D) formatted data (e.g., electrocardiogram, temperature, power consumption). A very promising technique for modelling this information is the use of One Dimensional Convolutional Neural Networks (1D CNN), which introduces a new challenge, namely how to define the best architecture for a 1D CNN. This manuscript addresses the concept of One Dimensional Neural Architecture Search (1D NAS), an approach that automates the search for the best combination of Neuronal Networks hyperparameters (model architecture), including both structural and training hyperparameters, for optimising 1D CNNs. This work includes the implementation of search processes for 1D CNN architectures based on five strategies: greedy, random, Bayesian, hyperband, and genetic approaches to perform, collect, and analyse the results obtained by each strategy scenario. For the analysis, we conducted 125 experiments, followed by a thorough evaluation from multiple perspectives, including the best-performing model in terms of accuracy, consistency, variability, total running time, and computational resource consumption. Finally, by presenting the optimised 1D CNN architecture, the results for the manuscript’s research question (a real-life clinical case) were provided.
format Online
Article
Text
id pubmed-8659883
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-86598832021-12-10 Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements Rala Cordeiro, João Raimundo, António Postolache, Octavian Sebastião, Pedro Sensors (Basel) Article In the field of sensors, in areas such as industrial, clinical, or environment, it is common to find one dimensional (1D) formatted data (e.g., electrocardiogram, temperature, power consumption). A very promising technique for modelling this information is the use of One Dimensional Convolutional Neural Networks (1D CNN), which introduces a new challenge, namely how to define the best architecture for a 1D CNN. This manuscript addresses the concept of One Dimensional Neural Architecture Search (1D NAS), an approach that automates the search for the best combination of Neuronal Networks hyperparameters (model architecture), including both structural and training hyperparameters, for optimising 1D CNNs. This work includes the implementation of search processes for 1D CNN architectures based on five strategies: greedy, random, Bayesian, hyperband, and genetic approaches to perform, collect, and analyse the results obtained by each strategy scenario. For the analysis, we conducted 125 experiments, followed by a thorough evaluation from multiple perspectives, including the best-performing model in terms of accuracy, consistency, variability, total running time, and computational resource consumption. Finally, by presenting the optimised 1D CNN architecture, the results for the manuscript’s research question (a real-life clinical case) were provided. MDPI 2021-11-30 /pmc/articles/PMC8659883/ /pubmed/34883994 http://dx.doi.org/10.3390/s21237990 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Rala Cordeiro, João
Raimundo, António
Postolache, Octavian
Sebastião, Pedro
Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
title Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
title_full Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
title_fullStr Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
title_full_unstemmed Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
title_short Neural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
title_sort neural architecture search for 1d cnns—different approaches tests and measurements
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659883/
https://www.ncbi.nlm.nih.gov/pubmed/34883994
http://dx.doi.org/10.3390/s21237990
work_keys_str_mv AT ralacordeirojoao neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements
AT raimundoantonio neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements
AT postolacheoctavian neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements
AT sebastiaopedro neuralarchitecturesearchfor1dcnnsdifferentapproachestestsandmeasurements