Cargando…

Transparent Quality Optimization for Machine Learning-Based Regression in Neurology

The clinical monitoring of walking generates enormous amounts of data that contain extremely valuable information. Therefore, machine learning (ML) has rapidly entered the research arena to analyze and make predictions from large heterogeneous datasets. Such data-driven ML-based applications for var...

Descripción completa

Detalles Bibliográficos
Autores principales: Wendt, Karsten, Trentzsch, Katrin, Haase, Rocco, Weidemann, Marie Luise, Weidemann, Robin, Aßmann, Uwe, Ziemssen, Tjalf
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9224715/
https://www.ncbi.nlm.nih.gov/pubmed/35743693
http://dx.doi.org/10.3390/jpm12060908
_version_ 1784733436105195520
author Wendt, Karsten
Trentzsch, Katrin
Haase, Rocco
Weidemann, Marie Luise
Weidemann, Robin
Aßmann, Uwe
Ziemssen, Tjalf
author_facet Wendt, Karsten
Trentzsch, Katrin
Haase, Rocco
Weidemann, Marie Luise
Weidemann, Robin
Aßmann, Uwe
Ziemssen, Tjalf
author_sort Wendt, Karsten
collection PubMed
description The clinical monitoring of walking generates enormous amounts of data that contain extremely valuable information. Therefore, machine learning (ML) has rapidly entered the research arena to analyze and make predictions from large heterogeneous datasets. Such data-driven ML-based applications for various domains become increasingly applicable, and thus their software qualities are taken into focus. This work provides a proof of concept for applying state-of-the-art ML technology to predict the distance travelled of the 2-min walk test, an important neurological measurement which is an indicator of walking endurance. A transparent lean approach was emphasized to optimize the results in an explainable way and simultaneously meet the specified software requirements for a generic approach. It is a general-purpose strategy as a fractional–factorial design benchmark combined with standardized quality metrics based on a minimal technology build and a resulting optimized software prototype. Based on 400 training and 100 validation data, the achieved prediction yielded a relative error of [Formula: see text] distributed over multiple experiments with an optimized configuration. The Adadelta algorithm ([Formula: see text] , [Formula: see text] , [Formula: see text] , [Formula: see text]) performed as the best model, with [Formula: see text] of the predictions with an absolute error of <15 m. Factors such as gender, age, disease duration, or use of walking aids showed no effect on the relative error. For multiple sclerosis patients with high walking impairment (EDSS Ambulation Score [Formula: see text]), the relative difference was significant ([Formula: see text]; [Formula: see text]; [Formula: see text]). The results show that it is possible to create a transparently working ML prototype for a given medical use case while meeting certain software qualities.
format Online
Article
Text
id pubmed-9224715
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-92247152022-06-24 Transparent Quality Optimization for Machine Learning-Based Regression in Neurology Wendt, Karsten Trentzsch, Katrin Haase, Rocco Weidemann, Marie Luise Weidemann, Robin Aßmann, Uwe Ziemssen, Tjalf J Pers Med Article The clinical monitoring of walking generates enormous amounts of data that contain extremely valuable information. Therefore, machine learning (ML) has rapidly entered the research arena to analyze and make predictions from large heterogeneous datasets. Such data-driven ML-based applications for various domains become increasingly applicable, and thus their software qualities are taken into focus. This work provides a proof of concept for applying state-of-the-art ML technology to predict the distance travelled of the 2-min walk test, an important neurological measurement which is an indicator of walking endurance. A transparent lean approach was emphasized to optimize the results in an explainable way and simultaneously meet the specified software requirements for a generic approach. It is a general-purpose strategy as a fractional–factorial design benchmark combined with standardized quality metrics based on a minimal technology build and a resulting optimized software prototype. Based on 400 training and 100 validation data, the achieved prediction yielded a relative error of [Formula: see text] distributed over multiple experiments with an optimized configuration. The Adadelta algorithm ([Formula: see text] , [Formula: see text] , [Formula: see text] , [Formula: see text]) performed as the best model, with [Formula: see text] of the predictions with an absolute error of <15 m. Factors such as gender, age, disease duration, or use of walking aids showed no effect on the relative error. For multiple sclerosis patients with high walking impairment (EDSS Ambulation Score [Formula: see text]), the relative difference was significant ([Formula: see text]; [Formula: see text]; [Formula: see text]). The results show that it is possible to create a transparently working ML prototype for a given medical use case while meeting certain software qualities. MDPI 2022-05-31 /pmc/articles/PMC9224715/ /pubmed/35743693 http://dx.doi.org/10.3390/jpm12060908 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wendt, Karsten
Trentzsch, Katrin
Haase, Rocco
Weidemann, Marie Luise
Weidemann, Robin
Aßmann, Uwe
Ziemssen, Tjalf
Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
title Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
title_full Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
title_fullStr Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
title_full_unstemmed Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
title_short Transparent Quality Optimization for Machine Learning-Based Regression in Neurology
title_sort transparent quality optimization for machine learning-based regression in neurology
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9224715/
https://www.ncbi.nlm.nih.gov/pubmed/35743693
http://dx.doi.org/10.3390/jpm12060908
work_keys_str_mv AT wendtkarsten transparentqualityoptimizationformachinelearningbasedregressioninneurology
AT trentzschkatrin transparentqualityoptimizationformachinelearningbasedregressioninneurology
AT haaserocco transparentqualityoptimizationformachinelearningbasedregressioninneurology
AT weidemannmarieluise transparentqualityoptimizationformachinelearningbasedregressioninneurology
AT weidemannrobin transparentqualityoptimizationformachinelearningbasedregressioninneurology
AT aßmannuwe transparentqualityoptimizationformachinelearningbasedregressioninneurology
AT ziemssentjalf transparentqualityoptimizationformachinelearningbasedregressioninneurology