Cargando…

Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking

It is hypothesized that the nonlinear muscle characteristic of biomechanical systems simplify control in the sense that the information the nervous system has to process is reduced through off-loading computation to the morphological structure. It has been proposed to quantify the required informati...

Descripción completa

Detalles Bibliográficos
Autores principales: Haeufle, Daniel F. B., Wochner, Isabell, Holzmüller, David, Driess, Danny, Günther, Michael, Schmitt, Syn
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7805995/
https://www.ncbi.nlm.nih.gov/pubmed/33501244
http://dx.doi.org/10.3389/frobt.2020.00077
_version_ 1783636430473396224
author Haeufle, Daniel F. B.
Wochner, Isabell
Holzmüller, David
Driess, Danny
Günther, Michael
Schmitt, Syn
author_facet Haeufle, Daniel F. B.
Wochner, Isabell
Holzmüller, David
Driess, Danny
Günther, Michael
Schmitt, Syn
author_sort Haeufle, Daniel F. B.
collection PubMed
description It is hypothesized that the nonlinear muscle characteristic of biomechanical systems simplify control in the sense that the information the nervous system has to process is reduced through off-loading computation to the morphological structure. It has been proposed to quantify the required information with an information-entropy based approach, which evaluates the minimally required information to control a desired movement, i.e., control effort. The key idea is to compare the same movement but generated by different actuators, e.g., muscles and torque actuators, and determine which of the two morphologies requires less information to generate the same movement. In this work, for the first time, we apply this measure to numerical simulations of more complex human movements: point-to-point arm movements and walking. These models consider up to 24 control signals rendering the brute force approach of the previous implementation to search for the minimally required information futile. We therefore propose a novel algorithm based on the pattern search approach specifically designed to solve this constraint optimization problem. We apply this algorithm to numerical models, which include Hill-type muscle-tendon actuation as well as ideal torque sources acting directly on the joints. The controller for the point-to-point movements was obtained by deep reinforcement learning for muscle and torque actuators. Walking was controlled by proprioceptive neural feedback in the muscular system and a PD controller in the torque model. Results show that the neuromuscular models consistently require less information to successfully generate the movement than the torque-driven counterparts. These findings were consistent for all investigated controllers in our experiments, implying that this is a system property, not a controller property. The proposed algorithm to determine the control effort is more efficient than other standard optimization techniques and provided as open source.
format Online
Article
Text
id pubmed-7805995
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-78059952021-01-25 Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking Haeufle, Daniel F. B. Wochner, Isabell Holzmüller, David Driess, Danny Günther, Michael Schmitt, Syn Front Robot AI Robotics and AI It is hypothesized that the nonlinear muscle characteristic of biomechanical systems simplify control in the sense that the information the nervous system has to process is reduced through off-loading computation to the morphological structure. It has been proposed to quantify the required information with an information-entropy based approach, which evaluates the minimally required information to control a desired movement, i.e., control effort. The key idea is to compare the same movement but generated by different actuators, e.g., muscles and torque actuators, and determine which of the two morphologies requires less information to generate the same movement. In this work, for the first time, we apply this measure to numerical simulations of more complex human movements: point-to-point arm movements and walking. These models consider up to 24 control signals rendering the brute force approach of the previous implementation to search for the minimally required information futile. We therefore propose a novel algorithm based on the pattern search approach specifically designed to solve this constraint optimization problem. We apply this algorithm to numerical models, which include Hill-type muscle-tendon actuation as well as ideal torque sources acting directly on the joints. The controller for the point-to-point movements was obtained by deep reinforcement learning for muscle and torque actuators. Walking was controlled by proprioceptive neural feedback in the muscular system and a PD controller in the torque model. Results show that the neuromuscular models consistently require less information to successfully generate the movement than the torque-driven counterparts. These findings were consistent for all investigated controllers in our experiments, implying that this is a system property, not a controller property. The proposed algorithm to determine the control effort is more efficient than other standard optimization techniques and provided as open source. Frontiers Media S.A. 2020-06-24 /pmc/articles/PMC7805995/ /pubmed/33501244 http://dx.doi.org/10.3389/frobt.2020.00077 Text en Copyright © 2020 Haeufle, Wochner, Holzmüller, Driess, Günther and Schmitt. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Robotics and AI
Haeufle, Daniel F. B.
Wochner, Isabell
Holzmüller, David
Driess, Danny
Günther, Michael
Schmitt, Syn
Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking
title Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking
title_full Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking
title_fullStr Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking
title_full_unstemmed Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking
title_short Muscles Reduce Neuronal Information Load: Quantification of Control Effort in Biological vs. Robotic Pointing and Walking
title_sort muscles reduce neuronal information load: quantification of control effort in biological vs. robotic pointing and walking
topic Robotics and AI
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7805995/
https://www.ncbi.nlm.nih.gov/pubmed/33501244
http://dx.doi.org/10.3389/frobt.2020.00077
work_keys_str_mv AT haeufledanielfb musclesreduceneuronalinformationloadquantificationofcontroleffortinbiologicalvsroboticpointingandwalking
AT wochnerisabell musclesreduceneuronalinformationloadquantificationofcontroleffortinbiologicalvsroboticpointingandwalking
AT holzmullerdavid musclesreduceneuronalinformationloadquantificationofcontroleffortinbiologicalvsroboticpointingandwalking
AT driessdanny musclesreduceneuronalinformationloadquantificationofcontroleffortinbiologicalvsroboticpointingandwalking
AT gunthermichael musclesreduceneuronalinformationloadquantificationofcontroleffortinbiologicalvsroboticpointingandwalking
AT schmittsyn musclesreduceneuronalinformationloadquantificationofcontroleffortinbiologicalvsroboticpointingandwalking