Cargando…

Can computational efficiency alone drive the evolution of modularity in neural networks?

Some biologists have abandoned the idea that computational efficiency in processing multipart tasks or input sets alone drives the evolution of modularity in biological networks. A recent study confirmed that small modular (neural) networks are relatively computationally-inefficient but large modula...

Descripción completa

Detalles Bibliográficos
Autor principal: Tosh, Colin R.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5004152/
https://www.ncbi.nlm.nih.gov/pubmed/27573614
http://dx.doi.org/10.1038/srep31982
_version_ 1782450749280616448
author Tosh, Colin R.
author_facet Tosh, Colin R.
author_sort Tosh, Colin R.
collection PubMed
description Some biologists have abandoned the idea that computational efficiency in processing multipart tasks or input sets alone drives the evolution of modularity in biological networks. A recent study confirmed that small modular (neural) networks are relatively computationally-inefficient but large modular networks are slightly more efficient than non-modular ones. The present study determines whether these efficiency advantages with network size can drive the evolution of modularity in networks whose connective architecture can evolve. The answer is no, but the reason why is interesting. All simulations (run in a wide variety of parameter states) involving gradualistic connective evolution end in non-modular local attractors. Thus while a high performance modular attractor exists, such regions cannot be reached by gradualistic evolution. Non-gradualistic evolutionary simulations in which multi-modularity is obtained through duplication of existing architecture appear viable. Fundamentally, this study indicates that computational efficiency alone does not drive the evolution of modularity, even in large biological networks, but it may still be a viable mechanism when networks evolve by non-gradualistic means.
format Online
Article
Text
id pubmed-5004152
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Nature Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-50041522016-09-07 Can computational efficiency alone drive the evolution of modularity in neural networks? Tosh, Colin R. Sci Rep Article Some biologists have abandoned the idea that computational efficiency in processing multipart tasks or input sets alone drives the evolution of modularity in biological networks. A recent study confirmed that small modular (neural) networks are relatively computationally-inefficient but large modular networks are slightly more efficient than non-modular ones. The present study determines whether these efficiency advantages with network size can drive the evolution of modularity in networks whose connective architecture can evolve. The answer is no, but the reason why is interesting. All simulations (run in a wide variety of parameter states) involving gradualistic connective evolution end in non-modular local attractors. Thus while a high performance modular attractor exists, such regions cannot be reached by gradualistic evolution. Non-gradualistic evolutionary simulations in which multi-modularity is obtained through duplication of existing architecture appear viable. Fundamentally, this study indicates that computational efficiency alone does not drive the evolution of modularity, even in large biological networks, but it may still be a viable mechanism when networks evolve by non-gradualistic means. Nature Publishing Group 2016-08-30 /pmc/articles/PMC5004152/ /pubmed/27573614 http://dx.doi.org/10.1038/srep31982 Text en Copyright © 2016, The Author(s) http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Tosh, Colin R.
Can computational efficiency alone drive the evolution of modularity in neural networks?
title Can computational efficiency alone drive the evolution of modularity in neural networks?
title_full Can computational efficiency alone drive the evolution of modularity in neural networks?
title_fullStr Can computational efficiency alone drive the evolution of modularity in neural networks?
title_full_unstemmed Can computational efficiency alone drive the evolution of modularity in neural networks?
title_short Can computational efficiency alone drive the evolution of modularity in neural networks?
title_sort can computational efficiency alone drive the evolution of modularity in neural networks?
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5004152/
https://www.ncbi.nlm.nih.gov/pubmed/27573614
http://dx.doi.org/10.1038/srep31982
work_keys_str_mv AT toshcolinr cancomputationalefficiencyalonedrivetheevolutionofmodularityinneuralnetworks