Cargando…
Can computational efficiency alone drive the evolution of modularity in neural networks?
Some biologists have abandoned the idea that computational efficiency in processing multipart tasks or input sets alone drives the evolution of modularity in biological networks. A recent study confirmed that small modular (neural) networks are relatively computationally-inefficient but large modula...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5004152/ https://www.ncbi.nlm.nih.gov/pubmed/27573614 http://dx.doi.org/10.1038/srep31982 |
_version_ | 1782450749280616448 |
---|---|
author | Tosh, Colin R. |
author_facet | Tosh, Colin R. |
author_sort | Tosh, Colin R. |
collection | PubMed |
description | Some biologists have abandoned the idea that computational efficiency in processing multipart tasks or input sets alone drives the evolution of modularity in biological networks. A recent study confirmed that small modular (neural) networks are relatively computationally-inefficient but large modular networks are slightly more efficient than non-modular ones. The present study determines whether these efficiency advantages with network size can drive the evolution of modularity in networks whose connective architecture can evolve. The answer is no, but the reason why is interesting. All simulations (run in a wide variety of parameter states) involving gradualistic connective evolution end in non-modular local attractors. Thus while a high performance modular attractor exists, such regions cannot be reached by gradualistic evolution. Non-gradualistic evolutionary simulations in which multi-modularity is obtained through duplication of existing architecture appear viable. Fundamentally, this study indicates that computational efficiency alone does not drive the evolution of modularity, even in large biological networks, but it may still be a viable mechanism when networks evolve by non-gradualistic means. |
format | Online Article Text |
id | pubmed-5004152 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Nature Publishing Group |
record_format | MEDLINE/PubMed |
spelling | pubmed-50041522016-09-07 Can computational efficiency alone drive the evolution of modularity in neural networks? Tosh, Colin R. Sci Rep Article Some biologists have abandoned the idea that computational efficiency in processing multipart tasks or input sets alone drives the evolution of modularity in biological networks. A recent study confirmed that small modular (neural) networks are relatively computationally-inefficient but large modular networks are slightly more efficient than non-modular ones. The present study determines whether these efficiency advantages with network size can drive the evolution of modularity in networks whose connective architecture can evolve. The answer is no, but the reason why is interesting. All simulations (run in a wide variety of parameter states) involving gradualistic connective evolution end in non-modular local attractors. Thus while a high performance modular attractor exists, such regions cannot be reached by gradualistic evolution. Non-gradualistic evolutionary simulations in which multi-modularity is obtained through duplication of existing architecture appear viable. Fundamentally, this study indicates that computational efficiency alone does not drive the evolution of modularity, even in large biological networks, but it may still be a viable mechanism when networks evolve by non-gradualistic means. Nature Publishing Group 2016-08-30 /pmc/articles/PMC5004152/ /pubmed/27573614 http://dx.doi.org/10.1038/srep31982 Text en Copyright © 2016, The Author(s) http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
spellingShingle | Article Tosh, Colin R. Can computational efficiency alone drive the evolution of modularity in neural networks? |
title | Can computational efficiency alone drive the evolution of modularity in neural networks? |
title_full | Can computational efficiency alone drive the evolution of modularity in neural networks? |
title_fullStr | Can computational efficiency alone drive the evolution of modularity in neural networks? |
title_full_unstemmed | Can computational efficiency alone drive the evolution of modularity in neural networks? |
title_short | Can computational efficiency alone drive the evolution of modularity in neural networks? |
title_sort | can computational efficiency alone drive the evolution of modularity in neural networks? |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5004152/ https://www.ncbi.nlm.nih.gov/pubmed/27573614 http://dx.doi.org/10.1038/srep31982 |
work_keys_str_mv | AT toshcolinr cancomputationalefficiencyalonedrivetheevolutionofmodularityinneuralnetworks |