Cargando…
Parallel biocomputing
BACKGROUND: With the advent of high throughput genomics and high-resolution imaging techniques, there is a growing necessity in biology and medicine for parallel computing, and with the low cost of computing, it is now cost-effective for even small labs or individuals to build their own personal com...
Autores principales: | , , |
---|---|
Formato: | Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2011
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3068083/ https://www.ncbi.nlm.nih.gov/pubmed/21418580 http://dx.doi.org/10.1186/1751-0473-6-4 |
_version_ | 1782201179195834368 |
---|---|
author | Kompass, Kenneth S Hoffmann, Thomas J Witte, John S |
author_facet | Kompass, Kenneth S Hoffmann, Thomas J Witte, John S |
author_sort | Kompass, Kenneth S |
collection | PubMed |
description | BACKGROUND: With the advent of high throughput genomics and high-resolution imaging techniques, there is a growing necessity in biology and medicine for parallel computing, and with the low cost of computing, it is now cost-effective for even small labs or individuals to build their own personal computation cluster. METHODS: Here we briefly describe how to use commodity hardware to build a low-cost, high-performance compute cluster, and provide an in-depth example and sample code for parallel execution of R jobs using MOSIX, a mature extension of the Linux kernel for parallel computing. A similar process can be used with other cluster platform software. RESULTS: As a statistical genetics example, we use our cluster to run a simulated eQTL experiment. Because eQTL is computationally intensive, and is conceptually easy to parallelize, like many statistics/genetics applications, parallel execution with MOSIX gives a linear speedup in analysis time with little additional effort. CONCLUSIONS: We have used MOSIX to run a wide variety of software programs in parallel with good results. The limitations and benefits of using MOSIX are discussed and compared to other platforms. |
format | Text |
id | pubmed-3068083 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2011 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-30680832011-03-31 Parallel biocomputing Kompass, Kenneth S Hoffmann, Thomas J Witte, John S Source Code Biol Med Brief Reports BACKGROUND: With the advent of high throughput genomics and high-resolution imaging techniques, there is a growing necessity in biology and medicine for parallel computing, and with the low cost of computing, it is now cost-effective for even small labs or individuals to build their own personal computation cluster. METHODS: Here we briefly describe how to use commodity hardware to build a low-cost, high-performance compute cluster, and provide an in-depth example and sample code for parallel execution of R jobs using MOSIX, a mature extension of the Linux kernel for parallel computing. A similar process can be used with other cluster platform software. RESULTS: As a statistical genetics example, we use our cluster to run a simulated eQTL experiment. Because eQTL is computationally intensive, and is conceptually easy to parallelize, like many statistics/genetics applications, parallel execution with MOSIX gives a linear speedup in analysis time with little additional effort. CONCLUSIONS: We have used MOSIX to run a wide variety of software programs in parallel with good results. The limitations and benefits of using MOSIX are discussed and compared to other platforms. BioMed Central 2011-03-18 /pmc/articles/PMC3068083/ /pubmed/21418580 http://dx.doi.org/10.1186/1751-0473-6-4 Text en Copyright ©2011 Kompass et al; licensee BioMed Central Ltd. http://creativecommons.org/licenses/by/2.0 This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Brief Reports Kompass, Kenneth S Hoffmann, Thomas J Witte, John S Parallel biocomputing |
title | Parallel biocomputing |
title_full | Parallel biocomputing |
title_fullStr | Parallel biocomputing |
title_full_unstemmed | Parallel biocomputing |
title_short | Parallel biocomputing |
title_sort | parallel biocomputing |
topic | Brief Reports |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3068083/ https://www.ncbi.nlm.nih.gov/pubmed/21418580 http://dx.doi.org/10.1186/1751-0473-6-4 |
work_keys_str_mv | AT kompasskenneths parallelbiocomputing AT hoffmannthomasj parallelbiocomputing AT wittejohns parallelbiocomputing |