Cargando…

Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster

Super‐resolved microscopy techniques have revolutionized the ability to study biological structures below the diffraction limit. Single molecule localization microscopy (SMLM) techniques are widely used because they are relatively straightforward to implement and can be realized at relatively low co...

Descripción completa

Detalles Bibliográficos
Autores principales: MUNRO, I., GARCÍA, E., YAN, M., GULDBRAND, S., KUMAR, S., KWAKWA, K., DUNSBY, C., NEIL, M.A.A., FRENCH, P.M.W.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6378585/
https://www.ncbi.nlm.nih.gov/pubmed/30508256
http://dx.doi.org/10.1111/jmi.12772
_version_ 1783395947980521472
author MUNRO, I.
GARCÍA, E.
YAN, M.
GULDBRAND, S.
KUMAR, S.
KWAKWA, K.
DUNSBY, C.
NEIL, M.A.A.
FRENCH, P.M.W.
author_facet MUNRO, I.
GARCÍA, E.
YAN, M.
GULDBRAND, S.
KUMAR, S.
KWAKWA, K.
DUNSBY, C.
NEIL, M.A.A.
FRENCH, P.M.W.
author_sort MUNRO, I.
collection PubMed
description Super‐resolved microscopy techniques have revolutionized the ability to study biological structures below the diffraction limit. Single molecule localization microscopy (SMLM) techniques are widely used because they are relatively straightforward to implement and can be realized at relatively low cost, e.g. compared to laser scanning microscopy techniques. However, while the data analysis can be readily undertaken using open source or other software tools, large SMLM data volumes and the complexity of the algorithms used often lead to long image data processing times that can hinder the iterative optimization of experiments. There is increasing interest in high throughput SMLM, but its further development and application is inhibited by the data processing challenges. We present here a widely applicable approach to accelerating SMLM data processing via a parallelized implementation of ThunderSTORM on a high‐performance computing (HPC) cluster and quantify the speed advantage for a four‐node cluster (with 24 cores and 128 GB RAM per node) compared to a high specification (28 cores, 128 GB RAM, SSD‐enabled) desktop workstation. This data processing speed can be readily scaled by accessing more HPC resources. Our approach is not specific to ThunderSTORM and can be adapted for a wide range of SMLM software. LAY DESCRIPTION: Optical microscopy is now able to provide images with a resolution far beyond the diffraction limit thanks to relatively new super‐resolved microscopy (SRM) techniques, which have revolutionized the ability to study biological structures. One approach to SRM is to randomly switch on and off the emission of fluorescent molecules in an otherwise conventional fluorescence microscope. If only a sparse subset of the fluorescent molecules labelling a sample can be switched on at a time, then each emitter will be, on average, spaced further apart than the diffraction‐limited resolution of the conventional microscope and the separate bright spots in the image corresponding to each emitter can be localised to high precision by finding the centre of each feature using a computer program. Thus, a precise map of the emitter positions can be recorded by sequentially mapping the localisation of different subsets of emitters as they are switched on and others switched off. Typically, this approach, described as single molecule localisation microscopy (SMLM), results in large image data sets that can take many minutes to hours to process, depending on the size of the field of view and whether the SMLM analysis employs a computationally‐intensive iterative algorithm. Such a slow workflow makes it difficult to optimise experiments and to analyse large numbers of samples. Faster SMLM experiments would be generally useful and automated high throughput SMLM studies of arrays of samples, such as cells, could be applied to drug discovery and other applications. However, the time required to process the resulting data would be prohibitive on a normal computer. To address this, we have developed a method to run standard SMLM data analysis software tools in parallel on a high‐performance computing cluster (HPC). This can be used to accelerate the analysis of individual SMLM experiments or it can be scaled to analyse high throughput SMLM data by extending it to run on an arbitrary number of HPC processors in parallel. In this paper we outline the design of our parallelised SMLM software for HPC and quantify the speed advantage when implementing it on four HPC nodes compared to a powerful desktop computer.
format Online
Article
Text
id pubmed-6378585
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-63785852019-02-28 Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster MUNRO, I. GARCÍA, E. YAN, M. GULDBRAND, S. KUMAR, S. KWAKWA, K. DUNSBY, C. NEIL, M.A.A. FRENCH, P.M.W. J Microsc Hot Topic—fast‐tracked short communication Super‐resolved microscopy techniques have revolutionized the ability to study biological structures below the diffraction limit. Single molecule localization microscopy (SMLM) techniques are widely used because they are relatively straightforward to implement and can be realized at relatively low cost, e.g. compared to laser scanning microscopy techniques. However, while the data analysis can be readily undertaken using open source or other software tools, large SMLM data volumes and the complexity of the algorithms used often lead to long image data processing times that can hinder the iterative optimization of experiments. There is increasing interest in high throughput SMLM, but its further development and application is inhibited by the data processing challenges. We present here a widely applicable approach to accelerating SMLM data processing via a parallelized implementation of ThunderSTORM on a high‐performance computing (HPC) cluster and quantify the speed advantage for a four‐node cluster (with 24 cores and 128 GB RAM per node) compared to a high specification (28 cores, 128 GB RAM, SSD‐enabled) desktop workstation. This data processing speed can be readily scaled by accessing more HPC resources. Our approach is not specific to ThunderSTORM and can be adapted for a wide range of SMLM software. LAY DESCRIPTION: Optical microscopy is now able to provide images with a resolution far beyond the diffraction limit thanks to relatively new super‐resolved microscopy (SRM) techniques, which have revolutionized the ability to study biological structures. One approach to SRM is to randomly switch on and off the emission of fluorescent molecules in an otherwise conventional fluorescence microscope. If only a sparse subset of the fluorescent molecules labelling a sample can be switched on at a time, then each emitter will be, on average, spaced further apart than the diffraction‐limited resolution of the conventional microscope and the separate bright spots in the image corresponding to each emitter can be localised to high precision by finding the centre of each feature using a computer program. Thus, a precise map of the emitter positions can be recorded by sequentially mapping the localisation of different subsets of emitters as they are switched on and others switched off. Typically, this approach, described as single molecule localisation microscopy (SMLM), results in large image data sets that can take many minutes to hours to process, depending on the size of the field of view and whether the SMLM analysis employs a computationally‐intensive iterative algorithm. Such a slow workflow makes it difficult to optimise experiments and to analyse large numbers of samples. Faster SMLM experiments would be generally useful and automated high throughput SMLM studies of arrays of samples, such as cells, could be applied to drug discovery and other applications. However, the time required to process the resulting data would be prohibitive on a normal computer. To address this, we have developed a method to run standard SMLM data analysis software tools in parallel on a high‐performance computing cluster (HPC). This can be used to accelerate the analysis of individual SMLM experiments or it can be scaled to analyse high throughput SMLM data by extending it to run on an arbitrary number of HPC processors in parallel. In this paper we outline the design of our parallelised SMLM software for HPC and quantify the speed advantage when implementing it on four HPC nodes compared to a powerful desktop computer. John Wiley and Sons Inc. 2018-12-03 2019-02 /pmc/articles/PMC6378585/ /pubmed/30508256 http://dx.doi.org/10.1111/jmi.12772 Text en © 2018 The Authors. Journal of Microscopy published by JohnWiley & Sons Ltd on behalf of Royal Microscopical Society. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Hot Topic—fast‐tracked short communication
MUNRO, I.
GARCÍA, E.
YAN, M.
GULDBRAND, S.
KUMAR, S.
KWAKWA, K.
DUNSBY, C.
NEIL, M.A.A.
FRENCH, P.M.W.
Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
title Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
title_full Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
title_fullStr Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
title_full_unstemmed Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
title_short Accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
title_sort accelerating single molecule localization microscopy through parallel processing on a high‐performance computing cluster
topic Hot Topic—fast‐tracked short communication
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6378585/
https://www.ncbi.nlm.nih.gov/pubmed/30508256
http://dx.doi.org/10.1111/jmi.12772
work_keys_str_mv AT munroi acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT garciae acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT yanm acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT guldbrands acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT kumars acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT kwakwak acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT dunsbyc acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT neilmaa acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster
AT frenchpmw acceleratingsinglemoleculelocalizationmicroscopythroughparallelprocessingonahighperformancecomputingcluster