Cargando…

Single-shot self-supervised object detection in microscopy

Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the a...

Descripción completa

Detalles Bibliográficos
Autores principales: Midtvedt, Benjamin, Pineda, Jesús, Skärberg, Fredrik, Olsén, Erik, Bachimanchi, Harshith, Wesén, Emelie, Esbjörner, Elin K., Selander, Erik, Höök, Fredrik, Midtvedt, Daniel, Volpe, Giovanni
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9722899/
https://www.ncbi.nlm.nih.gov/pubmed/36470883
http://dx.doi.org/10.1038/s41467-022-35004-y
_version_ 1784844058101809152
author Midtvedt, Benjamin
Pineda, Jesús
Skärberg, Fredrik
Olsén, Erik
Bachimanchi, Harshith
Wesén, Emelie
Esbjörner, Elin K.
Selander, Erik
Höök, Fredrik
Midtvedt, Daniel
Volpe, Giovanni
author_facet Midtvedt, Benjamin
Pineda, Jesús
Skärberg, Fredrik
Olsén, Erik
Bachimanchi, Harshith
Wesén, Emelie
Esbjörner, Elin K.
Selander, Erik
Höök, Fredrik
Midtvedt, Daniel
Volpe, Giovanni
author_sort Midtvedt, Benjamin
collection PubMed
description Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, experimental data are often challenging to label and cannot be easily reproduced numerically. Here, we propose a deep-learning method, named LodeSTAR (Localization and detection from Symmetries, Translations And Rotations), that learns to detect microscopic objects with sub-pixel accuracy from a single unlabeled experimental image by exploiting the inherent roto-translational symmetries of this task. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy, also when analyzing challenging experimental data containing densely packed cells or noisy backgrounds. Furthermore, by exploiting additional symmetries we show that LodeSTAR can measure other properties, e.g., vertical position and polarizability in holographic microscopy.
format Online
Article
Text
id pubmed-9722899
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-97228992022-12-07 Single-shot self-supervised object detection in microscopy Midtvedt, Benjamin Pineda, Jesús Skärberg, Fredrik Olsén, Erik Bachimanchi, Harshith Wesén, Emelie Esbjörner, Elin K. Selander, Erik Höök, Fredrik Midtvedt, Daniel Volpe, Giovanni Nat Commun Article Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, experimental data are often challenging to label and cannot be easily reproduced numerically. Here, we propose a deep-learning method, named LodeSTAR (Localization and detection from Symmetries, Translations And Rotations), that learns to detect microscopic objects with sub-pixel accuracy from a single unlabeled experimental image by exploiting the inherent roto-translational symmetries of this task. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy, also when analyzing challenging experimental data containing densely packed cells or noisy backgrounds. Furthermore, by exploiting additional symmetries we show that LodeSTAR can measure other properties, e.g., vertical position and polarizability in holographic microscopy. Nature Publishing Group UK 2022-12-05 /pmc/articles/PMC9722899/ /pubmed/36470883 http://dx.doi.org/10.1038/s41467-022-35004-y Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Midtvedt, Benjamin
Pineda, Jesús
Skärberg, Fredrik
Olsén, Erik
Bachimanchi, Harshith
Wesén, Emelie
Esbjörner, Elin K.
Selander, Erik
Höök, Fredrik
Midtvedt, Daniel
Volpe, Giovanni
Single-shot self-supervised object detection in microscopy
title Single-shot self-supervised object detection in microscopy
title_full Single-shot self-supervised object detection in microscopy
title_fullStr Single-shot self-supervised object detection in microscopy
title_full_unstemmed Single-shot self-supervised object detection in microscopy
title_short Single-shot self-supervised object detection in microscopy
title_sort single-shot self-supervised object detection in microscopy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9722899/
https://www.ncbi.nlm.nih.gov/pubmed/36470883
http://dx.doi.org/10.1038/s41467-022-35004-y
work_keys_str_mv AT midtvedtbenjamin singleshotselfsupervisedobjectdetectioninmicroscopy
AT pinedajesus singleshotselfsupervisedobjectdetectioninmicroscopy
AT skarbergfredrik singleshotselfsupervisedobjectdetectioninmicroscopy
AT olsenerik singleshotselfsupervisedobjectdetectioninmicroscopy
AT bachimanchiharshith singleshotselfsupervisedobjectdetectioninmicroscopy
AT wesenemelie singleshotselfsupervisedobjectdetectioninmicroscopy
AT esbjornerelink singleshotselfsupervisedobjectdetectioninmicroscopy
AT selandererik singleshotselfsupervisedobjectdetectioninmicroscopy
AT hookfredrik singleshotselfsupervisedobjectdetectioninmicroscopy
AT midtvedtdaniel singleshotselfsupervisedobjectdetectioninmicroscopy
AT volpegiovanni singleshotselfsupervisedobjectdetectioninmicroscopy