Cargando…

Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations

MOTIVATION: Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper, we present Generative Adversarial Network Discriminator Learner (GAN-DL), a novel self-supervised learning paradigm...

Descripción completa

Detalles Bibliográficos
Autores principales: Mascolini, Alessio, Cardamone, Dario, Ponzio, Francesco, Di Cataldo, Santa, Ficarra, Elisa
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9308954/
https://www.ncbi.nlm.nih.gov/pubmed/35871688
http://dx.doi.org/10.1186/s12859-022-04845-1
_version_ 1784753053804527616
author Mascolini, Alessio
Cardamone, Dario
Ponzio, Francesco
Di Cataldo, Santa
Ficarra, Elisa
author_facet Mascolini, Alessio
Cardamone, Dario
Ponzio, Francesco
Di Cataldo, Santa
Ficarra, Elisa
author_sort Mascolini, Alessio
collection PubMed
description MOTIVATION: Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper, we present Generative Adversarial Network Discriminator Learner (GAN-DL), a novel self-supervised learning paradigm based on the StyleGAN2 architecture, which we employ for self-supervised image representation learning in the case of fluorescent biological images. RESULTS: We show that Wasserstein Generative Adversarial Networks enable high-throughput compound screening based on raw images. We demonstrate this by classifying active and inactive compounds tested for the inhibition of SARS-CoV-2 infection in two different cell models: the primary human renal cortical epithelial cells (HRCE) and the African green monkey kidney epithelial cells (VERO). In contrast to previous methods, our deep learning-based approach does not require any annotation, and can also be used to solve subtle tasks it was not specifically trained on, in a self-supervised manner. For example, it can effectively derive a dose-response curve for the tested treatments. AVAILABILITY AND IMPLEMENTATION: Our code and embeddings are available at https://gitlab.com/AlesioRFM/gan-dl StyleGAN2 is available at https://github.com/NVlabs/stylegan2.
format Online
Article
Text
id pubmed-9308954
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-93089542022-07-25 Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations Mascolini, Alessio Cardamone, Dario Ponzio, Francesco Di Cataldo, Santa Ficarra, Elisa BMC Bioinformatics Research MOTIVATION: Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper, we present Generative Adversarial Network Discriminator Learner (GAN-DL), a novel self-supervised learning paradigm based on the StyleGAN2 architecture, which we employ for self-supervised image representation learning in the case of fluorescent biological images. RESULTS: We show that Wasserstein Generative Adversarial Networks enable high-throughput compound screening based on raw images. We demonstrate this by classifying active and inactive compounds tested for the inhibition of SARS-CoV-2 infection in two different cell models: the primary human renal cortical epithelial cells (HRCE) and the African green monkey kidney epithelial cells (VERO). In contrast to previous methods, our deep learning-based approach does not require any annotation, and can also be used to solve subtle tasks it was not specifically trained on, in a self-supervised manner. For example, it can effectively derive a dose-response curve for the tested treatments. AVAILABILITY AND IMPLEMENTATION: Our code and embeddings are available at https://gitlab.com/AlesioRFM/gan-dl StyleGAN2 is available at https://github.com/NVlabs/stylegan2. BioMed Central 2022-07-24 /pmc/articles/PMC9308954/ /pubmed/35871688 http://dx.doi.org/10.1186/s12859-022-04845-1 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Mascolini, Alessio
Cardamone, Dario
Ponzio, Francesco
Di Cataldo, Santa
Ficarra, Elisa
Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
title Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
title_full Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
title_fullStr Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
title_full_unstemmed Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
title_short Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
title_sort exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9308954/
https://www.ncbi.nlm.nih.gov/pubmed/35871688
http://dx.doi.org/10.1186/s12859-022-04845-1
work_keys_str_mv AT mascolinialessio exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations
AT cardamonedario exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations
AT ponziofrancesco exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations
AT dicataldosanta exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations
AT ficarraelisa exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations