Cargando…
Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations
MOTIVATION: Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper, we present Generative Adversarial Network Discriminator Learner (GAN-DL), a novel self-supervised learning paradigm...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9308954/ https://www.ncbi.nlm.nih.gov/pubmed/35871688 http://dx.doi.org/10.1186/s12859-022-04845-1 |
_version_ | 1784753053804527616 |
---|---|
author | Mascolini, Alessio Cardamone, Dario Ponzio, Francesco Di Cataldo, Santa Ficarra, Elisa |
author_facet | Mascolini, Alessio Cardamone, Dario Ponzio, Francesco Di Cataldo, Santa Ficarra, Elisa |
author_sort | Mascolini, Alessio |
collection | PubMed |
description | MOTIVATION: Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper, we present Generative Adversarial Network Discriminator Learner (GAN-DL), a novel self-supervised learning paradigm based on the StyleGAN2 architecture, which we employ for self-supervised image representation learning in the case of fluorescent biological images. RESULTS: We show that Wasserstein Generative Adversarial Networks enable high-throughput compound screening based on raw images. We demonstrate this by classifying active and inactive compounds tested for the inhibition of SARS-CoV-2 infection in two different cell models: the primary human renal cortical epithelial cells (HRCE) and the African green monkey kidney epithelial cells (VERO). In contrast to previous methods, our deep learning-based approach does not require any annotation, and can also be used to solve subtle tasks it was not specifically trained on, in a self-supervised manner. For example, it can effectively derive a dose-response curve for the tested treatments. AVAILABILITY AND IMPLEMENTATION: Our code and embeddings are available at https://gitlab.com/AlesioRFM/gan-dl StyleGAN2 is available at https://github.com/NVlabs/stylegan2. |
format | Online Article Text |
id | pubmed-9308954 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-93089542022-07-25 Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations Mascolini, Alessio Cardamone, Dario Ponzio, Francesco Di Cataldo, Santa Ficarra, Elisa BMC Bioinformatics Research MOTIVATION: Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper, we present Generative Adversarial Network Discriminator Learner (GAN-DL), a novel self-supervised learning paradigm based on the StyleGAN2 architecture, which we employ for self-supervised image representation learning in the case of fluorescent biological images. RESULTS: We show that Wasserstein Generative Adversarial Networks enable high-throughput compound screening based on raw images. We demonstrate this by classifying active and inactive compounds tested for the inhibition of SARS-CoV-2 infection in two different cell models: the primary human renal cortical epithelial cells (HRCE) and the African green monkey kidney epithelial cells (VERO). In contrast to previous methods, our deep learning-based approach does not require any annotation, and can also be used to solve subtle tasks it was not specifically trained on, in a self-supervised manner. For example, it can effectively derive a dose-response curve for the tested treatments. AVAILABILITY AND IMPLEMENTATION: Our code and embeddings are available at https://gitlab.com/AlesioRFM/gan-dl StyleGAN2 is available at https://github.com/NVlabs/stylegan2. BioMed Central 2022-07-24 /pmc/articles/PMC9308954/ /pubmed/35871688 http://dx.doi.org/10.1186/s12859-022-04845-1 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Mascolini, Alessio Cardamone, Dario Ponzio, Francesco Di Cataldo, Santa Ficarra, Elisa Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
title | Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
title_full | Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
title_fullStr | Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
title_full_unstemmed | Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
title_short | Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
title_sort | exploiting generative self-supervised learning for the assessment of biological images with lack of annotations |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9308954/ https://www.ncbi.nlm.nih.gov/pubmed/35871688 http://dx.doi.org/10.1186/s12859-022-04845-1 |
work_keys_str_mv | AT mascolinialessio exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations AT cardamonedario exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations AT ponziofrancesco exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations AT dicataldosanta exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations AT ficarraelisa exploitinggenerativeselfsupervisedlearningfortheassessmentofbiologicalimageswithlackofannotations |