Cargando…

New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing

Three-dimensional imaging is at the core of medical imaging and is becoming a standard in biological research. As a result, there is an increasing need to visualize, analyze and interact with data in a natural three-dimensional context. By combining stereoscopy and motion tracking, commercial virtua...

Descripción completa

Detalles Bibliográficos
Autores principales: Guérinot, Corentin, Marcon, Valentin, Godard, Charlotte, Blanc, Thomas, Verdier, Hippolyte, Planchon, Guillaume, Raimondi, Francesca, Boddaert, Nathalie, Alonso, Mariana, Sailor, Kurt, Lledo, Pierre-Marie, Hajj, Bassam, El Beheiry, Mohamed, Masson, Jean-Baptiste
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9580868/
https://www.ncbi.nlm.nih.gov/pubmed/36303792
http://dx.doi.org/10.3389/fbinf.2021.777101
_version_ 1784812488777269248
author Guérinot, Corentin
Marcon, Valentin
Godard, Charlotte
Blanc, Thomas
Verdier, Hippolyte
Planchon, Guillaume
Raimondi, Francesca
Boddaert, Nathalie
Alonso, Mariana
Sailor, Kurt
Lledo, Pierre-Marie
Hajj, Bassam
El Beheiry, Mohamed
Masson, Jean-Baptiste
author_facet Guérinot, Corentin
Marcon, Valentin
Godard, Charlotte
Blanc, Thomas
Verdier, Hippolyte
Planchon, Guillaume
Raimondi, Francesca
Boddaert, Nathalie
Alonso, Mariana
Sailor, Kurt
Lledo, Pierre-Marie
Hajj, Bassam
El Beheiry, Mohamed
Masson, Jean-Baptiste
author_sort Guérinot, Corentin
collection PubMed
description Three-dimensional imaging is at the core of medical imaging and is becoming a standard in biological research. As a result, there is an increasing need to visualize, analyze and interact with data in a natural three-dimensional context. By combining stereoscopy and motion tracking, commercial virtual reality (VR) headsets provide a solution to this critical visualization challenge by allowing users to view volumetric image stacks in a highly intuitive fashion. While optimizing the visualization and interaction process in VR remains an active topic, one of the most pressing issue is how to utilize VR for annotation and analysis of data. Annotating data is often a required step for training machine learning algorithms. For example, enhancing the ability to annotate complex three-dimensional data in biological research as newly acquired data may come in limited quantities. Similarly, medical data annotation is often time-consuming and requires expert knowledge to identify structures of interest correctly. Moreover, simultaneous data analysis and visualization in VR is computationally demanding. Here, we introduce a new procedure to visualize, interact, annotate and analyze data by combining VR with cloud computing. VR is leveraged to provide natural interactions with volumetric representations of experimental imaging data. In parallel, cloud computing performs costly computations to accelerate the data annotation with minimal input required from the user. We demonstrate multiple proof-of-concept applications of our approach on volumetric fluorescent microscopy images of mouse neurons and tumor or organ annotations in medical images.
format Online
Article
Text
id pubmed-9580868
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-95808682022-10-26 New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing Guérinot, Corentin Marcon, Valentin Godard, Charlotte Blanc, Thomas Verdier, Hippolyte Planchon, Guillaume Raimondi, Francesca Boddaert, Nathalie Alonso, Mariana Sailor, Kurt Lledo, Pierre-Marie Hajj, Bassam El Beheiry, Mohamed Masson, Jean-Baptiste Front Bioinform Bioinformatics Three-dimensional imaging is at the core of medical imaging and is becoming a standard in biological research. As a result, there is an increasing need to visualize, analyze and interact with data in a natural three-dimensional context. By combining stereoscopy and motion tracking, commercial virtual reality (VR) headsets provide a solution to this critical visualization challenge by allowing users to view volumetric image stacks in a highly intuitive fashion. While optimizing the visualization and interaction process in VR remains an active topic, one of the most pressing issue is how to utilize VR for annotation and analysis of data. Annotating data is often a required step for training machine learning algorithms. For example, enhancing the ability to annotate complex three-dimensional data in biological research as newly acquired data may come in limited quantities. Similarly, medical data annotation is often time-consuming and requires expert knowledge to identify structures of interest correctly. Moreover, simultaneous data analysis and visualization in VR is computationally demanding. Here, we introduce a new procedure to visualize, interact, annotate and analyze data by combining VR with cloud computing. VR is leveraged to provide natural interactions with volumetric representations of experimental imaging data. In parallel, cloud computing performs costly computations to accelerate the data annotation with minimal input required from the user. We demonstrate multiple proof-of-concept applications of our approach on volumetric fluorescent microscopy images of mouse neurons and tumor or organ annotations in medical images. Frontiers Media S.A. 2022-01-31 /pmc/articles/PMC9580868/ /pubmed/36303792 http://dx.doi.org/10.3389/fbinf.2021.777101 Text en Copyright © 2022 Guérinot, Marcon, Godard, Blanc, Verdier, Planchon, Raimondi, Boddaert, Alonso, Sailor, Lledo, Hajj, El Beheiry and Masson. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Bioinformatics
Guérinot, Corentin
Marcon, Valentin
Godard, Charlotte
Blanc, Thomas
Verdier, Hippolyte
Planchon, Guillaume
Raimondi, Francesca
Boddaert, Nathalie
Alonso, Mariana
Sailor, Kurt
Lledo, Pierre-Marie
Hajj, Bassam
El Beheiry, Mohamed
Masson, Jean-Baptiste
New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing
title New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing
title_full New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing
title_fullStr New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing
title_full_unstemmed New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing
title_short New Approach to Accelerated Image Annotation by Leveraging Virtual Reality and Cloud Computing
title_sort new approach to accelerated image annotation by leveraging virtual reality and cloud computing
topic Bioinformatics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9580868/
https://www.ncbi.nlm.nih.gov/pubmed/36303792
http://dx.doi.org/10.3389/fbinf.2021.777101
work_keys_str_mv AT guerinotcorentin newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT marconvalentin newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT godardcharlotte newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT blancthomas newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT verdierhippolyte newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT planchonguillaume newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT raimondifrancesca newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT boddaertnathalie newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT alonsomariana newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT sailorkurt newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT lledopierremarie newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT hajjbassam newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT elbeheirymohamed newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing
AT massonjeanbaptiste newapproachtoacceleratedimageannotationbyleveragingvirtualrealityandcloudcomputing