Cargando…

Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning

Significance: Spatial frequency-domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single-snapshot optical prop...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Mason T., Durr, Nicholas J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Society of Photo-Optical Instrumentation Engineers 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7701163/
https://www.ncbi.nlm.nih.gov/pubmed/33251783
http://dx.doi.org/10.1117/1.JBO.25.11.112907
_version_ 1783616437557919744
author Chen, Mason T.
Durr, Nicholas J.
author_facet Chen, Mason T.
Durr, Nicholas J.
author_sort Chen, Mason T.
collection PubMed
description Significance: Spatial frequency-domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single-snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. Aim: We introduce OxyGAN, a data-driven, content-aware method to estimate tissue oxygenation directly from single structured-light images. Approach: OxyGAN is an end-to-end approach that uses supervised generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659- and 851-nm sinusoidal illumination. We benchmark OxyGAN by comparing it with SSOP and a two-step hybrid technique that uses a previously developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. Results: When tested on human feet, cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5%. When applied to sample types not included in the training set, such as human hands and pig colon, OxyGAN achieves a 93% accuracy, demonstrating robustness to various tissue types. On average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9% and 24.7%, respectively. Finally, we optimize OxyGAN inference so that oxygenation maps are computed [Formula: see text] times faster than previous work, enabling video-rate, 25-Hz imaging. Conclusions: Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications.
format Online
Article
Text
id pubmed-7701163
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Society of Photo-Optical Instrumentation Engineers
record_format MEDLINE/PubMed
spelling pubmed-77011632020-12-01 Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning Chen, Mason T. Durr, Nicholas J. J Biomed Opt Special Series on Artificial Intelligence and Machine Learning in Biomedical Optics Significance: Spatial frequency-domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single-snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. Aim: We introduce OxyGAN, a data-driven, content-aware method to estimate tissue oxygenation directly from single structured-light images. Approach: OxyGAN is an end-to-end approach that uses supervised generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659- and 851-nm sinusoidal illumination. We benchmark OxyGAN by comparing it with SSOP and a two-step hybrid technique that uses a previously developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. Results: When tested on human feet, cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5%. When applied to sample types not included in the training set, such as human hands and pig colon, OxyGAN achieves a 93% accuracy, demonstrating robustness to various tissue types. On average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9% and 24.7%, respectively. Finally, we optimize OxyGAN inference so that oxygenation maps are computed [Formula: see text] times faster than previous work, enabling video-rate, 25-Hz imaging. Conclusions: Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications. Society of Photo-Optical Instrumentation Engineers 2020-11-30 2020-11 /pmc/articles/PMC7701163/ /pubmed/33251783 http://dx.doi.org/10.1117/1.JBO.25.11.112907 Text en © 2020 The Authors https://creativecommons.org/licenses/by/4.0/ Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
spellingShingle Special Series on Artificial Intelligence and Machine Learning in Biomedical Optics
Chen, Mason T.
Durr, Nicholas J.
Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
title Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
title_full Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
title_fullStr Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
title_full_unstemmed Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
title_short Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
title_sort rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
topic Special Series on Artificial Intelligence and Machine Learning in Biomedical Optics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7701163/
https://www.ncbi.nlm.nih.gov/pubmed/33251783
http://dx.doi.org/10.1117/1.JBO.25.11.112907
work_keys_str_mv AT chenmasont rapidtissueoxygenationmappingfromsnapshotstructuredlightimageswithadversarialdeeplearning
AT durrnicholasj rapidtissueoxygenationmappingfromsnapshotstructuredlightimageswithadversarialdeeplearning