Cargando…
Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning
Significance: Spatial frequency-domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single-snapshot optical prop...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Society of Photo-Optical Instrumentation Engineers
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7701163/ https://www.ncbi.nlm.nih.gov/pubmed/33251783 http://dx.doi.org/10.1117/1.JBO.25.11.112907 |
_version_ | 1783616437557919744 |
---|---|
author | Chen, Mason T. Durr, Nicholas J. |
author_facet | Chen, Mason T. Durr, Nicholas J. |
author_sort | Chen, Mason T. |
collection | PubMed |
description | Significance: Spatial frequency-domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single-snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. Aim: We introduce OxyGAN, a data-driven, content-aware method to estimate tissue oxygenation directly from single structured-light images. Approach: OxyGAN is an end-to-end approach that uses supervised generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659- and 851-nm sinusoidal illumination. We benchmark OxyGAN by comparing it with SSOP and a two-step hybrid technique that uses a previously developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. Results: When tested on human feet, cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5%. When applied to sample types not included in the training set, such as human hands and pig colon, OxyGAN achieves a 93% accuracy, demonstrating robustness to various tissue types. On average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9% and 24.7%, respectively. Finally, we optimize OxyGAN inference so that oxygenation maps are computed [Formula: see text] times faster than previous work, enabling video-rate, 25-Hz imaging. Conclusions: Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications. |
format | Online Article Text |
id | pubmed-7701163 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Society of Photo-Optical Instrumentation Engineers |
record_format | MEDLINE/PubMed |
spelling | pubmed-77011632020-12-01 Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning Chen, Mason T. Durr, Nicholas J. J Biomed Opt Special Series on Artificial Intelligence and Machine Learning in Biomedical Optics Significance: Spatial frequency-domain imaging (SFDI) is a powerful technique for mapping tissue oxygen saturation over a wide field of view. However, current SFDI methods either require a sequence of several images with different illumination patterns or, in the case of single-snapshot optical properties (SSOP), introduce artifacts and sacrifice accuracy. Aim: We introduce OxyGAN, a data-driven, content-aware method to estimate tissue oxygenation directly from single structured-light images. Approach: OxyGAN is an end-to-end approach that uses supervised generative adversarial networks. Conventional SFDI is used to obtain ground truth tissue oxygenation maps for ex vivo human esophagi, in vivo hands and feet, and an in vivo pig colon sample under 659- and 851-nm sinusoidal illumination. We benchmark OxyGAN by comparing it with SSOP and a two-step hybrid technique that uses a previously developed deep learning model to predict optical properties followed by a physical model to calculate tissue oxygenation. Results: When tested on human feet, cross-validated OxyGAN maps tissue oxygenation with an accuracy of 96.5%. When applied to sample types not included in the training set, such as human hands and pig colon, OxyGAN achieves a 93% accuracy, demonstrating robustness to various tissue types. On average, OxyGAN outperforms SSOP and a hybrid model in estimating tissue oxygenation by 24.9% and 24.7%, respectively. Finally, we optimize OxyGAN inference so that oxygenation maps are computed [Formula: see text] times faster than previous work, enabling video-rate, 25-Hz imaging. Conclusions: Due to its rapid acquisition and processing speed, OxyGAN has the potential to enable real-time, high-fidelity tissue oxygenation mapping that may be useful for many clinical applications. Society of Photo-Optical Instrumentation Engineers 2020-11-30 2020-11 /pmc/articles/PMC7701163/ /pubmed/33251783 http://dx.doi.org/10.1117/1.JBO.25.11.112907 Text en © 2020 The Authors https://creativecommons.org/licenses/by/4.0/ Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI. |
spellingShingle | Special Series on Artificial Intelligence and Machine Learning in Biomedical Optics Chen, Mason T. Durr, Nicholas J. Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
title | Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
title_full | Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
title_fullStr | Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
title_full_unstemmed | Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
title_short | Rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
title_sort | rapid tissue oxygenation mapping from snapshot structured-light images with adversarial deep learning |
topic | Special Series on Artificial Intelligence and Machine Learning in Biomedical Optics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7701163/ https://www.ncbi.nlm.nih.gov/pubmed/33251783 http://dx.doi.org/10.1117/1.JBO.25.11.112907 |
work_keys_str_mv | AT chenmasont rapidtissueoxygenationmappingfromsnapshotstructuredlightimageswithadversarialdeeplearning AT durrnicholasj rapidtissueoxygenationmappingfromsnapshotstructuredlightimageswithadversarialdeeplearning |