Cargando…

Real-time mixed reality display of dual particle radiation detector data

Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualiza...

Descripción completa

Detalles Bibliográficos
Autores principales: Pakari, Oskari, Lopez, Ricardo, Druckman, Ivan, Meng, Emilee, Zhou, Erik, Wang, Ziang, Clarke, Shaun D., Pozzi, Sara A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9825402/
https://www.ncbi.nlm.nih.gov/pubmed/36611055
http://dx.doi.org/10.1038/s41598-023-27632-1
_version_ 1784866622967644160
author Pakari, Oskari
Lopez, Ricardo
Druckman, Ivan
Meng, Emilee
Zhou, Erik
Wang, Ziang
Clarke, Shaun D.
Pozzi, Sara A.
author_facet Pakari, Oskari
Lopez, Ricardo
Druckman, Ivan
Meng, Emilee
Zhou, Erik
Wang, Ziang
Clarke, Shaun D.
Pozzi, Sara A.
author_sort Pakari, Oskari
collection PubMed
description Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections.
format Online
Article
Text
id pubmed-9825402
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-98254022023-01-09 Real-time mixed reality display of dual particle radiation detector data Pakari, Oskari Lopez, Ricardo Druckman, Ivan Meng, Emilee Zhou, Erik Wang, Ziang Clarke, Shaun D. Pozzi, Sara A. Sci Rep Article Radiation source localization and characterization are challenging tasks that currently require complex analyses for interpretation. Mixed reality (MR) technologies are at the verge of wide scale adoption and can assist in the visualization of complex data. Herein, we demonstrate real-time visualization of gamma ray and neutron radiation detector data in MR using the Microsoft HoloLens 2 smart glasses, significantly reducing user interpretation burden. Radiation imaging systems typically use double-scatter events of gamma rays or fast neutrons to reconstruct the incidence directional information, thus enabling source localization. The calculated images and estimated ’hot spots’ are then often displayed in 2D angular space projections on screens. By combining a state-of-the-art dual particle imaging system with HoloLens 2, we propose to display the data directly to the user via the head-mounted MR smart glasses, presenting the directional information as an overlay to the user’s 3D visual experience. We describe an open source implementation using efficient data transfer, image calculation, and 3D engine. We thereby demonstrate for the first time a real-time user experience to display fast neutron or gamma ray images from various radioactive sources set around the detector. We also introduce an alternative source search mode for situations of low event rates using a neural network and simulation based training data to provide a fast estimation of the source’s angular direction. Using MR for radiation detection provides a more intuitive perception of radioactivity and can be applied in routine radiation monitoring, education & training, emergency scenarios, or inspections. Nature Publishing Group UK 2023-01-07 /pmc/articles/PMC9825402/ /pubmed/36611055 http://dx.doi.org/10.1038/s41598-023-27632-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Pakari, Oskari
Lopez, Ricardo
Druckman, Ivan
Meng, Emilee
Zhou, Erik
Wang, Ziang
Clarke, Shaun D.
Pozzi, Sara A.
Real-time mixed reality display of dual particle radiation detector data
title Real-time mixed reality display of dual particle radiation detector data
title_full Real-time mixed reality display of dual particle radiation detector data
title_fullStr Real-time mixed reality display of dual particle radiation detector data
title_full_unstemmed Real-time mixed reality display of dual particle radiation detector data
title_short Real-time mixed reality display of dual particle radiation detector data
title_sort real-time mixed reality display of dual particle radiation detector data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9825402/
https://www.ncbi.nlm.nih.gov/pubmed/36611055
http://dx.doi.org/10.1038/s41598-023-27632-1
work_keys_str_mv AT pakarioskari realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT lopezricardo realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT druckmanivan realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT mengemilee realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT zhouerik realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT wangziang realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT clarkeshaund realtimemixedrealitydisplayofdualparticleradiationdetectordata
AT pozzisaraa realtimemixedrealitydisplayofdualparticleradiationdetectordata