Cargando…

Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display

Medical ultrasound (US) is a commonly used modality for image-guided procedures. Recent research systems providing an in situ visualization of 2D US images via an augmented reality (AR) head-mounted display (HMD) were shown to be advantageous over conventional imaging through reduced task completion...

Descripción completa

Detalles Bibliográficos
Autores principales: von Haxthausen, Felix, Rüger, Christoph, Sieren, Malte Maria, Kloeckner, Roman, Ernst, Floris
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9961663/
https://www.ncbi.nlm.nih.gov/pubmed/36850766
http://dx.doi.org/10.3390/s23042168
_version_ 1784895810487451648
author von Haxthausen, Felix
Rüger, Christoph
Sieren, Malte Maria
Kloeckner, Roman
Ernst, Floris
author_facet von Haxthausen, Felix
Rüger, Christoph
Sieren, Malte Maria
Kloeckner, Roman
Ernst, Floris
author_sort von Haxthausen, Felix
collection PubMed
description Medical ultrasound (US) is a commonly used modality for image-guided procedures. Recent research systems providing an in situ visualization of 2D US images via an augmented reality (AR) head-mounted display (HMD) were shown to be advantageous over conventional imaging through reduced task completion times and improved accuracy. In this work, we continue in the direction of recent developments by describing the first AR HMD application visualizing real-time volumetric (3D) US in situ for guiding vascular punctures. We evaluated the application on a technical level as well as in a mixed-methods user study with a qualitative prestudy and a quantitative main study, simulating a vascular puncture. Participants completed the puncture task significantly faster when using 3D US AR mode compared to 2D US AR, with a decrease of 28.4% in time. However, no significant differences were observed regarding the success rate of vascular puncture (2D US AR—50% vs. 3D US AR—72%). On the technical side, the system offers a low latency of 49.90 ± 12.92 ms and a satisfactory frame rate of 60 Hz. Our work shows the feasibility of a system that visualizes real-time 3D US data via an AR HMD, and our experiments show, furthermore, that this may offer additional benefits in US-guided tasks (i.e., reduced task completion time) over 2D US images viewed in AR by offering a vividly volumetric visualization.
format Online
Article
Text
id pubmed-9961663
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99616632023-02-26 Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display von Haxthausen, Felix Rüger, Christoph Sieren, Malte Maria Kloeckner, Roman Ernst, Floris Sensors (Basel) Article Medical ultrasound (US) is a commonly used modality for image-guided procedures. Recent research systems providing an in situ visualization of 2D US images via an augmented reality (AR) head-mounted display (HMD) were shown to be advantageous over conventional imaging through reduced task completion times and improved accuracy. In this work, we continue in the direction of recent developments by describing the first AR HMD application visualizing real-time volumetric (3D) US in situ for guiding vascular punctures. We evaluated the application on a technical level as well as in a mixed-methods user study with a qualitative prestudy and a quantitative main study, simulating a vascular puncture. Participants completed the puncture task significantly faster when using 3D US AR mode compared to 2D US AR, with a decrease of 28.4% in time. However, no significant differences were observed regarding the success rate of vascular puncture (2D US AR—50% vs. 3D US AR—72%). On the technical side, the system offers a low latency of 49.90 ± 12.92 ms and a satisfactory frame rate of 60 Hz. Our work shows the feasibility of a system that visualizes real-time 3D US data via an AR HMD, and our experiments show, furthermore, that this may offer additional benefits in US-guided tasks (i.e., reduced task completion time) over 2D US images viewed in AR by offering a vividly volumetric visualization. MDPI 2023-02-15 /pmc/articles/PMC9961663/ /pubmed/36850766 http://dx.doi.org/10.3390/s23042168 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
von Haxthausen, Felix
Rüger, Christoph
Sieren, Malte Maria
Kloeckner, Roman
Ernst, Floris
Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
title Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
title_full Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
title_fullStr Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
title_full_unstemmed Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
title_short Augmenting Image-Guided Procedures through In Situ Visualization of 3D Ultrasound via a Head-Mounted Display
title_sort augmenting image-guided procedures through in situ visualization of 3d ultrasound via a head-mounted display
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9961663/
https://www.ncbi.nlm.nih.gov/pubmed/36850766
http://dx.doi.org/10.3390/s23042168
work_keys_str_mv AT vonhaxthausenfelix augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay
AT rugerchristoph augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay
AT sierenmaltemaria augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay
AT kloecknerroman augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay
AT ernstfloris augmentingimageguidedproceduresthroughinsituvisualizationof3dultrasoundviaaheadmounteddisplay