Cargando…

Multi-Resolution 3D Rendering for High-Performance Web AR

In the context of web augmented reality (AR), 3D rendering that maintains visual quality and frame rate requirements remains a challenge. The lack of a dedicated and efficient 3D format often results in the degraded visual quality of the original data and compromises the user experience. This paper...

Descripción completa

Detalles Bibliográficos
Autores principales: Boutsi, Argyro-Maria, Ioannidis, Charalabos, Verykokou, Styliani
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422453/
https://www.ncbi.nlm.nih.gov/pubmed/37571668
http://dx.doi.org/10.3390/s23156885
_version_ 1785089213971038208
author Boutsi, Argyro-Maria
Ioannidis, Charalabos
Verykokou, Styliani
author_facet Boutsi, Argyro-Maria
Ioannidis, Charalabos
Verykokou, Styliani
author_sort Boutsi, Argyro-Maria
collection PubMed
description In the context of web augmented reality (AR), 3D rendering that maintains visual quality and frame rate requirements remains a challenge. The lack of a dedicated and efficient 3D format often results in the degraded visual quality of the original data and compromises the user experience. This paper examines the integration of web-streamable view-dependent representations of large-sized and high-resolution 3D models in web AR applications. The developed cross-platform prototype exploits the batched multi-resolution structures of the Nexus.js library as a dedicated lightweight web AR format and tests it against common formats and compression techniques. Built with AR.js and Three.js open-source libraries, it allows the overlay of the multi-resolution models by interactively adjusting the position, rotation and scale parameters. The proposed method includes real-time view-dependent rendering, geometric instancing and 3D pose regression for two types of AR: natural feature tracking (NFT) and location-based positioning for large and textured 3D overlays. The prototype achieves up to a 46% speedup in rendering time compared to optimized glTF models, while a 34 M vertices 3D model is visible in less than 4 s without degraded visual quality in slow 3D networks. The evaluation under various scenes and devices offers insights into how a multi-resolution scheme can be adopted in web AR for high-quality visualization and real-time performance.
format Online
Article
Text
id pubmed-10422453
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104224532023-08-13 Multi-Resolution 3D Rendering for High-Performance Web AR Boutsi, Argyro-Maria Ioannidis, Charalabos Verykokou, Styliani Sensors (Basel) Article In the context of web augmented reality (AR), 3D rendering that maintains visual quality and frame rate requirements remains a challenge. The lack of a dedicated and efficient 3D format often results in the degraded visual quality of the original data and compromises the user experience. This paper examines the integration of web-streamable view-dependent representations of large-sized and high-resolution 3D models in web AR applications. The developed cross-platform prototype exploits the batched multi-resolution structures of the Nexus.js library as a dedicated lightweight web AR format and tests it against common formats and compression techniques. Built with AR.js and Three.js open-source libraries, it allows the overlay of the multi-resolution models by interactively adjusting the position, rotation and scale parameters. The proposed method includes real-time view-dependent rendering, geometric instancing and 3D pose regression for two types of AR: natural feature tracking (NFT) and location-based positioning for large and textured 3D overlays. The prototype achieves up to a 46% speedup in rendering time compared to optimized glTF models, while a 34 M vertices 3D model is visible in less than 4 s without degraded visual quality in slow 3D networks. The evaluation under various scenes and devices offers insights into how a multi-resolution scheme can be adopted in web AR for high-quality visualization and real-time performance. MDPI 2023-08-03 /pmc/articles/PMC10422453/ /pubmed/37571668 http://dx.doi.org/10.3390/s23156885 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Boutsi, Argyro-Maria
Ioannidis, Charalabos
Verykokou, Styliani
Multi-Resolution 3D Rendering for High-Performance Web AR
title Multi-Resolution 3D Rendering for High-Performance Web AR
title_full Multi-Resolution 3D Rendering for High-Performance Web AR
title_fullStr Multi-Resolution 3D Rendering for High-Performance Web AR
title_full_unstemmed Multi-Resolution 3D Rendering for High-Performance Web AR
title_short Multi-Resolution 3D Rendering for High-Performance Web AR
title_sort multi-resolution 3d rendering for high-performance web ar
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422453/
https://www.ncbi.nlm.nih.gov/pubmed/37571668
http://dx.doi.org/10.3390/s23156885
work_keys_str_mv AT boutsiargyromaria multiresolution3drenderingforhighperformancewebar
AT ioannidischaralabos multiresolution3drenderingforhighperformancewebar
AT verykokoustyliani multiresolution3drenderingforhighperformancewebar