Mixed Reality Improves 3D Visualization and Spatial Awareness of Bone Tumors for Surgical Planning in Orthopaedic Oncology: A Proof of Concept Study

INTRODUCTION: In orthopedic oncology, computer navigation and 3D-printed guides facilitate precise osteotomies only after surgical exposure. Before surgeries start, it is challenging to mentally process and superimpose the virtual medical images onto patients’ anatomy for preoperative surgical planning. Mixed Reality (MR) is an immersive technology merging real and virtual worlds, and users can interact with digital objects in real time. Through Head-Mounted Displays, surgeons directly visualize holographic models that overlaid on tumor patients. The technology may facilitate surgical planning before skin incisions. METHODS: Nine bone tumor patients were included (July 2021 – Dec 2022). There were six primary bone sarcomas, two benign bone tumors, and one revision pelvic prosthesis. MR applications were created using patients’ preoperative medical images. The surgeon examined each patient clinically using the conventional method of viewing 2D images and MR via HMD, Hololens 2. A Likert-Scale (LS) questionnaire and The National Aeronautics and Space Administration-Task Load Index (NASA-TLX) score were used to evaluate and compare the effectiveness of surgical planning and the surgeon’s clinical cognitive workload for the two methods. RESULTS: The qualitative survey of the LS questionnaire suggested that the MR group had superior spatial awareness of tumors and was considered more effective as a preoperative planning tool than the conventional group. For NASA-TLX scores, the overall cognitive workload was lower in MR 3D hologram group than in the 2D Group for preoperative clinical assessment. When using MR technology with HMDs, the surgeon reported no discomfort. CONCLUSION: MR technology may improve 3D visualization and spatial awareness of bone tumors in patients’ anatomies and may facilitate surgical planning before skin incisions in orthopedic oncology surgery. With less cognitive load and better ergonomics, surgeons can focus on patients and surgical tasks with MR technology. Further studies must investigate whether MR technology improves clinical outcomes.