Accuracy and efficiency of an artificial intelligence-based pulmonary broncho-vascular three-dimensional reconstruction system supporting thoracic surgery: Retrospective and prospective validation study

BACKGROUND: Anthropomorphic phantoms are used in surgical planning and intervention. Ideal accuracy and high efficiency are prerequisites for its clinical application. We aimed to develop a fully automated artificial intelligence-based three-dimensional (3D) reconstruction system (AI system) to assist thoracic surgery and to determine its accuracy, efficiency, and safety for clinical use. METHODS: This AI system was developed based on a 3D convolutional neural network (CNN) and optimized by gradient descent after training with 500 cases, achieving a Dice coefficient of 89.2%. Accuracy was verified by comparing virtual structures predicted by the AI system with anatomical structures of patients in retrospective (n = 113) and prospective cohorts (n = 139) who underwent lobectomy or segmentectomy at the Peking University Cancer Hospital. Operation time and blood loss were compared between the retrospective cohort (without AI assistance) and prospective cohort (with AI assistance) for safety evaluation. The time consumption for reconstruction and the quality score were compared between the AI system and manual reconstruction software (Mimics®) for efficiency validation. This study was registered at https://www.chictr.org.cn as ChiCTR2100050985. FINDINGS: The AI system reconstructed 13,608 pulmonary segmental branches from retrospective and prospective cohorts, and 1573 branches of interest corresponding to phantoms were detectable during the operation for verification, achieving 100% and 97% accuracy for segmental bronchi, 97.2% and 99.1% for segmental arteries, and 93.2% and 98.8% for segmental veins, respectively. With the assistance of the AI system, the operation time was shortened by 24.5 min for lobectomy (p < 0.001) and 20 min for segmentectomy (p = 0.007). Compared to Mimics®, the AI system reduced the model reconstruction time by 14.2 min (p < 0.001), and it also outperformed Mimics® in model quality scores (p < 0.001). INTERPRETATION: The AI system can accurately predict thoracic anatomical structures with higher efficiency than manual reconstruction software. Constant optimization and larger population validation are required. FUNDING: This study was funded by the 10.13039/501100004826Beijing Natural Science Foundation (No. L222020) and other sources.