Validation of an artificial intelligence-based method to automate Cobb angle measurement on spinal radiographs of children with adolescent idiopathic scoliosis

BACKGROUND: Accurately measuring the Cobb angle on radiographs is crucial for diagnosis and treatment decisions for adolescent idiopathic scoliosis (AIS). However, manual Cobb angle measurement is time-consuming and subject to measurement variation, especially for inexperienced clinicians. AIM: This study aimed to validate a novel artificial-intelligence-based (AI) algorithm that automatically measures the Cobb angle on radiographs. DESIGN: This is a retrospective cross-sectional study. SETTING: The population of patients attended the Stollery Children’s Hospital in Alberta, Canada. POPULATION: Children who: 1) were diagnosed with AIS, 2) were aged between 10 and 18 years old, 3) had no prior surgery, and 4) had a radiograph out of brace, were enrolled. METHODS: A total of 330 spinal radiographs were used. Among those, 130 were used for AI model development and 200 were used for measurement validation. Automatic Cobb angle measurements were validated by comparing them with manual ones measured by a rater with 20+ years of experience. Analysis was performed using the standard error of measurement (SEM), inter-method intraclass correlation coefficient (ICC(2,1)), and percentage of measurements within clinical acceptance (≤5°). Subgroup analysis was conducted by severity, region, and X-ray system to identify any systematic biases. RESULTS: The AI method detected 346 of 352 manually measured curves (mean±standard deviation: 24.7±9.5°), achieving 91% (316/346) of measurements within clinical acceptance. Excellent reliability was obtained with 0.92 ICC and 0.79° SEM. Comparable performance was found throughout all subgroups, and no systematic biases in performance affecting any subgroup were discovered. The algorithm measured each radiograph approximately 18s on average which is slightly faster than the estimated measurement time of an experienced rater. Radiographs taken by the EOS X-ray system were measured more quickly on average than those taken by a conventional digital X-ray system (10s vs. 26s). CONCLUSIONS: An AI-based algorithm was developed to measure the Cobb angle automatically on radiographs and yielded reliable measurements quickly. The algorithm provides detailed images on how the angles were measured, providing interpretability that can give clinicians confidence in the measurements. CLINICAL REHABILITATION IMPACT: Employing the algorithm in practice could streamline clinical workflow and optimize measurement accuracy and speed in order to inform AIS treatment decisions.