Accuracy of papillary thyroid cancer prognostic nomograms: a systematic review

OBJECTIVE: Current staging and risk-stratification systems for predicting survival or recurrence of patients with differentiated thyroid carcinoma may be ineffective at predicting outcomes in individual patients. In recent years, nomograms have been proposed as an alternative to conventional systems for predicting personalized clinical outcomes. We conducted a systematic review to evaluate the predictive performance of available nomograms for thyroid cancer patients. DESIGN AND METHODS: PROSPERO registration (CRD42022327028). A systematic search was conducted without time and language restrictions. PICOT questions: population, patients with papillary thyroid cancer; comparator prognostic factor, single-arm studies; outcomes, overall survival, disease-free survival, cancer-specific survival, recurrence, central lymph node metastases, or lateral lymph node metastases; timing, all periods; setting, hospital setting. Risk of bias was assessed through PROBAST tool. RESULTS: Eighteen studies with a total of 20 prognostic models were included in the systematic review (90,969 papillary thyroid carcinoma patients). Fourteen models were at high risk of bias and four were at unclear risk of bias. The greatest concerns arose in the analysis domain. The accuracy of nomograms for overall survival was assessed in only one study and appeared limited (0.77, 95% CI: 0.75–0.79). The accuracy of nomograms for disease-free survival ranged from 0.65 (95% CI: 0.55–0.75) to 0.92 (95% CI: 0.91–0.95). The C-index for predicting lateral lymph node metastasis ranged from 0.72 to 0.92 (95% CI: 0.86–0.97). For central lymph node metastasis, the C-index of externally validated studies ranged from 0.706 (95% CI: 0.685–0.727) to 0.923 (95% CI: 0.893–0.946). CONCLUSIONS: Our work highlights the extremely high heterogeneity among nomograms and the critical lack of external validation studies that limit the applicability of nomograms in clinical practice. Further studies ideally using commonly adopted risk factors as the backbone to develop nomograms are required. SIGNIFICANCE STATEMENT: Nomograms may be appropriate tools to plan treatments and predict personalized clinical outcomes in patients with papillary thyroid cancer. However, the nomograms developed to date are very heterogeneous, and their results seem to be closely related to the specific samples studied to generate the same nomograms. The lack of rigorous external validation procedures and the use of risk factors that sometimes appear to be far from those commonly used in clinical practice, as well as the great heterogeneity of the risk factors considered, limit the ability of nomograms to predict patient outcomes and thus their current introduction in clinical practice.