Reliability assessment and correlation analysis of evaluating orthodontic treatment outcome in Chinese patients

This study aimed to assess the reliability of experienced Chinese orthodontists in evaluating treatment outcome and to determine the correlations between three diagnostic information sources. Sixty-nine experienced Chinese orthodontic specialists each evaluated the outcome of orthodontic treatment of 108 Chinese patients. Three different information sources: study casts (SC), lateral cephalometric X-ray images (LX) and facial photographs (PH) were generated at the end of treatment for 108 patients selected randomly from six orthodontic treatment centers throughout China. Six different assessments of treatment outcome were made by each orthodontist using data from the three information sources separately and in combination. Each assessment included both ranking and grading for each patient. The rankings of each of the 69 judges for the 108 patients were correlated with the rankings of each of the other judges yielding 13 873 Spearman r(s) values, ranging from –0.08 to +0.85. Of these, 90% were greater than 0.4, showing moderate-to-high consistency among the 69 orthodontists. In the combined evaluations, study casts were the most significant predictive component (R(2)=0.86, P<0.000 1), while the inclusion of lateral cephalometric films and facial photographs also contributed to a more comprehensive assessment (R(2)=0.96, P<0.000 1). Grading scores for SC+LX and SC+PH were highly significantly correlated with those for SC+LX+PH (r((SC+LX)vs.(SC+LX+PH))=0.96, r((SC+PH)vs.(SC+LX+PH))=0.97), showing that either SC+LX or SC+PH is an excellent substitute for all three combined assessment.