Substantial clinical benefit values demonstrate a high degree of variability when stratified by time and geographic region

BACKGROUND: A Substantial Clinical Benefit (SCB) value is the amount of change in a patient-reported outcome measure required for a patient to feel they significantly improved from an intervention. Previously published SCB values are often cited by researchers when publishing outcomes data. Where these SCB values are set can have a large impact on the conclusions drawn from a study citing them. As such, the goal of this study was to determine the generalizability of SCB values for a procedure when stratified by time from surgery and geographic region. METHODS: A nationwide outcomes database was utilized to obtain preoperative, one-year, and two-year postoperative outcome measurements for patients who underwent anatomic total shoulder arthroplasty (TSA) or reverse TSA. The data were divided into three geographic regions: the South, the Midwest, and the West. An East region was not included due to its limited number of patients. SCB values were calculated for four outcomes measures: Single Assessment Numeric Evaluation score, American Shoulder Elbow Surgeons score, Visual Analog Scale, and Western Ontario Osteoarthritis of the Shoulder score. SCB values were calculated for each region, for each procedure, and at both one and two years postoperatively. To determine the variability of potential SCBs within each region, simulated datasets were created to determine a distribution of possible calculated SCBs. RESULTS: A total of 380 anatomic TSA patients and 543 reverse TSA patients were included for analysis. There was a high degree of variability of SCB values when stratified by procedure, time, and region. While some simulated datasets did produce homogenous SCB distributions among regions, some outcome measures demonstrated a large heterogeneity in distribution among regions, with concomitant large distributions of values within individual regions. CONCLUSIONS: There is notable heterogeneity of SCB values when stratified by region or time. The current method of citing previously published SCB values for determining the efficacy of an intervention may be inappropriate. It is likely that this variability holds true in other areas of orthopedics.