Scorecards: Quantifying Dosimetric Plan Quality in Pancreatic Ductal Adenocarcinoma Stereotactic Body Radiation Therapy

PURPOSE: A scoring mechanism called the scorecard that objectively quantifies the dosimetric plan quality of pancreas stereotactic body radiation therapy treatment plans is introduced. METHODS AND MATERIALS: A retrospective analysis of patients with pancreatic ductal adenocarcinoma receiving stereotactic body radiation therapy at our institution between November 2019 and November 2020 was performed. Ten patients were identified. All patients were treated to 36 Gy in 5 fractions, and organs at risk (OARs) were constrained based on Alliance A021501. The scorecard awarded points for OAR doses lower than those cited in Alliance A021501. A team of 3 treatment planners and 2 radiation oncologists, including a physician resident without plan optimization experience, discussed the relative importance of the goals of the treatment plan and added additional metrics for OARs and plan quality indexes to create a more rigorous scoring mechanism. The scorecard for this study consisted of 42 metrics, each with a unique piecewise linear scoring function which is summed to calculate the total score (maximum possible score of 365). The scorecard-guided plan, the planning and optimization for which were done exclusively by the physician resident with no prior plan optimization experience, was compared with the clinical plan, the planning and optimization for which were done by expert dosimetrists, using the Sign test. RESULTS: Scorecard-guided plans had, on average, higher total scores than those clinically delivered for each patient, averaging 280.1 for plans clinically delivered and 311.7 for plans made using the scorecard (P = .003). Additionally, for most metrics, the average score of each metric across all 10 patients was higher for scorecard-guided plans than for clinically delivered plans. The scorecard guided the planner toward higher coverage, conformality, and OAR sparing. CONCLUSIONS: A scorecard tool can help clarify the goals of a treatment plan and provide an objective method for comparing the results of different plans. Our study suggests that a completely novice treatment planner can use a scorecard to create treatment plans with enhanced coverage, conformality, and improved OAR sparing, which may have significant effects on both tumor control and toxicity. These tools, including the scorecard used in this study, have been made freely available.