Analysis of Performance and Failure Modes of the IROC Proton Liver Phantom

PURPOSE: To analyze trends in institutional performance and failure modes for the Imaging and Radiation Oncology Core’s (IROC’s) proton liver phantom. MATERIALS AND METHODS: Results of 66 phantom irradiations from 28 institutions between 2015 and 2020 were retrospectively analyzed. Univariate analysis and random forest models were used to associate irradiation conditions with phantom results. Phantom results included pass/fail classification, average thermoluminescent dosimeter (TLD) ratio of both targets, and percentage of pixels passing gamma of both targets. The following categories were evaluated in terms of how they predicted these outcomes: irradiation year, treatment planning system (TPS), TPS algorithm, treatment machine, number of irradiations, treatment technique, motion management technique, number of isocenters, and superior-inferior extent (in cm) of the 90% TPS isodose line for primary target 1 (PTV1) and primary target 2 (PTV2). In addition, failures were categorized by failure mode. RESULTS: Average pass rate was approximately 52% and average TLD ratio for both targets had slightly improved. As the treatment field increased to cover the target, the pass rate statistically significantly fell. Lower pass rates were observed for Mevion machines, scattered irradiation techniques, and gating and internal target volume (ITV) motion management techniques. Overall, the accuracy of the random forest modeling of the phantom results was approximately 73% ± 14%. The most important predictor was the superior-inferior extent for both targets and irradiation year. Three failure modes dominated the failures of the phantom: (1) systematic underdosing, (2) poor localization in the superior-inferior direction, and (3) range error. Only 44% of failures have similar failure modes between the 2 targets. CONCLUSION: Improvement of the proton liver phantom has been observed; however, the pass rate remains the lowest among all IROC phantoms. Through various analysis techniques, range uncertainty, motion management, and underdosing are the main culprits of failures of the proton liver phantom. Clinically, careful consideration of the influences of liver proton therapy is needed to improve phantom performance and patient outcome.