Impact of observer experience on multi-detector computed tomography aortic valve morphology assessment and valve size selection for transcatheter aortic valve replacement

Transcatheter aortic valve replacement (TAVR) has become the standard treatment for aortic stenosis in older patients. It increasingly relies on accurate pre-procedural planning using multidetector computed tomography (MDCT). Since little is known about the required competence levels for MDCT analyses, we comprehensively assessed MDCT TAVR planning reproducibility and accuracy with regard to valve selection in various healthcare workers. 20 randomly selected MDCT of TAVR patients were analyzed using dedicated software by healthcare professionals with varying backgrounds and experience (two structural interventionalists, one imaging specialist, one cardiac surgeon, one general physician, and one medical student). Following the analysis, the most appropriate Edwards SAPIEN 3™ and Medtronic CoreValve valve size was selected. Intra- and inter-observer variability were assessed. The first structural interventionalist was considered as reference standard for inter-observer comparison. Excellent intra- and inter-observer variability was found for the entire group in regard to the MDCT measurements. The best intra-observer agreement and reproducibility were found for the structural interventionalist, while the medical student had the lowest reproducibility. The highest inter-observer agreement was between both structural interventionalists, followed by the imaging specialist. As to valve size selection, the structural interventionalist showed the highest intra-observer reproducibility, independent of the brand of valve used. Compared to the reference structural interventionalist, the second structural interventionalist showed the highest inter-observer agreement for valve size selection [ICC 0.984, 95% CI 0.969–0.991] followed by the cardiac surgeon [ICC 0.947, 95%CI 0.900–0.972]. The lowest inter-observer agreement was found for the medical student [ICC 0.507, 95%CI 0.067–0.739]. While current state-of-the-art MDCT analysis software provides excellent reproducibility for anatomical measurements, the highest levels of confidence in terms of valve size selection were achieved by the performing interventional physicians. This was most likely attributable to observer experience.