Multiple instance learning detects peripheral arterial disease from high-resolution color fundus photography

Peripheral arterial disease (PAD) is caused by atherosclerosis and is a common disease of the elderly leading to excess morbidity and mortality. Early PAD diagnosis is important, as the only available causal therapy is addressing risk factors like smoking, hypercholesterolemia or hypertension. However, current diagnostic techniques often do not detect early stages of PAD. We theorize that PAD’s underlying cause atherosclerosis can be detected on color fundus photography (CFP) images with a convolutional neural network architecture, which might aid earlier PAD diagnosis and improve disease monitoring. In this explorative study a deep attention-based Multiple Instance Learning (MIL) architecture is used to capture retinal imaging biomarkers on CFP images of 135 examinations. To capture subtle variations in vascular structures, higher image resolution can be utilized by partitioning the CFP into patches. Our architecture converts each patch into a feature vector, and determines its relative importance via an automatically computed attention weight. Our best model achieves an ROC AUC score of 0.890. Visualizing these attention weights provides insights about the network’s decision and suggests ocular involvement in PAD. Statistical analysis confirms that the optic disc and the temporal arcades are weighted significantly higher (p < 0.001) than retinal background. Our results support the feasibility of detecting the presence of PAD with a modern deep learning approach.