Agreement on Grading Retinal Findings of Patients with Diabetes Using Fundus Photographs by Allied Medical Personnel when Compared to an Ophthalmologist at a Diabetic Retinopathy Screening Program in Nepal

INTRODUCTION: Diabetic retinopathy (DR) is the emerging cause of blindness in developing countries. This study aimed to assess the accuracy of grading retinal findings of patients with diabetes using fundus photographs by allied medical personnel (AMP) when compared to an ophthalmologist. MATERIALS AND METHODS: Six AMPs were enrolled for grading fundus photographs of patients with diabetes after three and six months of training twice at two weeks interval. The total number of fundus photographs graded were 1,344. Grading by a retina specialist was used as the gold standard. Intra-rater and inter-rater agreement was assessed using the kappa coefficient (k). RESULTS: The intra-rater agreement of half of the AMPs in both three months and six months was almost perfect for grading of any retinal abnormalities, and substantial for retinal hemorrhages. In three months, the overall inter-rater agreement at the second rating was moderate for any retinal abnormalities (k=0.60) and retinal hemorrhage (k=0.48) and was fair for macular exudates (k=0.35). The overall inter-rater agreement of AMPs in six months at the second rating was substantial for any retinal abnormalities (k=0.61), fair for retinal hemorrhage (k=0.30), and moderate for macular exudates (k=0.49). The overall inter-rater agreement at first rating was almost similar to the second rating in both three months and six months. CONCLUSION: Intra-rater agreement of AMPs was almost perfect for any retinal abnormalities and substantial for retinal hemorrhage. The inter-rater agreement of AMP was substantial for any retinal abnormalities and moderate for retinal hemorrhages and macular exudates. The agreement results were almost similar at three months and six months. AMPs could be utilized in screening of DR and other retinal pathologies for timely referral to reduce the blindness in low-resource settings.