Significant difference between three observers in the assessment of intraepidermal nerve fiber density in skin biopsy

BACKGROUND: The determination of Intraepidermal Nerve Fiber Density (IENFD) in skin biopsy is a useful method for the evaluation of different types of peripheral neuropathies. To allow a reliable use of the method it is necessary to determine interobserver reliability. Previous studies dealing with this topic used limited suitable statistical methods. METHODS: In the present study three observers determined the IENFD and estimated the staining quality of the basement membrane for an adequate quantity of 120 skin biopsies (stained with indirect immunofluorescence technique) from 68 patients. More adequate statistical methods like intraclass correlation coefficient and Bland Altman Plot were chosen to estimate interobserver reliability. RESULTS: We found an unexpected significant difference in IENFD between the observers (p < 0.05) and so the results of this study are not in line with the high interobserver reliability reported before (intraclass correlation coefficient: 0.73). The Bland Altmann Plot showed a variance growing with rising mean. The difference in IENFD between the observers and the resulting low interobserver reliability is likely caused by different interpretations of the standard counting rules. There was no significant difference in IENFD between observers for biopsies with a well-defined basement membrane. Thus skin biopsies with an inexactly defined basement membrane should not be used diagnostically for the determination of IENFD. CONCLUSION: These results emphasise that standardisation of the method is extremely important and at least two observers should analyse skin biopsies with critical IENFD near the cut-off values.