Cargando…

Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)

BACKGROUND: Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent. OBJECTIVES: We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast ima...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Youn Joo, Choi, So Young, Kim, Kyu Sun, Yang, Po Song
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Kowsar 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5106650/
https://www.ncbi.nlm.nih.gov/pubmed/27853492
http://dx.doi.org/10.5812/iranjradiol.28281
_version_ 1782467091708772352
author Lee, Youn Joo
Choi, So Young
Kim, Kyu Sun
Yang, Po Song
author_facet Lee, Youn Joo
Choi, So Young
Kim, Kyu Sun
Yang, Po Song
author_sort Lee, Youn Joo
collection PubMed
description BACKGROUND: Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent. OBJECTIVES: We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast imaging reporting and data system (BI-RADS)-US lexicon, and then attempted to identify whether inter-observer variability could be improved after one education session. PATIENTS AND METHODS: In total, 50 malignant lesions and 70 benign lesions were considered in our retrospective study. Two faculty members, two senior residents, and two junior residents separately assessed the US images. After the first assessment, the readers received one education session, and then reassessed the images in a random order. Inter-observer variability was measured using the kappa coefficient (κ). Performance discrepancy was evaluated by receiver operating characteristic (ROC) curves. RESULTS: For the faculty members, fair-to-good agreement was obtained in all descriptors and final assessment, while for residents, poor-to-moderate agreement was obtained. The areas under the ROC curves were 0.78 for the faculty members, 0.59 for the senior residents, and 0.52 for the junior residents, respectively. Diagnostic performance was significantly higher in the faculty members than the senior and junior residents (P = 0.0001 and < 0.0001, respectively). After one education session, the agreement in the final assessment was one level higher in the faculty members and senior residents, yet in the senior residents, the degree of agreement was still only fair. Moreover, in the junior residents, there was no improvement. CONCLUSION: Investigative assessment of breast US by residents is inadvisable. We recommend continued professional resident training to improve the degree of agreement and performance.
format Online
Article
Text
id pubmed-5106650
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Kowsar
record_format MEDLINE/PubMed
spelling pubmed-51066502016-11-16 Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) Lee, Youn Joo Choi, So Young Kim, Kyu Sun Yang, Po Song Iran J Radiol Women's Imaging BACKGROUND: Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent. OBJECTIVES: We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast imaging reporting and data system (BI-RADS)-US lexicon, and then attempted to identify whether inter-observer variability could be improved after one education session. PATIENTS AND METHODS: In total, 50 malignant lesions and 70 benign lesions were considered in our retrospective study. Two faculty members, two senior residents, and two junior residents separately assessed the US images. After the first assessment, the readers received one education session, and then reassessed the images in a random order. Inter-observer variability was measured using the kappa coefficient (κ). Performance discrepancy was evaluated by receiver operating characteristic (ROC) curves. RESULTS: For the faculty members, fair-to-good agreement was obtained in all descriptors and final assessment, while for residents, poor-to-moderate agreement was obtained. The areas under the ROC curves were 0.78 for the faculty members, 0.59 for the senior residents, and 0.52 for the junior residents, respectively. Diagnostic performance was significantly higher in the faculty members than the senior and junior residents (P = 0.0001 and < 0.0001, respectively). After one education session, the agreement in the final assessment was one level higher in the faculty members and senior residents, yet in the senior residents, the degree of agreement was still only fair. Moreover, in the junior residents, there was no improvement. CONCLUSION: Investigative assessment of breast US by residents is inadvisable. We recommend continued professional resident training to improve the degree of agreement and performance. Kowsar 2016-01-09 /pmc/articles/PMC5106650/ /pubmed/27853492 http://dx.doi.org/10.5812/iranjradiol.28281 Text en Copyright © 2016, Tehran University of Medical Sciences and Iranian Society of Radiology http://creativecommons.org/licenses/by-nc/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.
spellingShingle Women's Imaging
Lee, Youn Joo
Choi, So Young
Kim, Kyu Sun
Yang, Po Song
Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
title Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
title_full Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
title_fullStr Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
title_full_unstemmed Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
title_short Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
title_sort variability in observer performance between faculty members and residents using breast imaging reporting and data system (bi-rads)-ultrasound, fifth edition (2013)
topic Women's Imaging
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5106650/
https://www.ncbi.nlm.nih.gov/pubmed/27853492
http://dx.doi.org/10.5812/iranjradiol.28281
work_keys_str_mv AT leeyounjoo variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013
AT choisoyoung variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013
AT kimkyusun variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013
AT yangposong variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013