Cargando…
Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013)
BACKGROUND: Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent. OBJECTIVES: We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast ima...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Kowsar
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5106650/ https://www.ncbi.nlm.nih.gov/pubmed/27853492 http://dx.doi.org/10.5812/iranjradiol.28281 |
_version_ | 1782467091708772352 |
---|---|
author | Lee, Youn Joo Choi, So Young Kim, Kyu Sun Yang, Po Song |
author_facet | Lee, Youn Joo Choi, So Young Kim, Kyu Sun Yang, Po Song |
author_sort | Lee, Youn Joo |
collection | PubMed |
description | BACKGROUND: Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent. OBJECTIVES: We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast imaging reporting and data system (BI-RADS)-US lexicon, and then attempted to identify whether inter-observer variability could be improved after one education session. PATIENTS AND METHODS: In total, 50 malignant lesions and 70 benign lesions were considered in our retrospective study. Two faculty members, two senior residents, and two junior residents separately assessed the US images. After the first assessment, the readers received one education session, and then reassessed the images in a random order. Inter-observer variability was measured using the kappa coefficient (κ). Performance discrepancy was evaluated by receiver operating characteristic (ROC) curves. RESULTS: For the faculty members, fair-to-good agreement was obtained in all descriptors and final assessment, while for residents, poor-to-moderate agreement was obtained. The areas under the ROC curves were 0.78 for the faculty members, 0.59 for the senior residents, and 0.52 for the junior residents, respectively. Diagnostic performance was significantly higher in the faculty members than the senior and junior residents (P = 0.0001 and < 0.0001, respectively). After one education session, the agreement in the final assessment was one level higher in the faculty members and senior residents, yet in the senior residents, the degree of agreement was still only fair. Moreover, in the junior residents, there was no improvement. CONCLUSION: Investigative assessment of breast US by residents is inadvisable. We recommend continued professional resident training to improve the degree of agreement and performance. |
format | Online Article Text |
id | pubmed-5106650 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Kowsar |
record_format | MEDLINE/PubMed |
spelling | pubmed-51066502016-11-16 Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) Lee, Youn Joo Choi, So Young Kim, Kyu Sun Yang, Po Song Iran J Radiol Women's Imaging BACKGROUND: Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent. OBJECTIVES: We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast imaging reporting and data system (BI-RADS)-US lexicon, and then attempted to identify whether inter-observer variability could be improved after one education session. PATIENTS AND METHODS: In total, 50 malignant lesions and 70 benign lesions were considered in our retrospective study. Two faculty members, two senior residents, and two junior residents separately assessed the US images. After the first assessment, the readers received one education session, and then reassessed the images in a random order. Inter-observer variability was measured using the kappa coefficient (κ). Performance discrepancy was evaluated by receiver operating characteristic (ROC) curves. RESULTS: For the faculty members, fair-to-good agreement was obtained in all descriptors and final assessment, while for residents, poor-to-moderate agreement was obtained. The areas under the ROC curves were 0.78 for the faculty members, 0.59 for the senior residents, and 0.52 for the junior residents, respectively. Diagnostic performance was significantly higher in the faculty members than the senior and junior residents (P = 0.0001 and < 0.0001, respectively). After one education session, the agreement in the final assessment was one level higher in the faculty members and senior residents, yet in the senior residents, the degree of agreement was still only fair. Moreover, in the junior residents, there was no improvement. CONCLUSION: Investigative assessment of breast US by residents is inadvisable. We recommend continued professional resident training to improve the degree of agreement and performance. Kowsar 2016-01-09 /pmc/articles/PMC5106650/ /pubmed/27853492 http://dx.doi.org/10.5812/iranjradiol.28281 Text en Copyright © 2016, Tehran University of Medical Sciences and Iranian Society of Radiology http://creativecommons.org/licenses/by-nc/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited. |
spellingShingle | Women's Imaging Lee, Youn Joo Choi, So Young Kim, Kyu Sun Yang, Po Song Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) |
title | Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) |
title_full | Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) |
title_fullStr | Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) |
title_full_unstemmed | Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) |
title_short | Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013) |
title_sort | variability in observer performance between faculty members and residents using breast imaging reporting and data system (bi-rads)-ultrasound, fifth edition (2013) |
topic | Women's Imaging |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5106650/ https://www.ncbi.nlm.nih.gov/pubmed/27853492 http://dx.doi.org/10.5812/iranjradiol.28281 |
work_keys_str_mv | AT leeyounjoo variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013 AT choisoyoung variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013 AT kimkyusun variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013 AT yangposong variabilityinobserverperformancebetweenfacultymembersandresidentsusingbreastimagingreportinganddatasystembiradsultrasoundfifthedition2013 |