Cargando…
Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies
The vigilance decrement describes a decrease in sensitivity or increase in specificity with time on task. It has been observed in a variety of repetitive visual tasks, but little is known about these patterns in radiologists. We investigated whether there is systematic variation in performance over...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer US
2014
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4305061/ https://www.ncbi.nlm.nih.gov/pubmed/25005866 http://dx.doi.org/10.1007/s10278-014-9717-9 |
_version_ | 1782354177427505152 |
---|---|
author | Taylor-Phillips, Sian Elze, Markus C. Krupinski, Elizabeth A. Dennick, Kathryn Gale, Alastair G. Clarke, Aileen Mello-Thoms, Claudia |
author_facet | Taylor-Phillips, Sian Elze, Markus C. Krupinski, Elizabeth A. Dennick, Kathryn Gale, Alastair G. Clarke, Aileen Mello-Thoms, Claudia |
author_sort | Taylor-Phillips, Sian |
collection | PubMed |
description | The vigilance decrement describes a decrease in sensitivity or increase in specificity with time on task. It has been observed in a variety of repetitive visual tasks, but little is known about these patterns in radiologists. We investigated whether there is systematic variation in performance over the course of a radiology reading session. We re-analyzed data from six previous lesion-enriched radiology studies. Studies featured 8–22 participants assessing 27–100 cases (including mammograms, chest CT, chest x-ray, and bone x-ray) in a reading session. Changes in performance and speed as the reading session progressed were analyzed using mixed effects models. Time taken per case decreased 9–23 % as the reading session progressed (p < 0.005 for every study). There was a sensitivity decrease or specificity increase over the course of reading 100 chest x-rays (p = 0.005), 60 bone fracture x-rays (p = 0.03), and 100 chest CT scans (p < 0.0001). This effect was not found in the shorter mammography sessions with 27 or 50 cases. We found evidence supporting the hypothesis that behavior and performance may change over the course of reading an enriched test set. Further research is required to ascertain whether this effect is present in radiological practice. |
format | Online Article Text |
id | pubmed-4305061 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2014 |
publisher | Springer US |
record_format | MEDLINE/PubMed |
spelling | pubmed-43050612015-01-27 Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies Taylor-Phillips, Sian Elze, Markus C. Krupinski, Elizabeth A. Dennick, Kathryn Gale, Alastair G. Clarke, Aileen Mello-Thoms, Claudia J Digit Imaging Article The vigilance decrement describes a decrease in sensitivity or increase in specificity with time on task. It has been observed in a variety of repetitive visual tasks, but little is known about these patterns in radiologists. We investigated whether there is systematic variation in performance over the course of a radiology reading session. We re-analyzed data from six previous lesion-enriched radiology studies. Studies featured 8–22 participants assessing 27–100 cases (including mammograms, chest CT, chest x-ray, and bone x-ray) in a reading session. Changes in performance and speed as the reading session progressed were analyzed using mixed effects models. Time taken per case decreased 9–23 % as the reading session progressed (p < 0.005 for every study). There was a sensitivity decrease or specificity increase over the course of reading 100 chest x-rays (p = 0.005), 60 bone fracture x-rays (p = 0.03), and 100 chest CT scans (p < 0.0001). This effect was not found in the shorter mammography sessions with 27 or 50 cases. We found evidence supporting the hypothesis that behavior and performance may change over the course of reading an enriched test set. Further research is required to ascertain whether this effect is present in radiological practice. Springer US 2014-07-09 2015-02 /pmc/articles/PMC4305061/ /pubmed/25005866 http://dx.doi.org/10.1007/s10278-014-9717-9 Text en © The Author(s) 2014 https://creativecommons.org/licenses/by/4.0/ Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited. |
spellingShingle | Article Taylor-Phillips, Sian Elze, Markus C. Krupinski, Elizabeth A. Dennick, Kathryn Gale, Alastair G. Clarke, Aileen Mello-Thoms, Claudia Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies |
title | Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies |
title_full | Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies |
title_fullStr | Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies |
title_full_unstemmed | Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies |
title_short | Retrospective Review of the Drop in Observer Detection Performance Over Time in Lesion-enriched Experimental Studies |
title_sort | retrospective review of the drop in observer detection performance over time in lesion-enriched experimental studies |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4305061/ https://www.ncbi.nlm.nih.gov/pubmed/25005866 http://dx.doi.org/10.1007/s10278-014-9717-9 |
work_keys_str_mv | AT taylorphillipssian retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies AT elzemarkusc retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies AT krupinskielizabetha retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies AT dennickkathryn retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies AT galealastairg retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies AT clarkeaileen retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies AT mellothomsclaudia retrospectivereviewofthedropinobserverdetectionperformanceovertimeinlesionenrichedexperimentalstudies |