Cargando…

Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial

BACKGROUND: Since the advent of COVID-19, accelerated adoption of systems that reduce face-to-face encounters has outpaced training and best practices. Electronic consultations (eConsults), structured communications between PCPs and specialists regarding a case, have been effective in reducing face-...

Descripción completa

Detalles Bibliográficos
Autores principales: Meeker, Daniella, Friedberg, Mark W., Knight, Tara K., Doctor, Jason N., Zein, Dina, Cayasso-McIntosh, Nancy, Goldstein, Noah J., Fox, Craig R., Linder, Jeffrey A., Persell, Stephen D., Dea, Stanley, Giboney, Paul, Yee, Hal F.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8428492/
https://www.ncbi.nlm.nih.gov/pubmed/34505234
http://dx.doi.org/10.1007/s11606-021-07002-1
_version_ 1783750390043377664
author Meeker, Daniella
Friedberg, Mark W.
Knight, Tara K.
Doctor, Jason N.
Zein, Dina
Cayasso-McIntosh, Nancy
Goldstein, Noah J.
Fox, Craig R.
Linder, Jeffrey A.
Persell, Stephen D.
Dea, Stanley
Giboney, Paul
Yee, Hal F.
author_facet Meeker, Daniella
Friedberg, Mark W.
Knight, Tara K.
Doctor, Jason N.
Zein, Dina
Cayasso-McIntosh, Nancy
Goldstein, Noah J.
Fox, Craig R.
Linder, Jeffrey A.
Persell, Stephen D.
Dea, Stanley
Giboney, Paul
Yee, Hal F.
collection PubMed
description BACKGROUND: Since the advent of COVID-19, accelerated adoption of systems that reduce face-to-face encounters has outpaced training and best practices. Electronic consultations (eConsults), structured communications between PCPs and specialists regarding a case, have been effective in reducing face-to-face specialist encounters. As the health system rapidly adapts to multiple new practices and communication tools, new mechanisms to measure and improve performance in this context are needed. OBJECTIVE: To test whether feedback comparing physicians to top performing peers using co-specialists’ ratings improves performance. DESIGN: Cluster-randomized controlled trial PARTICIPANTS: Eighty facility-specialty clusters and 214 clinicians INTERVENTION: Providers in the feedback arms were sent messages that announced their membership in an elite group of “Top Performers” or provided actionable recommendations with feedback for providers that were “Not Top Performers.” MAIN MEASURES: The primary outcomes were changes in peer ratings in the following performance dimensions after feedback was received: (1) elicitation of information from primary care practitioners; (2) adherence to institutional clinical guidelines; (3) agreement with peer’s medical decision-making; (4) educational value; (5) relationship building. KEY RESULTS: Specialists showed significant improvements on 3 of the 5 consultation performance dimensions: medical decision-making (odds ratio 1.52, 95% confidence interval 1.08–2.14, p<.05), educational value (1.86, 1.17–2.96) and relationship building (1.63, 1.13–2.35) (both p<.01). CONCLUSIONS: The pandemic has shed light on clinicians’ commitment to professionalism and service as we rapidly adapt to changing paradigms. Interventions that appeal to professional norms can help improve the efficacy of new systems of practice. We show that specialists’ performance can be measured and improved with feedback using aspirational norms. TRIAL REGISTRATION: clinicaltrials.gov NCT03784950 SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11606-021-07002-1.
format Online
Article
Text
id pubmed-8428492
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-84284922021-09-10 Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial Meeker, Daniella Friedberg, Mark W. Knight, Tara K. Doctor, Jason N. Zein, Dina Cayasso-McIntosh, Nancy Goldstein, Noah J. Fox, Craig R. Linder, Jeffrey A. Persell, Stephen D. Dea, Stanley Giboney, Paul Yee, Hal F. J Gen Intern Med Original Research BACKGROUND: Since the advent of COVID-19, accelerated adoption of systems that reduce face-to-face encounters has outpaced training and best practices. Electronic consultations (eConsults), structured communications between PCPs and specialists regarding a case, have been effective in reducing face-to-face specialist encounters. As the health system rapidly adapts to multiple new practices and communication tools, new mechanisms to measure and improve performance in this context are needed. OBJECTIVE: To test whether feedback comparing physicians to top performing peers using co-specialists’ ratings improves performance. DESIGN: Cluster-randomized controlled trial PARTICIPANTS: Eighty facility-specialty clusters and 214 clinicians INTERVENTION: Providers in the feedback arms were sent messages that announced their membership in an elite group of “Top Performers” or provided actionable recommendations with feedback for providers that were “Not Top Performers.” MAIN MEASURES: The primary outcomes were changes in peer ratings in the following performance dimensions after feedback was received: (1) elicitation of information from primary care practitioners; (2) adherence to institutional clinical guidelines; (3) agreement with peer’s medical decision-making; (4) educational value; (5) relationship building. KEY RESULTS: Specialists showed significant improvements on 3 of the 5 consultation performance dimensions: medical decision-making (odds ratio 1.52, 95% confidence interval 1.08–2.14, p<.05), educational value (1.86, 1.17–2.96) and relationship building (1.63, 1.13–2.35) (both p<.01). CONCLUSIONS: The pandemic has shed light on clinicians’ commitment to professionalism and service as we rapidly adapt to changing paradigms. Interventions that appeal to professional norms can help improve the efficacy of new systems of practice. We show that specialists’ performance can be measured and improved with feedback using aspirational norms. TRIAL REGISTRATION: clinicaltrials.gov NCT03784950 SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11606-021-07002-1. Springer International Publishing 2021-09-09 2022-05 /pmc/articles/PMC8428492/ /pubmed/34505234 http://dx.doi.org/10.1007/s11606-021-07002-1 Text en © Society of General Internal Medicine 2021
spellingShingle Original Research
Meeker, Daniella
Friedberg, Mark W.
Knight, Tara K.
Doctor, Jason N.
Zein, Dina
Cayasso-McIntosh, Nancy
Goldstein, Noah J.
Fox, Craig R.
Linder, Jeffrey A.
Persell, Stephen D.
Dea, Stanley
Giboney, Paul
Yee, Hal F.
Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
title Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
title_full Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
title_fullStr Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
title_full_unstemmed Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
title_short Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
title_sort effect of peer benchmarking on specialist electronic consult performance in a los angeles safety-net: a cluster randomized trial
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8428492/
https://www.ncbi.nlm.nih.gov/pubmed/34505234
http://dx.doi.org/10.1007/s11606-021-07002-1
work_keys_str_mv AT effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT meekerdaniella effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT friedbergmarkw effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT knighttarak effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT doctorjasonn effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT zeindina effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT cayassomcintoshnancy effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT goldsteinnoahj effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT foxcraigr effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT linderjeffreya effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT persellstephend effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT deastanley effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT giboneypaul effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial
AT yeehalf effectofpeerbenchmarkingonspecialistelectronicconsultperformanceinalosangelessafetynetaclusterrandomizedtrial