Assessment of the reliability of virtual preanesthetic airway evaluation compared to traditional in-person airway evaluation: a prospective observational study

PURPOSE: Airway evaluation is a fundamental component of the preanesthetic examination. Virtual care has increased during the COVID-19 pandemic. We aimed to assess the reliability of a virtual preanesthetic airway evaluation compared with a traditional in-person airway evaluation. METHODS: This prospective observational study compared the inter-rater agreement of an in-person airway evaluation performed by a consultant anesthesiologist with a virtual airway evaluation (VAE) performed by consultant anesthesiologists and medical students. The airway evaluation was completed using a comprehensive airway evaluation and scoring tool. The primary outcome was the inter-rater agreement of total scores between in-person anesthesiologist airway evaluations and the VAEs of both the anesthesiologists and medical students, assessed using Cohen’s Kappa (CK). Secondary outcomes included the inter-rater agreement for each airway evaluation component between the in-person anesthesiologists and both the anesthesiologist and medical student VAEs, assessed using prevalence-adjusted and bias-adjusted Kappa. RESULTS: One hundred out of 111 participants completed all three evaluations. The in-person anesthesiologist airway evaluations had fair and good levels of agreement of total scores with the VAEs of the anesthesiologists (CK, 0.21; 97.5% confidence interval [CI], 0.07 to 0.34) and the medical students (CK, 0.74; 97.5% CI, 0.62 to 0.86), respectively. One participant was reported to have a difficult intubation. CONCLUSION: Virtual airway evaluations performed by anesthesiologists and medical students had fair and good inter-rater agreement, respectively, with in-person anesthesiologist airway evaluations. Further study with a focus on patients with difficult airways is required to define the predictive value of VAEs regarding difficult intubations. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s12630-022-02345-7.