The role of a checklist for assessing the quality of basic life support performance: an observational cohort study

BACKGROUND: Training lay rescuers in Basic Life Support (BLS) is essential to improve bystander cardiopulmonary resuscitation (CPR) rates; in addition, simple methods are needed to provide feedback on CPR performance. This study evaluated whether a simple observational checklist can be used by BLS instructors to adequately measure the quality of BLS performance as an alternative to other feedback devices. METHODS: The BLS performances of 152 first-year medical students (aged 21.4 ± 3.9 years) were recorded on video, and objective data regarding the quality of the BLS were documented using Laerdal PC SkillReporting software. The performances were categorized according to quality. Ten BLS instructors observed the videos and completed a ten-point checklist based on the Cardiff Test of BLS (version 3.1) to assess the performances. The validity of the checklist was reviewed using interrater reliability as well as by comparing the checklist-based results with objective performance data. RESULTS: Matching the checklist-based evaluation with the objective performance data revealed high levels of agreement for very good (82%) and overall insufficient (75%) performances. Regarding the checklist-based evaluation, interrater reliability depended on the checklist item; thus, some items were more easily identified correctly than others. The highest and lowest levels of agreement were observed for the items “undressed torso” and “complete release between compressions” (mean joint-probability 95 and 67%, respectively). CONCLUSIONS: The observational checklist adequately distinguished sufficient from insufficient BLS performances and offered an assessment of items not incorporated by SkillReporting software such as the initial assessment or undressing the chest. Although its usefulness was reduced for scaling intermediate performance groups, the checklist may be overall a useful rating tool in BLS-training if objective feedback devices are not available, for example, due to large groups of participants or limited training time.