Cargando…

Validation of a form for assessing the professional performance of residents in cardiology by nurses

BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validat...

Descripción completa

Detalles Bibliográficos
Autores principales: Busch, German, Rodríguez Borda, María V., Morales, Pablo I., Weiss, Mónica, Ciambrone, Graciana, Costabel, Juan P., Durante, Eduardo, Gelpi, Ricardo, Alves De Lima, Alberto E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Wolters Kluwer - Medknow 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10312400/
https://www.ncbi.nlm.nih.gov/pubmed/37397106
http://dx.doi.org/10.4103/jehp.jehp_44_23
_version_ 1785066924114182144
author Busch, German
Rodríguez Borda, María V.
Morales, Pablo I.
Weiss, Mónica
Ciambrone, Graciana
Costabel, Juan P.
Durante, Eduardo
Gelpi, Ricardo
Alves De Lima, Alberto E.
author_facet Busch, German
Rodríguez Borda, María V.
Morales, Pablo I.
Weiss, Mónica
Ciambrone, Graciana
Costabel, Juan P.
Durante, Eduardo
Gelpi, Ricardo
Alves De Lima, Alberto E.
author_sort Busch, German
collection PubMed
description BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3(rd): 4.47; 4(th): 6.17; 5(th): 4.56; 6(th): 4.08; 7(th): 4.36; 8(th): 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents’ experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.
format Online
Article
Text
id pubmed-10312400
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Wolters Kluwer - Medknow
record_format MEDLINE/PubMed
spelling pubmed-103124002023-07-01 Validation of a form for assessing the professional performance of residents in cardiology by nurses Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Gelpi, Ricardo Alves De Lima, Alberto E. J Educ Health Promot Original Article BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3(rd): 4.47; 4(th): 6.17; 5(th): 4.56; 6(th): 4.08; 7(th): 4.36; 8(th): 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents’ experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability. Wolters Kluwer - Medknow 2023-04-28 /pmc/articles/PMC10312400/ /pubmed/37397106 http://dx.doi.org/10.4103/jehp.jehp_44_23 Text en Copyright: © 2023 Journal of Education and Health Promotion https://creativecommons.org/licenses/by-nc-sa/4.0/This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.
spellingShingle Original Article
Busch, German
Rodríguez Borda, María V.
Morales, Pablo I.
Weiss, Mónica
Ciambrone, Graciana
Costabel, Juan P.
Durante, Eduardo
Gelpi, Ricardo
Alves De Lima, Alberto E.
Validation of a form for assessing the professional performance of residents in cardiology by nurses
title Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_full Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_fullStr Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_full_unstemmed Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_short Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_sort validation of a form for assessing the professional performance of residents in cardiology by nurses
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10312400/
https://www.ncbi.nlm.nih.gov/pubmed/37397106
http://dx.doi.org/10.4103/jehp.jehp_44_23
work_keys_str_mv AT buschgerman validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT rodriguezbordamariav validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT moralespabloi validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT weissmonica validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT ciambronegraciana validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT costabeljuanp validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT duranteeduardo validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT gelpiricardo validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses
AT alvesdelimaalbertoe validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses