Cargando…
Validation of a form for assessing the professional performance of residents in cardiology by nurses
BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validat...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Wolters Kluwer - Medknow
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10312400/ https://www.ncbi.nlm.nih.gov/pubmed/37397106 http://dx.doi.org/10.4103/jehp.jehp_44_23 |
_version_ | 1785066924114182144 |
---|---|
author | Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Gelpi, Ricardo Alves De Lima, Alberto E. |
author_facet | Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Gelpi, Ricardo Alves De Lima, Alberto E. |
author_sort | Busch, German |
collection | PubMed |
description | BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3(rd): 4.47; 4(th): 6.17; 5(th): 4.56; 6(th): 4.08; 7(th): 4.36; 8(th): 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents’ experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability. |
format | Online Article Text |
id | pubmed-10312400 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Wolters Kluwer - Medknow |
record_format | MEDLINE/PubMed |
spelling | pubmed-103124002023-07-01 Validation of a form for assessing the professional performance of residents in cardiology by nurses Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Gelpi, Ricardo Alves De Lima, Alberto E. J Educ Health Promot Original Article BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3(rd): 4.47; 4(th): 6.17; 5(th): 4.56; 6(th): 4.08; 7(th): 4.36; 8(th): 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents’ experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability. Wolters Kluwer - Medknow 2023-04-28 /pmc/articles/PMC10312400/ /pubmed/37397106 http://dx.doi.org/10.4103/jehp.jehp_44_23 Text en Copyright: © 2023 Journal of Education and Health Promotion https://creativecommons.org/licenses/by-nc-sa/4.0/This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms. |
spellingShingle | Original Article Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Gelpi, Ricardo Alves De Lima, Alberto E. Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title | Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_full | Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_fullStr | Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_full_unstemmed | Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_short | Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_sort | validation of a form for assessing the professional performance of residents in cardiology by nurses |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10312400/ https://www.ncbi.nlm.nih.gov/pubmed/37397106 http://dx.doi.org/10.4103/jehp.jehp_44_23 |
work_keys_str_mv | AT buschgerman validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT rodriguezbordamariav validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT moralespabloi validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT weissmonica validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT ciambronegraciana validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT costabeljuanp validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT duranteeduardo validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT gelpiricardo validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses AT alvesdelimaalbertoe validationofaformforassessingtheprofessionalperformanceofresidentsincardiologybynurses |