Cargando…
Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
BACKGROUND: Fidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study use...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7723987/ https://www.ncbi.nlm.nih.gov/pubmed/33324299 http://dx.doi.org/10.3389/fpsyg.2020.601813 |
_version_ | 1783620458540695552 |
---|---|
author | Brandt, Nathalie Georgia McHale, Calum Thomas Humphris, Gerald Michael |
author_facet | Brandt, Nathalie Georgia McHale, Calum Thomas Humphris, Gerald Michael |
author_sort | Brandt, Nathalie Georgia |
collection | PubMed |
description | BACKGROUND: Fidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients’ fear of cancer recurrence, as an example. OBJECTIVES: To illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability. METHODS: The FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability. RESULTS: The qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, r(ICC) = 0.84, 95% CI [0.51, 0.96]. CONCLUSION: The study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended. CLINICAL TRIAL REGISTRATION: www.ClinicalTrials.gov, identifier: NCT03763825. |
format | Online Article Text |
id | pubmed-7723987 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-77239872020-12-14 Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention Brandt, Nathalie Georgia McHale, Calum Thomas Humphris, Gerald Michael Front Psychol Psychology BACKGROUND: Fidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients’ fear of cancer recurrence, as an example. OBJECTIVES: To illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability. METHODS: The FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability. RESULTS: The qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, r(ICC) = 0.84, 95% CI [0.51, 0.96]. CONCLUSION: The study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended. CLINICAL TRIAL REGISTRATION: www.ClinicalTrials.gov, identifier: NCT03763825. Frontiers Media S.A. 2020-11-25 /pmc/articles/PMC7723987/ /pubmed/33324299 http://dx.doi.org/10.3389/fpsyg.2020.601813 Text en Copyright © 2020 Brandt, McHale and Humphris. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Brandt, Nathalie Georgia McHale, Calum Thomas Humphris, Gerald Michael Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
title | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
title_full | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
title_fullStr | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
title_full_unstemmed | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
title_short | Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention |
title_sort | development and testing of a novel measure to assess fidelity of implementation: example of the mini-afterc intervention |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7723987/ https://www.ncbi.nlm.nih.gov/pubmed/33324299 http://dx.doi.org/10.3389/fpsyg.2020.601813 |
work_keys_str_mv | AT brandtnathaliegeorgia developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention AT mchalecalumthomas developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention AT humphrisgeraldmichael developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention |