Maintaining Research Fidelity: Remote Training and Monitoring of Clinical Assistants in Aphasia Research

BACKGROUND: In aphasia research, to improve a study's reliability, the aphasia journals compel their authors to report fidelity. Aphasia researchers are mostly concerned about Type I and Type II errors to maintain the level of confidence. However, the third type (Type III error) can significantly affect the study outcomes and question the research fidelity. OBJECTIVE: This study explains the methodology of how investigators maintained research fidelity in the context of hiring and training remote data collectors and conducted a multi-site data collection. METHODS: The present study used a descriptive analysis design to explicate the three-step process of remote data collection: (1) remotely selecting and training data collectors, (2) remotely supervising data collection and data management, and (3) optimizing and monitoring screening/assessment fidelity. At the initial step, investigators interviewed seven candidates and short-listed four of them, who were trained using a standard training protocol and participated in a mock data collection. For the next two steps, data collectors video-recorded each study session and e-shared the data with the investigator, who watched all the video-recordings and provided necessary feedback with a focus on the screening sections. The screenings were a part of the inclusion-exclusion criteria. RESULTS: Two data collectors (both clinical psychologists) with the highest scores were selected and received final training. One-to-one e-supervision by the investigator resulted in significant improvement in data collectors' performance. Only 4% of the total collected sample size was excluded, and 99 participants' data were analyzed. CONCLUSION: The present study adds information on maintaining research fidelity for remote data collection, where limited studies exist.