Effect of sonification types in upper-limb movement: a quantitative and qualitative study in hemiparetic and healthy participants

BACKGROUND: Movement sonification, the use of real-time auditory feedback linked to movement parameters, have been proposed to support rehabilitation. Nevertheless, if promising results have been reported, the effect of the type of sound used has not been studied systematically. The aim of this study was to investigate in a single session the effect of different types of sonification both quantitatively and qualitatively on patients with acquired brain lesions and healthy participants. METHODS: An experimental setup enabling arm sonification was developed using three different categories of sonification (direct sound modulation, musical interaction, and soundscape). Simple moving forward movements performed while sliding on a table with both arms were investigated with all participants. Quantitative analysis on the movement timing were performed considering various parameters (sound condition, affected arm and dominance, sonification categories). Qualitative analysis of semi-structured interviews were also conducted, as well as neuropsychological evaluation of music perception. RESULTS: For both the patient and healthy groups (15 participants each), average duration for performing the arm movement is significantly longer with sonification compared to the no-sound condition (p < 0.001). Qualitative analysis of semi-structured interviews revealed different aspects of motivational and affective aspects of sonification. Most participants of both groups preferred to complete the task with sound (29 of 30 participants), and described the experience as playful (22 of 30 participants). More precisely, the soundscape (nature sounds) was the most constantly preferred (selected first by 14 of 30 participants). CONCLUSION: Overall, our results confirm that the sonification has an effect on the temporal execution of the movement during a single-session. Globally, sonification is welcomed by the participants, and we found convergent and differentiated appreciations of the different sonification types. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12984-023-01248-y.