How does the Use of Sonification of Arm Movement Modulate Gesture Reproduction? - IMT Mines Alès
Communication Dans Un Congrès Année : 2023

How does the Use of Sonification of Arm Movement Modulate Gesture Reproduction?

Résumé

In sports, efficacy of visual and verbal feedbacks is well known for learning or improving gestures. Auditory feedback to the contrary is poorly understood. However, several authors have demonstrated the efficacy of using sonification systems to provide real-time auditory feedback to athletes in diverse types of sports (O'brien et al., 2019). The sonification gives athletes the opportunity to receive direct information about their motion to correct it instantly. This method is also used in physical rehabilitation, after a loss of mobility due to an injury, or a disease as Parkinson's Disease (PD). In this work, we focus on the use of sonification to assess the proprioception and improve the mobility of healthy subjects and patients with PD. Frameworks and Methodology Videos of movements will be shown to the participants who will have to reproduce the same movements faithfully, with or without the sonification system (used in the video and by the participant himself). The movements we chose are characterized by large amplitudes, speed changes, and stops at precise angles, which will have to be reproduced according to the principle adopted in ARJP tests (Han et al., 2016). Gestures are also inspired by the LSVT-BIG Program (a training program for patients with PD). Our experiment will be performed at the AIHM (Ales Imaging and Human Metrology) platform, using the Qualysis motion capture system. Sets of 4 markers (to avoid occlusions) placed on the shoulder, the elbow, and the wrist will be connected to the sound synthesis software Max. The 3D kinematics data of these joints will be mapped in real time to specifics sound parameters so that the subjects will perceive modulation in sound while moving. As the model will also wear the sonification system in the videos, participants will be able to listen the expected sound they will have to reproduce. And so, they will instantly notice if their movement are too small or too slow. Other markers will be placed in the whole body to assess changes in motion. The effect of sonification will be assessed by comparing kinematics of the model and of the reproduction by participants, with and without sonification. In particular, we will quantify the similarity between angular velocity at the elbow and shoulder between model and reproduction, using the Wasserstein distance (Słowiński et al., 2016). Amplitude of movements will also be quantified. Results will focus on the impact of our sonification approach in terms of speed of movement, reproduction of joint position and range of motion. Discussion will address how sonification could be effective in improving movement and providing a source of motivation for users (Nikmaram et al., 2019). Conclusion and perspectives Sonification has a large potential in different fields like sport, rehabilitation or learning but is not yet sufficiently explored. Future works will involve a larger sample of Parkinson's patients assess our hypothesis with the aim of creating a standardized rehabilitation protocol using sonification to facilitate the physiotherapist's work in PD.
Fichier non déposé

Dates et versions

hal-04287349 , version 1 (15-11-2023)

Identifiants

  • HAL Id : hal-04287349 , version 1

Citer

Laura Lacazette, Patrice Guyot, Julien Lagarde, Pierre Slangen, Valérie Cochen de Cock. How does the Use of Sonification of Arm Movement Modulate Gesture Reproduction?. ACAPS 2023 - Les Environnements de l'Activité Physique et Sportive, Oct 2023, Reims, France. ⟨hal-04287349⟩
56 Consultations
0 Téléchargements

Partager

More