Scoring synchronization between music and motion: local Vs global approaches - IMT Mines Alès
Communication Dans Un Congrès Année : 2024

Scoring synchronization between music and motion: local Vs global approaches

Hamza Bayd
  • Fonction : Auteur
  • PersonId : 1136238
  • IdHAL : hamza-bayd
Patrice Guyot
Benoit G. Bardy
Pierre Slangen

Résumé

This paper compares methods for scoring the synchronization between music and motion. A wide range of local and global methods such as the Gaussian-based method, relative phase, and dynamic time warping (DTW) have been evaluated. Firstly, these methods were tested on synthetic data representing various scenarios of motion and music interaction. Secondly, we introduce a full system able to evaluate real video performances of music and movement synchronization in which participants were asked to tap their fingers to the beat. The system takes a motion video clip as input and extracts music and motion beats. From these two vectors, the synchronization is scored with different metrics. Results emphasize the complementary nature of the scoring approaches. The data and code are available online at https://github.com/baya1235/Scoring-synchronization- between-motion-and-music.
Fichier non déposé

Dates et versions

Identifiants

Citer

Hamza Bayd, Patrice Guyot, Benoit G. Bardy, Pierre Slangen. Scoring synchronization between music and motion: local Vs global approaches. EUSIPCO 2024 - 32nd European Signal Processing Conference, Sep 2024, Lyon, France. ⟨10.23919/EUSIPCO63174.2024.10715297⟩. ⟨hal-04728052⟩
30 Consultations
0 Téléchargements

Altmetric

Partager

More