Evaluation of Audio Source Separation Models Using Hypothesis-Driven Non-Parametric Statistical Methods

Andrew Simpson 1 Gerard Roma 1 Emad Grais 1 Russell Mason 1 Chris Hummersone 1 Antoine Liutkus 2 Mark Plumbley 1
2 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Audio source separation models are typically evaluated using objective separation quality measures, but rigorous statistical methods have yet to be applied to the problem of model comparison. As a result, it can be difficult to establish whether or not reliable progress is being made during the development of new models. In this paper, we provide a hypothesis-driven statistical analysis of the results of the recent source separation SiSEC challenge involving twelve competing models tested on separation of voice and accompaniment from fifty pieces of " professionally produced " contemporary music. Using non-parametric statistics, we establish reliable evidence for meaningful conclusions about the performance of the various models.
Type de document :
Communication dans un congrès
European Signal Processing Conference, Aug 2016, Budapest, Hungary
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01410176
Contributeur : Antoine Liutkus <>
Soumis le : mardi 6 décembre 2016 - 14:52:56
Dernière modification le : mercredi 21 février 2018 - 07:50:07
Document(s) archivé(s) le : mardi 21 mars 2017 - 05:49:43

Fichier

Separation_Stats.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01410176, version 1

Collections

Citation

Andrew Simpson, Gerard Roma, Emad Grais, Russell Mason, Chris Hummersone, et al.. Evaluation of Audio Source Separation Models Using Hypothesis-Driven Non-Parametric Statistical Methods. European Signal Processing Conference, Aug 2016, Budapest, Hungary. 〈hal-01410176〉

Partager

Métriques

Consultations de la notice

206

Téléchargements de fichiers

100