Skip to Main content Skip to Navigation
New interface
Conference papers

Multi-criteria subjective and objective evaluation of audio source separation

Valentin Emiya 1 Emmanuel Vincent 1 Niklas Harlander 2 Volker Hohmann 2 
1 METISS - Speech and sound data modeling and processing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : In this paper, we address the problem of assessing the perceived quality of estimated source signals in the context of audio source separation. These signals involve different kinds of distortions depending on the considered separation algorithm, including distortion of the target source, interference from other sources or musical noise artifacts. A new MUSHRA-based subjective test protocol is proposed to assess the perceived quality with respect to each kind of distortion and collect the scores of 20 subjects over 80 sounds. Subsequently, the contribution of each type of distortion to the overall quality is analyzed. We propose a family of objective measures aiming to predict the subjective scores based on a decomposition of the estimation error into several distortion components. We conclude by discussing possible implications of this work in the field of 3D audio quality assessment.
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download
Contributor : Valentin Emiya Connect in order to contact the contributor
Submitted on : Monday, January 31, 2011 - 5:15:38 PM
Last modification on : Friday, February 4, 2022 - 3:23:03 AM
Long-term archiving on: : Sunday, May 1, 2011 - 2:25:55 AM


Files produced by the author(s)


  • HAL Id : inria-00545031, version 1


Valentin Emiya, Emmanuel Vincent, Niklas Harlander, Volker Hohmann. Multi-criteria subjective and objective evaluation of audio source separation. AES 38th International Conference on Sound Quality Evaluation, Jun 2010, Pitea, Sweden. ⟨inria-00545031⟩



Record views


Files downloads