Multi-criteria subjective and objective evaluation of audio source separation

Valentin Emiya 1 Emmanuel Vincent 1 Niklas Harlander 2 Volker Hohmann 2
1 METISS - Speech and sound data modeling and processing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : In this paper, we address the problem of assessing the perceived quality of estimated source signals in the context of audio source separation. These signals involve different kinds of distortions depending on the considered separation algorithm, including distortion of the target source, interference from other sources or musical noise artifacts. A new MUSHRA-based subjective test protocol is proposed to assess the perceived quality with respect to each kind of distortion and collect the scores of 20 subjects over 80 sounds. Subsequently, the contribution of each type of distortion to the overall quality is analyzed. We propose a family of objective measures aiming to predict the subjective scores based on a decomposition of the estimation error into several distortion components. We conclude by discussing possible implications of this work in the field of 3D audio quality assessment.
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/inria-00545031
Contributor : Valentin Emiya <>
Submitted on : Monday, January 31, 2011 - 5:15:38 PM
Last modification on : Thursday, March 21, 2019 - 2:20:42 PM
Long-term archiving on : Sunday, May 1, 2011 - 2:25:55 AM

File

2010-06-13_AES38_emiya.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00545031, version 1

Citation

Valentin Emiya, Emmanuel Vincent, Niklas Harlander, Volker Hohmann. Multi-criteria subjective and objective evaluation of audio source separation. AES 38th International Conference on Sound Quality Evaluation, Jun 2010, Pitea, Sweden. ⟨inria-00545031⟩

Share

Metrics

Record views

848

Files downloads

249