Subjective and objective quality assessment of audio source separation

Valentin Emiya 1 Emmanuel Vincent 1 Niklas Harlander 2 Volker Hohmann 2
1 METISS - Speech and sound data modeling and processing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : We aim to assess the perceived quality of estimated source signals in the context of audio source separation. These signals may involve one or more kinds of distortions, including distortion of the target source, interference from the other sources or musical noise artifacts. We propose a subjective test protocol to assess the perceived quality with respect to each kind of distortion and collect the scores of 20 subjects over 80 sounds. We then propose a family of objective measures aiming to predict these subjective scores based on the decomposition of the estimation error into several distortion components and on the use of the PEMO-Q perceptual salience measure to provide multiple features that are then combined. These measures increase correlation with subjective scores up to 0.5 compared to nonlinear mapping of individual state-of-the-art source separation measures. Finally, we released the data and code presented in this paper in a freely-available toolkit called PEASS.
Complete list of metadatas

Cited literature [36 references]  Display  Hide  Download

https://hal.inria.fr/inria-00567152
Contributor : Valentin Emiya <>
Submitted on : Friday, February 18, 2011 - 2:56:21 PM
Last modification on : Thursday, March 21, 2019 - 2:20:41 PM
Long-term archiving on : Thursday, May 19, 2011 - 2:55:15 AM

File

emiya2011.pdf
Files produced by the author(s)

Identifiers

Citation

Valentin Emiya, Emmanuel Vincent, Niklas Harlander, Volker Hohmann. Subjective and objective quality assessment of audio source separation. IEEE Transactions on Audio, Speech and Language Processing, Institute of Electrical and Electronics Engineers, 2011, 19 (7), pp.2046-2057. ⟨10.1109/TASL.2011.2109381⟩. ⟨inria-00567152⟩

Share

Metrics

Record views

837

Files downloads

6219