Nonnegative matrix factorization and spatial covariance model for under-determined reverberant audio source separation

Simon Arberet; Alexey Ozerov; Ngoc Q. K. Duong; Emmanuel Vincent; Rémi Gribonval; Frédéric Bimbot; Pierre Vandergheynst

inria-00541436, version 1

Nonnegative matrix factorization and spatial covariance model for under-determined reverberant audio source separation

Simon Arberet ()^a^, 1, Alexey Ozerov ()^b^, 2, Ngoc Q. K. Duong ()^b^, 2, Emmanuel Vincent ()^b^, 2, Rémi Gribonval ()^b^, 2, Frédéric Bimbot ()^c^, 2, Pierre Vandergheynst () ¹

Information Sciences Signal Processing and their Applications (ISSPA), 2010 10th International Conference on (2010) 1--4

Résumé : We address the problem of blind audio source separation in the under-determined and convolutive case. The contribution of each source to the mixture channels in the time-frequency domain is modeled by a zero-mean Gaussian random vector with a full rank covariance matrix composed of two terms: a variance which represents the spectral properties of the source and which is modeled by a nonnegative matrix factorization (NMF) model and another full rank covariance matrix which encodes the spatial properties of the source contribution in the mixture. We address the estimation of these parameters by maximizing the likelihood of the mixture using an expectation-maximization (EM) algorithm. Theoretical propositions are corroborated by experimental studies on stereo reverberant music mixtures.

a – EPFL
b – INRIA
c – CNRS
1 : LTS2 - EPFL
École Polytechnique Fédérale de Lausanne
2 : METISS (INRIA - IRISA)
CNRS : UMR6074 – INRIA – Institut National des Sciences Appliquées (INSA) - Rennes – Université de Rennes 1

inria-00541436, version 1
http://hal.inria.fr/inria-00541436
oai:hal.inria.fr:inria-00541436
Contributeur : Rémi Gribonval <>
Soumis le : Samedi 5 Février 2011, 12:53:44
Dernière modification le : Dimanche 6 Février 2011, 20:28:58

Voir la fiche détaillée

Documents associés

PDF :

DOI : 10.1109/ISSPA.2010.5605570

Exporter

Bibtex EndNote TEI RefWorks

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="inproceedings"><head>Communications avec actes</head>
<biblStruct type="inproceedings" xml:id="inria-00541436"><analytic>
<author><persName><forename>Simon</forename><surname>Arberet</surname></persName>
<affiliation>
<orgName type="team">LTS2 - EPFL</orgName>
<country>CH</country>
<orgName type="institution">École Polytechnique Fédérale de Lausanne</orgName>
</affiliation>
</author>
<author><persName><forename>Alexey</forename><surname>Ozerov</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">METISS</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) - Rennes</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
</affiliation>
</author>
<author><persName><forename>Ngoc</forename><surname>Duong</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">METISS</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) - Rennes</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
</affiliation>
</author>
<author><persName><forename>Emmanuel</forename><surname>Vincent</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">METISS</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) - Rennes</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
</affiliation>
</author>
<author><persName><forename>Rémi</forename><surname>Gribonval</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">METISS</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) - Rennes</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
</affiliation>
</author>
<author><persName><forename>Frédéric</forename><surname>Bimbot</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">METISS</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) - Rennes</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
</affiliation>
</author>
<author><persName><forename>Pierre</forename><surname>Vandergheynst</surname></persName>
<affiliation>
<orgName type="team">LTS2 - EPFL</orgName>
<country>CH</country>
<orgName type="institution">École Polytechnique Fédérale de Lausanne</orgName>
</affiliation>
</author>
<title type="main" level="a">Nonnegative matrix factorization and spatial covariance model for under-determined reverberant audio source separation</title></analytic><monogr><meeting>Information Sciences Signal Processing and their Applications (ISSPA), 2010 10th International Conference on</meeting><imprint><publisher>IEEE</publisher><pubPlace><settlement>Kuala Lumpur</settlement><country>Malaisie</country></pubPlace><biblScope type="publicationDate">2010-00-00</biblScope><biblScope type="pp">1--4</biblScope></imprint></monogr><idno type="doi">10.1109/ISSPA.2010.5605570</idno><idno type="HALid">http://hal.inria.fr/inria-00541436</idno><idno type="HALFile">http://hal.inria.fr/inria-00541436/PDF/2010_ISSPA_ArberetEtAl.pdf</idno></biblStruct>
</listBibl>
</listBibl>