Skip to Main content Skip to Navigation
Book sections

Audio source separation using sparse representations

Andrew Nesbit 1 Maria Jafari 1 Emmanuel Vincent 2 Mark Plumbley 1
2 METISS - Speech and sound data modeling and processing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : We address the problem of audio source separation, namely, the recovery of audio signals from recordings of mixtures of those signals. The sparse component analysis framework is a powerful method for achieving this. Sparse orthogonal transforms, in which only few transform coefficients differ significantly from zero, are developed; once the signal has been transformed, energy is apportioned from each transform coefficient to each estimated source, and, finally, the signal is reconstructed using the inverse transform. The overriding aim of this chapter is to demonstrate how this framework, as exemplified here by two different decomposition methods which adapt to the signal to represent it sparsely, can be used to solve different problems in different mixing scenarios. To address the instantaneous (neither delays nor echoes) and underdetermined (more sources than mixtures) mixing model, a lapped orthogonal transform is adapted to the signal by selecting a basis from a library of predetermined bases. This method is highly related to the windowing methods used in the MPEG audio coding framework. In considering the anechoic (delays but no echoes) and determined (equal number of sources and mixtures) mixing case, a greedy adaptive transform is used based on orthogonal basis functions that are learned from the observed data, instead of being selected from a predetermined library of bases. This is found to encode the signal characteristics, by introducing a feedback system between the bases and the observed data. Experiments on mixtures of speech and music signals demonstrate that these methods give good signal approximations and separation performance, and indicate promising directions for future research.
Complete list of metadata

Cited literature [29 references]  Display  Hide  Download
Contributor : Emmanuel Vincent Connect in order to contact the contributor
Submitted on : Saturday, December 10, 2011 - 7:00:23 AM
Last modification on : Wednesday, June 16, 2021 - 3:41:19 AM
Long-term archiving on: : Sunday, March 11, 2012 - 2:20:15 AM


Files produced by the author(s)



Andrew Nesbit, Maria Jafari, Emmanuel Vincent, Mark Plumbley. Audio source separation using sparse representations. W. Wang. Machine Audition: Principles, Algorithms and Systems, IGI Global, pp.246--265, 2010, ⟨10.4018/978-1-61520-919-4.ch010⟩. ⟨inria-00544030⟩



Record views


Files downloads