A simple user interface system for recovering patterns repeating in time and frequency in mixtures of sounds

Zafar Rafii 1 Antoine Liutkus 2, 3 Bryan Pardo 4
2 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
3 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Repetition is a fundamental element in generating and perceiving structure in audio. Especially in music, structures tend to be composed of patterns that repeat through time (e.g., rhythmic elements in a musical accompaniment), and also frequency (e.g., different notes of the same instrument). The auditory system has the remarkable ability to parse such patterns by identifying repetitions within the audio mixture. On this basis, we propose a simple user interface system for recovering patterns repeating in time and frequency in mixtures of sounds. A user selects a region in the log-frequency spectrogram of an audio recording from which she/he wishes to recover a repeating pattern masked by an undesired element (e.g., a note masked by a cough). The selected region is then cross-correlated with the spectrogram to identify similar regions where the underlying pattern repeats. The identified regions are finally averaged over their repetitions and the repeating pattern is recovered.
Liste complète des métadonnées

Cited literature [19 references]  Display  Hide  Download

https://hal.inria.fr/hal-01116689
Contributor : Antoine Liutkus <>
Submitted on : Friday, February 13, 2015 - 11:46:51 PM
Last modification on : Tuesday, December 18, 2018 - 4:38:02 PM
Document(s) archivé(s) le : Saturday, September 12, 2015 - 1:30:33 PM

File

Rafii-Liutkus-Pardo - A Simple...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01116689, version 1

Collections

Citation

Zafar Rafii, Antoine Liutkus, Bryan Pardo. A simple user interface system for recovering patterns repeating in time and frequency in mixtures of sounds. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Apr 2015, Brisbane, France. ⟨hal-01116689⟩

Share

Metrics

Record views

356

Files downloads

314