Variability Modelling for Audio Events Detection in Movies.

Cédric Penet 1, 2 Claire-Hélène Demarty 1 Guillaume Gravier 2 Patrick Gros 2
2 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : Detecting audio events in Hollywood movies is a complex task due to the presence of variability between the soundtracks of the movies. This inter-movies variability is shown to impair the audio events detection results in a realistic framework. In this article, we propose to model the variability using a factor analysis technique, which we then use to compensate the audio features. The factor analysis compensation is validated using the state-of-the-art system based on multiple audio words sequences and contextual Bayesian networks which we previously developed in Penet et al. (2013). Results obtained on the same publicly available dataset for the detection of gunshots and explosions show an improvement in the handling of the variability, while keeping the robustness capabilities of the previous system. Furthermore, the system is applied to the detection of screams and proves its ability to generalise to other types of events. The obtained results also emphasise the fact that, in addition to modelling variability, adding concepts in the system may also be beneficial for the precision rates
Liste complète des métadonnées
Contributeur : Patrick Gros <>
Soumis le : dimanche 20 juillet 2014 - 17:11:00
Dernière modification le : jeudi 11 janvier 2018 - 06:20:10




Cédric Penet, Claire-Hélène Demarty, Guillaume Gravier, Patrick Gros. Variability Modelling for Audio Events Detection in Movies.. Multimedia Tools and Applications, Springer Verlag, 2014, 〈〉. 〈10.1007/s11042-014-2038-7〉. 〈hal-01026151〉



Consultations de la notice