The CAVA corpus: synchronised stereoscopic and binaural datasets with head movements

Elise Arnaud 1 Heidi Christensen 2 Yan-Chen Lu 2 Jon Barker 2 Vasil Khalidov 3 Miles Hansard 1 Bertrand Holveck 1 Herve Mathieu 1 Ramya Narasimha 1 Elise Taillant 1 Florence Forbes 3 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 Department of Computer Sciences [Scheffield]
3 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper describes the acquisition and content of a new multi-modal database. Some tools for making use of the data streams are also presented. The Computational Audio- Visual Analysis (CAVA) database is a unique collection of three synchronised data streams obtained from a binaural microphone pair, a stereoscopic camera pair and a head tracking device. All recordings are made from the perspective of a person; i.e. what would a human with natural head movements see and hear in a given environment. The database is intended to facilitate research into humans' ability to optimise their multi-modal sensory input and fills a gap by providing data that enables human centred audiovisual scene analysis. It also enables 3D localisation using either audio, visual, or audio-visual cues. A total of 50 sessions, with varying degrees of visual and auditory complexity, were recorded. These range from seeing and hearing a single speaker moving in and out of field of view, to moving around a 'cocktail party' style situation, mingling and joining different small groups of people chatting.
Document type :
Conference papers
Complete list of metadatas

casque-sansCP.jpg
casque-sansCP.jpg
https://hal.inria.fr/inria-00373173
Contributor : Elise Arnaud <>
Submitted on : Friday, April 3, 2009 - 3:06:51 PM
Last modification on : Wednesday, April 11, 2018 - 1:58:39 AM
Long-term archiving on : Friday, October 12, 2012 - 4:11:01 PM

Files

icmi08-cava.pdf
Files produced by the author(s)

Identifiers

Collections

INRIA | LJK_PS_MISTIS | LJK_PS | LJK_GI_PERCEPTION | LJK_GI | LJK | UGA

Citation

Elise Arnaud, Heidi Christensen, Yan-Chen Lu, Jon Barker, Vasil Khalidov, et al.. The CAVA corpus: synchronised stereoscopic and binaural datasets with head movements. ICMI 2008 - ACM/IEEE International Conference on Multimodal Interfaces, Oct 2008, Chania, Greece. pp.109-116, ⟨10.1145/1452392.1452414⟩. ⟨inria-00373173⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

620

Files downloads

284

Contact


archive-ouverte@inria.fr