The CAVA corpus: synchronised stereoscopic and binaural datasets with head movements
Abstract
This paper describes the acquisition and content of a new multi-modal database. Some tools for making use of the data streams are also presented. The Computational Audio- Visual Analysis (CAVA) database is a unique collection of three synchronised data streams obtained from a binaural microphone pair, a stereoscopic camera pair and a head tracking device. All recordings are made from the perspective of a person; i.e. what would a human with natural head movements see and hear in a given environment. The database is intended to facilitate research into humans' ability to optimise their multi-modal sensory input and fills a gap by providing data that enables human centred audiovisual scene analysis. It also enables 3D localisation using either audio, visual, or audio-visual cues. A total of 50 sessions, with varying degrees of visual and auditory complexity, were recorded. These range from seeing and hearing a single speaker moving in and out of field of view, to moving around a 'cocktail party' style situation, mingling and joining different small groups of people chatting.
Domains
Databases [cs.DB]
Fichier principal
icmi08-cava.pdf (1.15 Mo)
Télécharger le fichier
casque-sansCP.jpg (66.29 Ko)
Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image