A Comparative Error Analysis of Audio-Visual Source Localization

Abstract : This paper examines the accuracy of audio-video based localization using multiple cameras and multi-microphones. Covariance mapping theory is used to determine the accuracy of audio and video based localization. Both modalities are compared in terms of their ability to provide accurate location estimates of a moving audio-visual source. Relatively, video is found to be significantly more accurate than audio. The problem of audio-video fusion is also examined. The fusion of audio and video location estimates is applied in the audio domain, the video domain and the positional domain. The accuracy of these three fusion strategies for 3D localization are examined from a theoretical basis. The best localization performance is found when fusion is applied in the positional domain. Fusing audio and video data in the video domain is found to exhibit the worst localization performance. This analysis is confirmed by measuring the accuracy of each fusion strategy in localizing a moving audio-visual source.
Type de document :
Communication dans un congrès
Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications - M2SFA2 2008, Oct 2008, Marseille, France. 2008
Liste complète des métadonnées

Littérature citée [12 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00326742
Contributeur : Peter Sturm <>
Soumis le : dimanche 5 octobre 2008 - 13:40:40
Dernière modification le : lundi 6 octobre 2008 - 09:32:19
Document(s) archivé(s) le : vendredi 4 juin 2010 - 12:13:25

Fichier

1569140110.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00326742, version 1

Collections

Citation

Damien Kelly, François Pitié, Anil Kokaram, Frank Boland. A Comparative Error Analysis of Audio-Visual Source Localization. Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications - M2SFA2 2008, Oct 2008, Marseille, France. 2008. 〈inria-00326742〉

Partager

Métriques

Consultations de la notice

88

Téléchargements de fichiers

63