Analysing domain shift factors between videos and images for object detection

Vicky Kalogeiton 1, 2 Vittorio Ferrari 1 Cordelia Schmid 2
1 CALVIN research group [Edinburgh]
IPAB - Institute of Perception, Action and Behaviour
2 Thoth - Apprentissage de modèles à partir de données massives
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
Abstract : Object detection is one of the most important challenges in computer vision. Object detectors are usually trained on bounding-boxes from still images. Recently, video has been used as an alternative source of data. Yet, for a given test domain (image or video), the performance of the detector depends on the domain it was trained on. In this paper, we examine the reasons behind this performance gap. We define and evaluate different domain shift factors: spatial location accuracy, appearance diversity, image quality and aspect distribution. We examine the impact of these factors by comparing performance before and after factoring them out. The results show that all four factors affect the performance of the detectors and their combined effect explains nearly the whole performance gap.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

https://hal.inria.fr/hal-01281069
Contributor : Thoth Team <>
Submitted on : Tuesday, March 1, 2016 - 3:48:58 PM
Last modification on : Friday, February 8, 2019 - 2:49:18 PM
Long-term archiving on: Thursday, June 2, 2016 - 10:37:18 AM

File

vicky_ArXiv_January_2016_Analy...
Files produced by the author(s)

Identifiers

Citation

Vicky Kalogeiton, Vittorio Ferrari, Cordelia Schmid. Analysing domain shift factors between videos and images for object detection. 2016. ⟨hal-01281069v1⟩

Share

Metrics

Record views

198

Files downloads

144