Skip to Main content Skip to Navigation

Unsupervised Segmentation Incorporating Colour, Texture, and Motion

Thomas Brox 1 Mikaël Rousson Rachid Deriche Joachim Weickert
1 ODYSSEE - Computer and biological vision
DI-ENS - Département d'informatique de l'École normale supérieure, CRISAM - Inria Sophia Antipolis - Méditerranée , ENS Paris - École normale supérieure - Paris, Inria Paris-Rocquencourt, ENPC - École des Ponts ParisTech
Abstract : In this paper we incorporate different kinds of information, namely colour, texture, and motion, into a segmentation process. The segmentation is based on a variational framework for vector-valued data using a level set approach and a statistical model to describe the interior and the complement of a region. It is assumed here that there are only two regions in the image, basically one object and the background. In order to obtain appropriate texture features, we apply the idea of the nonlinear structure tensor, which turns out to have very good discrimination properties while inducing only three feature channels. The spatio-temporal version of the nonlinear structure tensor is also used to estimate the optic flow as the feature for motion. Before the actual segmentation process, the features are presmooth- ed by a novel nonlinear diffusion technique closely related to TV flow, but being strictly edge enhancing. The coupling between the channels hereby ensures the enhancement of edges at joint positions in all channels. This kind of presmoothing works well together with the statistical model we use, namely nonparametric Parzen density estimates. We also consider multi-scale segmentation in order to speed up the process and to obtain more robust results.Furthermore, it is shown that our method can not only be applied to segment images but also to track moving objects. The tracking of several moving objects is taken into account, where a coupling between the object regions allows to track also partly occluded objects.Our method has been verified in several experiments using synthetic as well as real image data. There we checked the importance of the different kinds of information for obtaining good results. Finally, also the limitations of our approach are described and shown in some examples.
Document type :
Complete list of metadata

Cited literature [64 references]  Display  Hide  Download
Contributor : Rapport de Recherche Inria <>
Submitted on : Tuesday, May 23, 2006 - 6:54:39 PM
Last modification on : Tuesday, September 22, 2020 - 3:57:57 AM
Long-term archiving on: : Sunday, April 4, 2010 - 10:40:00 PM


  • HAL Id : inria-00071826, version 1



Thomas Brox, Mikaël Rousson, Rachid Deriche, Joachim Weickert. Unsupervised Segmentation Incorporating Colour, Texture, and Motion. RR-4760, INRIA. 2003. ⟨inria-00071826⟩



Record views


Files downloads