Skip to Main content Skip to Navigation
New interface
Journal articles

Tree-structured CRF Models for Interactive Image Labeling

Thomas Mensink 1, 2, * Jakob Verbeek 1 Gabriela Csurka 2 
* Corresponding author
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : We propose structured prediction models for image labeling that explicitly take into account dependencies among image labels. In our tree structured models, image labels are nodes, and edges encode dependency relations. To allow for more complex dependencies, we combine labels in a single node, and use mixtures of trees. Our models are more expressive than independent predictors, and lead to more accurate label predictions. The gain becomes more significant in an interactive scenario where a user provides the value of some of the image labels at test time. Such an interactive scenario offers an interesting trade-off between label accuracy and manual labeling effort. The structured models are used to decide which labels should be set by the user, and transfer the user input to more accurate predictions on other image labels. We also apply our models to attribute-based image classification, where attribute predictions of a test image are mapped to class probabilities by means of a given attribute-class mapping. Experimental results on three publicly available benchmark data sets show that in all scenarios our structured models lead to more accurate predictions, and leverage user input much more effectively than state-of-the-art independent models.
Document type :
Journal articles
Complete list of metadata

Cited literature [34 references]  Display  Hide  Download
Contributor : THOTH Team Connect in order to contact the contributor
Submitted on : Monday, April 16, 2012 - 6:29:19 PM
Last modification on : Saturday, November 19, 2022 - 3:59:06 AM
Long-term archiving on: : Monday, November 26, 2012 - 2:50:23 PM


Files produced by the author(s)



Thomas Mensink, Jakob Verbeek, Gabriela Csurka. Tree-structured CRF Models for Interactive Image Labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35 (2), pp.476-489. ⟨10.1109/TPAMI.2012.100⟩. ⟨hal-00688143⟩



Record views


Files downloads