A Framework for Efficient Structured Max-Margin Learning of High-Order MRF Models

Abstract : We present a very general algorithm for structured prediction learning that is able to efficiently handle discrete MRFs/CRFs (including both pairwise and higher-order models) so long as they can admit a decomposition into tractable subproblems. At its core, it relies on a dual decomposition principle that has been recently employed in the task of MRF optimization. By properly combining such an approach with a max-margin learning method, the proposed framework manages to reduce the training of a complex high-order MRF to the parallel training of a series of simple slave MRFs that are much easier to handle. This leads to a very efficient and general learning scheme that relies on solid mathematical principles. We thoroughly analyze its theoretical properties, and also show that it can yield learning algorithms of increasing accuracy since it naturally allows a hierarchy of convex relaxations to be used for loss-augmented MAP-MRF inference within a max-margin learning approach. Furthermore, it can be easily adapted to take advantage of the special structure that may be present in a given class of MRFs. We demonstrate the generality and flexibility of our approach by testing it on a variety of scenarios, including training of pairwise and higher-order MRFs, training by using different types of regularizers and/or different types of dissimilarity loss functions, as well as by learning of appropriate models for a variety of vision tasks (including high-order models for compact pose-invariant shape priors, knowledge-based segmentation, image denoising, stereo matching as well as high-order Potts MRFs).
Document type :
Reports
Complete list of metadatas

Cited literature [69 references]  Display  Hide  Download

https://hal.inria.fr/hal-01090971
Contributor : Alexandra Merlin <>
Submitted on : Sunday, January 4, 2015 - 5:29:15 PM
Last modification on : Monday, April 1, 2019 - 4:45:02 PM
Long-term archiving on : Thursday, September 10, 2015 - 11:20:36 PM

File

RR-8645.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01090971, version 1

Relations

Citation

Nikos Komodakis, Bo Xiang, Nikos Paragios. A Framework for Efficient Structured Max-Margin Learning of High-Order MRF Models. [Research Report] RR-8645, Ecole de Ponts-ParisTech; Ecole Centrale de Paris; Inria Saclay Ile de France; INRIA. 2014, pp.1 - 34. ⟨hal-01090971⟩

Share

Metrics

Record views

924

Files downloads

515