MODELING LATENT VARIABLE UNCERTAINTY FOR LOSS-BASED LEARNING

Abstract : We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation is modeled using latent variables. Previous methods overburden a single distribution with two separate tasks: (i) modeling the uncertainty in the latent variables during training; and (ii) making accurate predictions for the output and the latent variables during testing. We propose a novel framework that separates the demands of the two tasks using two distributions: (i) a conditional distribution to model the uncertainty of the latent variables for a given input-output pair; and (ii) a delta distribution to predict the output and the latent variables for a given input. During learning, we encourage agreement between the two distributions by minimizing a loss-based dissimilarity coefficient. Our approach generalizes latent SVM in two important ways: (i) it models the uncertainty over latent variables instead of relying on a pointwise estimate; and (ii) it allows the use of loss functions that depend on latent variables, which greatly increases its applicability. We demonstrate the efficacy of our approach on two challenging problems---object detection and action detection---using publicly available datasets.
Document type :
Conference papers
ICML, Jun 2012, Edinburgh, United Kingdom. 2012
Liste complète des métadonnées

Cited literature [14 references]  Display  Hide  Download

https://hal.inria.fr/hal-00773605
Contributor : M. Pawan Kumar <>
Submitted on : Monday, January 14, 2013 - 1:39:59 PM
Last modification on : Thursday, March 29, 2018 - 1:36:02 PM
Document(s) archivé(s) le : Monday, April 15, 2013 - 4:00:53 AM

File

KPK-ICML2012.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00773605, version 1

Collections

Citation

M. Pawan Kumar, Ben Packer, Daphne Koller. MODELING LATENT VARIABLE UNCERTAINTY FOR LOSS-BASED LEARNING. ICML, Jun 2012, Edinburgh, United Kingdom. 2012. 〈hal-00773605〉

Share

Metrics

Record views

218

Files downloads

153