Efficient Optimization for Average Precision SVM

Abstract : The accuracy of information retrieval systems is often measured using average precision (AP). Given a set of positive (relevant) and negative (non-relevant) samples, the parameters of a retrieval system can be estimated using the AP-SVM framework, which minimizes a regularized convex upper bound on the empirical AP loss. However, the high computational complexity of loss-augmented inference, which is required for learning an AP-SVM, prohibits its use on large training datasets. To alleviate this deficiency, we propose three complementary approaches. The first approach guarantees an asymptotic decrease in the computational complexity of loss-augmented inference by exploiting the problem structure. The second approach takes advantage of the fact that we do not require a full ranking during loss-augmented inference. This helps us to avoid the expensive step of sorting the negative samples according to their individual scores. The third approach approximates the AP loss over all samples by the AP loss over difficult samples (for example, those that are incorrectly classified by a binary SVM), while ensuring the correct classification of the remaining samples. Using the PASCAL VOC action classification dataset, we show that our approaches provide significant speed-ups during training without degrading the test accuracy of AP-SVM.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/hal-01069917
Contributor : M. Pawan Kumar <>
Submitted on : Tuesday, September 30, 2014 - 11:01:54 AM
Last modification on : Thursday, February 7, 2019 - 5:29:22 PM
Long-term archiving on : Wednesday, December 31, 2014 - 10:36:19 AM

File

MJK-NIPS2014.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01069917, version 1

Collections

Citation

Pritish Mohapatra, C. V. Jawahar, M. Pawan Kumar. Efficient Optimization for Average Precision SVM. NIPS - Advances in Neural Information Processing Systems, 2014, Montreal, Canada. ⟨hal-01069917⟩

Share

Metrics

Record views

223

Files downloads

245