K. S. Azoury and M. K. Warmuth, Relative loss bounds for on-line density estimation with the exponential family of distributions, Machine Learning, pp.211-246, 2001.

P. L. Bartlett, M. I. Jordan, and J. D. Mcauliffe, Convexity, Classification, and Risk Bounds, Journal of the American Statistical Association, vol.101, issue.473, pp.138-156, 2006.
DOI : 10.1198/016214505000000907

S. Boucheron, O. Bousquet, and G. Lugosi, Theory of Classification: a Survey of Some Recent Advances, ESAIM: Probability and Statistics, vol.9, pp.323-375, 2005.
DOI : 10.1051/ps:2005018
URL : https://hal.archives-ouvertes.fr/hal-00017923

R. Castro and R. D. Nowak, Minimax Bounds for Active Learning, IEEE Transactions on Information Theory, vol.54, issue.5, pp.2339-2353, 2008.
DOI : 10.1109/TIT.2008.920189

G. Cavallanti, N. Cesa-bianchi, and C. Gentile, Learning noisy linear classifiers via adaptive and??selective sampling, Machine Learning, vol.52, issue.1, 2009.
DOI : 10.1007/s10994-010-5191-x
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.329.8458

S. Dasgupta, A. T. Kalai, and C. Monteleoni, Analysis of Perceptron-Based Active Learning, Proceedings of the 18th Conference on Learning Theory (Colt 2005), pp.249-263, 2005.
DOI : 10.1007/11503415_17

Y. Freund, S. Seung, E. Shamir, and N. Tishby, Selective sampling using the Query by Committee algorithm, Machine Learning, pp.133-168, 1997.

I. Steinwart and C. Scovel, Fast rates for support vector machines using Gaussian kernels, The Annals of Statistics, vol.35, issue.2, pp.575-60, 2007.
DOI : 10.1214/009053606000001226

A. Tsybakov, Optimal aggregation of classifiers in statistical learning. The Annals of Statistics, pp.135-166, 2004.
URL : https://hal.archives-ouvertes.fr/hal-00102142

V. Vovk, Competitive On-line Statistics, International Statistical Review, vol.20, issue.2, pp.213-248, 2001.
DOI : 10.1093/comjnl/42.4.318
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.103.9745

Y. Ying and D. X. Zhou, Online Regularized Classification Algorithms, IEEE Transactions on Information Theory, vol.52, issue.11, pp.4775-4788, 2006.
DOI : 10.1109/TIT.2006.883632
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.97.2745