J. Audibert, PAC-Bayesian statistical learning theory, 2004.

P. Auer, N. Cesa-bianchi, and C. Gentile, Adaptive and Self-Confident On-Line Learning Algorithms, Journal of Computer and System Sciences, vol.64, issue.1, pp.48-75, 2002.
DOI : 10.1006/jcss.2001.1795

O. Catoni, PAC-Bayesian Supervised Classification, Lecture Notes-Monograph Series. IMS, 2007.
DOI : 10.1007/978-3-319-21852-6_20

URL : https://hal.archives-ouvertes.fr/hal-00206119

N. Cesa-bianchi and G. Lugosi, Prediction, learning, and games, 2006.
DOI : 10.1017/CBO9780511546921

N. Cesa-bianchi, Y. Freund, D. Haussler, D. P. Helmbold, R. E. Schapire et al., How to use expert advice, Journal of the ACM, vol.44, issue.3, pp.427-485, 1997.
DOI : 10.1145/258128.258179

N. Cesa-bianchi, Y. Mansour, and G. Stoltz, Improved second-order bounds for prediction with expert advice, Machine Learning, pp.321-352, 2007.
URL : https://hal.archives-ouvertes.fr/hal-00019799

K. Chaudhuri, Y. Freund, and D. Hsu, A parameter-free hedging algorithm, Advances in Neural Information Processing Systems, pp.297-305, 2009.

V. Alexey, V. Chernov, and . Vovk, Prediction with advice of unknown number of experts, UAI, pp.117-125, 2010.

M. Devaine, P. Gaillard, Y. Goude, and G. Stoltz, Forecasting electricity consumption by aggregating specialized experts; a review of the sequential aggregation of specialized experts, with an application to Slovakian and French country-wide one-dayahead (half-)hourly predictions, Machine Learning, 2012.

Y. Freund and R. E. Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting, Journal of Computer and System Sciences, vol.55, issue.1, pp.119-139, 1997.
DOI : 10.1006/jcss.1997.1504

Y. Freund and R. E. Schapire, Adaptive Game Playing Using Multiplicative Weights, Games and Economic Behavior, vol.29, issue.1-2, pp.79-103, 1999.
DOI : 10.1006/game.1999.0738

S. Gerchinovitz, Prédiction de suites individuelles et cadre statistique classique: étude de quelques liens autour de la régression parcimonieuse et des techniques d'agrégation, 2011.

P. Grünwald, Safe learning: bridging the gap between Bayes, MDL and statistical learning theory via empirical convexity, Proceedings of the 24th International Conference on Learning Theory (COLT 2011), pp.551-573, 2011.

P. Grünwald, The Safe Bayesian, Proceedings of the 23rd International Conference on Algorithmic Learning Theory, p.2012, 2012.
DOI : 10.1007/978-3-642-34106-9_16

P. Grünwald and J. Langford, Suboptimal behavior of Bayes and MDL in classification under misspecification, Machine Learning, pp.119-149, 2007.

L. Györfi and G. Ottucsák, Sequential Prediction of Unbounded Stationary Time Series, IEEE Transactions on Information Theory, vol.53, issue.5, pp.1866-1872, 2007.
DOI : 10.1109/TIT.2007.894660

E. Hazan and S. Kale, Extracting certainty from uncertainty: regret bounded by??variation in??costs, Proceedings of the 21st Annual Conference on Learning Theory (COLT), pp.57-67, 2008.
DOI : 10.1007/s10994-010-5175-x

M. Hutter and J. Poland, Adaptive online prediction by following the perturbed leader, Journal of Machine Learning Research, vol.6, pp.639-660, 2005.

A. Kalai and S. Vempala, Efficient algorithms for online decision, Proceedings of the 16st Annual Conference on Learning Theory (COLT), pp.506-521, 2003.

Y. Kalnishkan and M. V. Vyugin, The weak aggregating algorithm and weak mixability, Proceedings of the 18th Annual Conference on Learning Theory (COLT), pp.188-203, 2005.

M. Wouter, M. K. Koolen, J. Warmuth, and . Kivinen, Hedging structured concepts, Proceedings of the 23rd Annual Conference on Learning Theory, pp.93-105, 2010.

N. Littlestone and M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation, vol.108, issue.2, pp.212-261, 1994.
DOI : 10.1006/inco.1994.1009

K. Tsuda, G. Rätsch, and M. K. Warmuth, Matrix exponentiated gradient updates for on-line learning and bregman projection, Journal of Machine Learning Research, vol.6, pp.995-1018, 2005.

T. Van-erven, P. Grünwald, M. Wouter, S. Koolen, and . De-rooij, Adaptive hedge, Advances in Neural Information Processing Systems, pp.1656-1664, 2011.

V. Vovk, A Game of Prediction with Expert Advice, Journal of Computer and System Sciences, vol.56, issue.2, pp.153-173, 1998.
DOI : 10.1006/jcss.1997.1556

V. Vovk, Competitive On-line Statistics, International Statistical Review, vol.20, issue.2, pp.213-248, 2001.
DOI : 10.1093/comjnl/42.4.318