Skip to Main content Skip to Navigation
Journal articles

On the Bernstein-Hoeffding method

Christos Pelekis 1 Jan Ramon 2 Yuyi Wang 3
2 MAGNET - Machine Learning in Information Networks
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : We consider extensions of Hoeffding's " exponential method " approach for obtaining upper estimates on the probability that a sum of independent and bounded random variables is significantly larger than its mean. We show that the exponential function in Hoeffding's approach can be replaced with any function which is non-negative, increasing and convex. As a result we generalize and improve upon Hoeffding's inequality. Our approach allows to obtain " missing factors " in Hoeffding's inequality. The later result is a rather weaker version of a theorem that is due to Michel Talagrand. Moreover, we characterize the class of functions with respect to which our method yields optimal concentration bounds. Finally, using ideas from the theory of Bernstein polynomials, we show that similar ideas apply under information on higher moments of the random variables.
Complete list of metadata

Cited literature [26 references]  Display  Hide  Download
Contributor : Jan Ramon Connect in order to contact the contributor
Submitted on : Wednesday, June 13, 2018 - 1:32:57 PM
Last modification on : Friday, January 21, 2022 - 3:11:08 AM
Long-term archiving on: : Friday, September 14, 2018 - 3:11:54 PM


Files produced by the author(s)


  • HAL Id : hal-01814651, version 1


Christos Pelekis, Jan Ramon, Yuyi Wang. On the Bernstein-Hoeffding method. Bulletin of the Hellenic Mathematical Society, Hellenic Mathematical Society, 2018, 62, pp.31-43. ⟨hal-01814651⟩



Les métriques sont temporairement indisponibles