A Formal Proof of the Expressiveness of Deep Learning

Abstract : Deep learning has had a profound impact on computer science in recent years, with applications to image recognition, language processing, bioinformatics, and more. Recently, Cohen et al. provided theoretical evidence for the superiority of deep learning over shallow learning. We formalized their mathematical proof using Isabelle/HOL. The Isabelle development simplifies and generalizes the original proof, while working around the limitations of the HOL type system. To support the formalization, we developed reusable libraries of formalized mathematics, including results about the matrix rank, the Borel measure, and multivariate polynomials as well as a library for tensor analysis.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/hal-01599172
Contributor : Jasmin Christian Blanchette <>
Submitted on : Sunday, October 1, 2017 - 6:49:15 PM
Last modification on : Tuesday, February 19, 2019 - 3:40:04 PM

File

paper.pdf
Files produced by the author(s)

Identifiers

Citation

Alexander Bentkamp, Jasmin Christian Blanchette, Dietrich Klakow. A Formal Proof of the Expressiveness of Deep Learning. ITP 2017: 8th International Conference on Interactive Theorem Proving, Sep 2017, Brasilia, Brazil. ⟨10.1007/3-540-48256-3_12⟩. ⟨hal-01599172⟩

Share

Metrics

Record views

214

Files downloads

129