Approximate Inverse Ising models close to a Bethe Reference Point

Cyril Furtlehner 1
1 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : We investigate different ways of generating approximate solutions to the inverse Ising problem. Our approach consists in to take as a starting point for further perturbation procedures, a Bethe mean-field solution obtained with a maximum spanning tree of pairwise mutual information which we refer to as the "Bethe reference point". We consider three different ways of following this idea: in the first one, we discuss a greedy procedure by which optimal links to be added starting from the Bethe reference point are selected and calibrated iteratively; the second one is based on the observation that the natural gradient can be computed analytically at the Bethe point; the last one deals with loop corrections to the Bethe point. Assuming no external field and using a dual transform we develop a dual loop joint model based on a well-chosen cycle basis. This leads us to identify a subclass of planar models, which we refer to as \emph{dual-loop-free models}, having possibly many loops, but characterized by a singly connected dual factor graph, for which the partition function and the linear response can be computed exactly in respectively O(N) and O(N^2) operations, thanks to a dual weight propagation message passing procedure that we set up. When restricted to this subclass of models, the inverse Ising problem being convex, becomes tractable at any temperature. Numerical experiments show that this can serve to some extent as a good approximation for models with dual loops.
Type de document :
Article dans une revue
Journal of Statistical Mechanics: Theory and Experiment, IOP Science, 2013, Volume2013, pp.P09020. 〈10.1088/1742-5468/2013/09/P09020〉
Liste complète des métadonnées

Littérature citée [39 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00865085
Contributeur : Cyril Furtlehner <>
Soumis le : lundi 23 septembre 2013 - 17:46:03
Dernière modification le : jeudi 5 avril 2018 - 12:30:12
Document(s) archivé(s) le : mardi 24 décembre 2013 - 04:34:45

Fichier

jstatmech.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Cyril Furtlehner. Approximate Inverse Ising models close to a Bethe Reference Point. Journal of Statistical Mechanics: Theory and Experiment, IOP Science, 2013, Volume2013, pp.P09020. 〈10.1088/1742-5468/2013/09/P09020〉. 〈hal-00865085〉

Partager

Métriques

Consultations de la notice

298

Téléchargements de fichiers

222