Heuristics for Efficiently Calculating Jacobians by Edge Elimination in Computational Graphs - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport Année : 1999

Heuristics for Efficiently Calculating Jacobians by Edge Elimination in Computational Graphs

Résumé

The chain rule - fundamental for Automatic Differentiation (AD) - can be applied to computational graphs representing vector functions in arbitrary orders resulting in different operations counts for the calculation of their Jacobian matrices. Very few authors have looked at this interesting subject so far and there is no generally accepted terminology for dealing with these combinations of the forward and reverse modes of AD. The minimizati- on of the number of arithmetic operations required for the calculation of the complete Jacobian leads to a computationally hard combinatorial optimization problem. After an extensive introduction into the problem of computing Jacobians using a minimal number of arithmetic operations we will describe several heuristics for reducing the size the computational graph as well as for solving the edge elimination problem in computational graphs. We will discuss the ideas behind the heuristics and present some test results. Finally we will give an outlook on the role that edge eliminatio- n could play in the development of new AD tools.

Domaines

Autre [cs.OH]
Fichier principal
Vignette du fichier
RR-3690.pdf (577.4 Ko) Télécharger le fichier

Dates et versions

inria-00072979 , version 1 (24-05-2006)

Identifiants

  • HAL Id : inria-00072979 , version 1

Citer

Uwe Naumann. Heuristics for Efficiently Calculating Jacobians by Edge Elimination in Computational Graphs. RR-3690, INRIA. 1999. ⟨inria-00072979⟩
51 Consultations
135 Téléchargements

Partager

Gmail Facebook X LinkedIn More