Optimal Policies Search for Sensor Management - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

Optimal Policies Search for Sensor Management

Emmanuel Duflos
  • Fonction : Auteur
  • PersonId : 844358
Pierre-Arnaud Coquelin
  • Fonction : Auteur
  • PersonId : 844357

Résumé

This paper introduces a new approach to solve sensor management problems. Classically sensor management problems can be well formalized as Partially-Observed Markov Decision Processes (POMPD). The original approach developped here consists in deriving the optimal parameterized policy based on a stochastic gradient estimation. We assume in this work that it is possible to learn the optimal policy off-line (in simulation ) using models of the environement and of the sensor(s). The learned policy can then be used to manage the sensor(s). In order to approximate the gradient in a stochastic context, we introduce a new method to approximate the gradient, based on Infinitesimal Perturbation Approximation (IPA). The effectiveness of this general framework is illustrated by the managing of an Electronically Scanned Array Radar. First simulations results are finally proposed.
Fichier principal
Vignette du fichier
Fusion2008_SensorManagement_EDuflos.pdf (131.95 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00368875 , version 1 (19-03-2009)

Identifiants

  • HAL Id : inria-00368875 , version 1
  • ARXIV : 0903.3329

Citer

Thomas Bréhard, Emmanuel Duflos, Philippe Vanheeghe, Pierre-Arnaud Coquelin. Optimal Policies Search for Sensor Management. FUSION 2008, Jun 2008, Cologne, Germany. pp.1 - 8. ⟨inria-00368875⟩
193 Consultations
101 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More