Improved Iterative Methods for Verifying Markov Decision Processes

Abstract : Value and policy iteration are powerful methods for verifying quantitative properties of Markov Decision Processes (MDPs). In order to accelerate these methods many approaches have been proposed. The performance of these methods depends on the graphical structure of MDPs. Experimental results show that they don’t work much better than normal value/policy iteration when the graph of the MDP is dense. In this paper we present an algorithm which tries to reduce the number of updates in dense MDPs. In this algorithm, instead of saving unnecessary updates we use graph partitioning method to have more important updates.
Type de document :
Communication dans un congrès
Mehdi Dastani; Marjan Sirjani. 6th Fundamentals of Software Engineering (FSEN), Apr 2015, Tehran, Iran. Springer, Lecture Notes in Computer Science, LNCS-9392, pp.207-214, 2015, Fundamentals of Software Engineering. 〈10.1007/978-3-319-24644-4_14〉
Liste complète des métadonnées

Littérature citée [9 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01446601
Contributeur : Hal Ifip <>
Soumis le : jeudi 26 janvier 2017 - 10:43:31
Dernière modification le : jeudi 26 janvier 2017 - 10:57:19
Document(s) archivé(s) le : vendredi 28 avril 2017 - 05:54:34

Fichier

978-3-319-24644-4_14_Chapter.p...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Jaber Karimpour, Ayaz Isazadeh, Mohammadsadegh Mohagheghi, Khayyam Salehi. Improved Iterative Methods for Verifying Markov Decision Processes. Mehdi Dastani; Marjan Sirjani. 6th Fundamentals of Software Engineering (FSEN), Apr 2015, Tehran, Iran. Springer, Lecture Notes in Computer Science, LNCS-9392, pp.207-214, 2015, Fundamentals of Software Engineering. 〈10.1007/978-3-319-24644-4_14〉. 〈hal-01446601〉

Partager

Métriques

Consultations de la notice

63

Téléchargements de fichiers

12