Skip to Main content Skip to Navigation
Conference papers

Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata

Nathalie Bertrand 1 Thomas Brihaye 2 Blaise Genest 1 
1 SUMO - SUpervision of large MOdular and distributed systems
Inria Rennes – Bretagne Atlantique , IRISA-D4 - LANGAGE ET GÉNIE LOGICIEL
Abstract : We consider reachability objectives on an extension of stochastic timed automata (STA) with nondeterminism. Decision stochastic timed automata (DSTA) are Markov decision processes based on timed automata where delays are chosen randomly and choices between enabled edges are nondeterministic. Given a reachability objective, the value 1 problem asks whether a target can be reached with probability arbitrary close to 1. Simple examples show that the value can be 1 and yet no strategy ensures reaching the target with probability 1. In this paper, we prove that, the value 1 problem is decidable for single clock DSTA by non-trivial reduction to a simple almost-sure reachability problem on a finite Markov decision process. The ε-optimal strategies are involved: the precise probability distributions, even if they do not change the winning nature of a state, impact the timings at which ε-optimal strategies must change their decisions, and more surprisingly these timings cannot be chosen uniformly over the set of regions.
Document type :
Conference papers
Complete list of metadata

Cited literature [16 references]  Display  Hide  Download
Contributor : Nathalie Bertrand Connect in order to contact the contributor
Submitted on : Thursday, November 27, 2014 - 2:15:48 PM
Last modification on : Thursday, January 20, 2022 - 4:16:17 PM
Long-term archiving on: : Monday, March 2, 2015 - 9:23:59 AM


Files produced by the author(s)



Nathalie Bertrand, Thomas Brihaye, Blaise Genest. Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata. Quantitative Evaluation of Systems (QEST'14), Sep 2014, Florence, Italy. pp.313 - 328, ⟨10.1007/978-3-319-10696-0_25⟩. ⟨hal-01088113⟩



Record views


Files downloads