Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata

Nathalie Bertrand 1 Thomas Brihaye 2 Blaise Genest 1
1 SUMO - SUpervision of large MOdular and distributed systems
Inria Rennes – Bretagne Atlantique , IRISA-D4 - LANGAGE ET GÉNIE LOGICIEL
Abstract : We consider reachability objectives on an extension of stochastic timed automata (STA) with nondeterminism. Decision stochastic timed automata (DSTA) are Markov decision processes based on timed automata where delays are chosen randomly and choices between enabled edges are nondeterministic. Given a reachability objective, the value 1 problem asks whether a target can be reached with probability arbitrary close to 1. Simple examples show that the value can be 1 and yet no strategy ensures reaching the target with probability 1. In this paper, we prove that, the value 1 problem is decidable for single clock DSTA by non-trivial reduction to a simple almost-sure reachability problem on a finite Markov decision process. The ε-optimal strategies are involved: the precise probability distributions, even if they do not change the winning nature of a state, impact the timings at which ε-optimal strategies must change their decisions, and more surprisingly these timings cannot be chosen uniformly over the set of regions.
Document type :
Conference papers
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download

https://hal.inria.fr/hal-01088113
Contributor : Nathalie Bertrand <>
Submitted on : Thursday, November 27, 2014 - 2:15:48 PM
Last modification on : Tuesday, February 12, 2019 - 12:06:02 PM
Long-term archiving on : Monday, March 2, 2015 - 9:23:59 AM

File

paper44.pdf
Files produced by the author(s)

Identifiers

Citation

Nathalie Bertrand, Thomas Brihaye, Blaise Genest. Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata. Quantitative Evaluation of Systems (QEST'14), Sep 2014, Florence, Italy. pp.313 - 328, ⟨10.1007/978-3-319-10696-0_25⟩. ⟨hal-01088113⟩

Share

Metrics

Record views

349

Files downloads

150