CaltechAUTHORS
  A Caltech Library Service

Temporal logic control of general Markov decision processes by approximate policy refinement

Haesaert, Sofie and Soudjani, Sadegh and Abate, Alessandro (2018) Temporal logic control of general Markov decision processes by approximate policy refinement. IFAC-PapersOnLine, 51 (16). pp. 73-78. ISSN 2405-8963. https://resolver.caltech.edu/CaltechAUTHORS:20180912-141109196

[img] PDF - Published Version
See Usage Policy.

562Kb

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20180912-141109196

Abstract

The formal verification and controller synthesis for general Markov decision processes (gMDPs) that evolve over uncountable state spaces are computationally hard and thus generally rely on the use of approximate abstractions. In this paper, we contribute to the state of the art of control synthesis for temporal logic properties by computing and quantifying a less conservative gridding of the continuous state space of linear stochastic dynamic systems and by giving a new approach for control synthesis and verification that is robust to the incurred approximation errors. The approximation errors are expressed as both deviations in the outputs of the gMDPs and in the probabilistic transitions.


Item Type:Article
Related URLs:
URLURL TypeDescription
https://doi.org/10.1016/j.ifacol.2018.08.013DOIArticle
Additional Information:© 2016, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. Available online 31 August 2018.
Issue or Number:16
Record Number:CaltechAUTHORS:20180912-141109196
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20180912-141109196
Official Citation:Sofie Haesaert, Sadegh Soudjani, Alessandro Abate, Temporal logic control of general Markov decision processes by approximate policy refinement, IFAC-PapersOnLine, Volume 51, Issue 16, 2018, Pages 73-78, ISSN 2405-8963, https://doi.org/10.1016/j.ifacol.2018.08.013. (http://www.sciencedirect.com/science/article/pii/S2405896318311261)
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:89584
Collection:CaltechAUTHORS
Deposited By: Tony Diaz
Deposited On:12 Sep 2018 21:31
Last Modified:03 Oct 2019 20:17

Repository Staff Only: item control page