Skip to main content

Numerical Methods of Simulation and Optimization of Piecewise Deterministic Markov Processes: Application to Reliability

Numerical Methods of Simulation and Optimization of Piecewise Deterministic Markov Processes: Application to Reliability

Benoîte de Saporta, François Dufour, Huilong Zhang

ISBN: 978-1-848-21794-2

Jul 2015, Wiley-ISTE

150 pages

Select type: Hardcover

$105.00

Product not available for purchase

Description

This book is focused on theoretical and numerical aspects of simulation of expectations of functionals and resolution of optimization problems for piecewise deterministic Markov processes.

This book deals with theoretical and numerical aspects of simulation and optimization for piecewise deterministic Markov processes (PDMP's). PDMP's form a general class of stochastic hybrid models covering a large number of problems such as engineering systems, operation research, economics, management science, biology, internet traffic, networks and reliability. This book is focused on the computation of expectation of functionals of PDMP's with applications to the evaluation of service times and on solving optimal control problems with applications to maintenance optimization.

The class of piecewise deterministic Markov processes (PDMP's) is considered and recognized as a powerful modelling tool for complex systems. However, surprisingly few works are devoted to the development of numerical methods for PDMP's to solve problems of practical importance such as evaluation and optimization of functionals of the process. The main objective of this book consists in presenting mathematical tools recently developed by the authors to address such problems.

Part I: Piecewise deterministic Markov processes and quantization

1 Piecewise deterministic Markov processes

2 Quantization technique

3 Discretization of piecewise deterministic Markov processes

4 Examples in reliability

Part II: Simulation of functionals

1 Expectation

2 Exit time

3 Example in reliability: service time

Part III: Optimization

1 Optimal stopping

2 Optimal impulse control

3 Example in reliability: maintenance optimization