Numerical Methods for Controlled Stochastic Delay Systems

The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays and is the first book on the subject. Featuring numerical algorithms and examples with applications to control and modern communications systems, the book will be of great interest to all those...