Adaptive Markov Control Processes

This book is concerned with a class of discrete-time stochastic control processes known as controlled Markov processes (CMP''s), also known as Markov decision processes or Markov dynamic programs. Starting in the mid-1950swith Richard Bellman, many contributions to CMP''s have been made, and applications to engineering, statistics and operations research, among other areas, have also been develope...