Turnpike Phenomenon for Markov Decision Processes

This book provides a comprehensive examination of the structure of approximate optimal policies in Markov decision processes (MDPs) with finite state spaces, as well as approximate optimal solutions for deterministic discrete-time optimal control problems. At its core, the monograph delves into the turnpike property, a concept introduced by P. Samuelson, which suggests that optimal solutions are l...