Foundations of Average-Cost Nonhomogeneous Controlled Markov Chains

This Springer brief addresses the challenges encountered in the study of  the optimization of time-nonhomogeneous Markov chains. It develops new insights and new methodologies for systems in which concepts such as stationarity, ergodicity, periodicity and connectivity do not apply.

This brief introduces the novel concept of confluencity and applies a relative optimization approach. It develops a co...