Markov Decision Processes
White, Karen WhiteBooks.org participates in affiliate programs including Bookshop.org and the Amazon Services LLC Associates Program. We may earn a commission from qualifying purchases made through links on this page, at no additional cost to you.
Overview
Examines several fundamentals concerning the manner in which Markov decision problems may be properly formulated and the determination of solutions or their properties. Coverage includes optimal equations, algorithms and their characteristics, probability distributions, modern development in the Markov decision process area, namely structural policy analysis, approximation modeling, multiple objectives and Markov games. Copiously illustrated with examples.
Synopsis
Examines several fundamentals concerning the manner in which Markov decision problems may be properly formulated and the determination of solutions or their properties. Coverage includes optimal equations, algorithms and their characteristics, probability distributions, modern development in the Markov decision process area, namely structural policy analysis, approximation modeling, multiple objectives and Markov games. Copiously illustrated with examples.
Booknews
A basic text covering some of the fundamentals of formulating and solving Markov decision problems, for graduate students with a moderate mathematical background who are learning to apply statistics in operational research, management science, systems engineering and related fields. Could also be used in an advanced undergraduate mathematics or statistics course. Annotation c. Book News, Inc., Portland, OR (booknews.com)