Probability Theory, Theoretical Physics, Mathematical Programming & Operations Research, Mathematical Equations - Differential

Stochastic Control of Hereditary Systems and Applications

Name: Stochastic Control of Hereditary Systems and Applications
Author: Chang, Mou-Hsiung
ISBN: 9781441926050

by Chang, Mou-Hsiung

Available on Bookshop Write a review

Books.org participates in affiliate programs including Bookshop.org and the Amazon Services LLC Associates Program. We may earn a commission from qualifying purchases made through links on this page, at no additional cost to you.

Overview

This monograph develops the Hamilton-Jacobi-Bellman theory via dynamic programming principle for a class of optimal control problems for shastic hereditary differential equations (SHDEs) driven by a standard Brownian motion and with a bounded or an infinite but fading memory. These equations represent a class of shastic infinite-dimensional systems that become increasingly important and have wide range of applications in physics, chemistry, biology, engineering and economics/finance. This monograph can be used as a reference for those who have special interest in optimal control theory and applications of shastic hereditary systems.

Synopsis

ThisresearchmonographdevelopstheHamilton-Jacobi-Bellman(HJB)theory viathedynamicprogrammingprincipleforaclassofoptimalcontrolproblems for stochastic hereditary di?erential equations (SHDEs) driven by a standard Brownian motion and with a bounded or an unbounded but fading m- ory. These equations represent a class of in?nite-dimensional stochastic s- tems that become increasingly important and have wide range of applications in physics, chemistry, biology, engineering, and economics/?nance. The wide applicability of these systems is due to the fact that the reaction of re- world systems to exogenous e?ects/signals is never “instantaneous” and it needs some time, time that can be translated into a mathematical language by some delay terms. Therefore, to describe these delayed e?ects, the drift and di?usion coe?cients of these stochastic equations depend not only on the current state but also explicitly on the past history of the state variable. The theory developed herein extends the ?nite-dimensional HJB theory of controlled di?usion processes to its in?nite-dimensional counterpart for c- trolledSHDEsinwhichacertainin?nite-dimensionalBanachspaceorHilbert space is critically involved in order to account for the bounded or unbounded memory. Another type of in?nite-dimensional HJB theory that is not treated in this monograph but arises from real-world application problems can often be modeled by controlled stochastic partial di?erential equations. Although they are both in?nite dimensional in nature and are both in the infancy of their developments, the SHDE exhibits many characteristics that are not in common with stochastic partial di?erential equations. Consequently, the HJB theory for controlled SHDEs is parallel to and cannot be treated as a subset of the theory developed for controlled stochastic partial di?erential equations.