Dynamic programming viscosity solution approach and its applications to optimal control problems

Bing Sun*, Zhen Zhen Tao, Yang Yang Wang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

7 Citations (Scopus)

Abstract

This chapter is concerned with optimal control problems of dynamical systems described by partial differential equations (PDEs). Firstly, using the Dubovitskii-Milyutin approach, we obtain the necessary condition of optimality, i.e., the Pontryagin maximum principle for optimal control problem of an age-structured population dynamics for spread of universally fatal diseases. Secondly, for an optimal birth control problem of a McKendrick type age-structured population dynamics, we establish the optimal feedback control laws by the dynamic programming viscosity solution (DPVS) approach. Finally, for a well-adapted upwind finite-difference numerical scheme for the HJB equation arising in optimal control, we prove its convergence and show that the solution from this finite-difference scheme converges to the value function of the associated optimal control problem.

Original languageEnglish
Title of host publicationStudies in Systems, Decision and Control
PublisherSpringer International Publishing
Pages363-420
Number of pages58
DOIs
Publication statusPublished - 2019

Publication series

NameStudies in Systems, Decision and Control
Volume200
ISSN (Print)2198-4182
ISSN (Electronic)2198-4190

Keywords

  • Convergence
  • Dynamic programming approach
  • Numerical solution
  • Optimal feedback control
  • Viscosity solution

Fingerprint

Dive into the research topics of 'Dynamic programming viscosity solution approach and its applications to optimal control problems'. Together they form a unique fingerprint.

Cite this