Stochastic optimal control problems governed by delay equations with delay in the control are usually more dicult to study than those in which the delay appears only in the state. This is particularly true when we look at the associated Hamilton{Jacobi{Bellman (HJB) equation. Indeed, even in the simplied setting (introduced rst by Vinter and Kwong [SIAM J. Control Optim., 19 (1981), pp. 139{153] for the deterministic case) the HJB equation is an innite-dimensional second order semilinear partial dierential equation that does not satisfy the so-called structure condition, which substantially means that the control can act on the system, modifying its dynamics at most along the same directions upon which the noise acts. The absence of such a condition|together with the lack of smoothing properties, a common feature of problems with delay|prevents the use of known techniques (based on backward stochastic dierential equations or on the smoothing properties of the linear part) to prove the existence of regular solutions of this HJB equation, and so no results in this direction have been proved till now. In this paper we provide a result on existence of regular solutions of HJB equations of this type. This opens the door to proving existence of optimal feedback controls, a task that will be accomplished in the companion paper [F. Gozzi and F. Masiero, SIAM J. Control Optim., 55 (2017), pp. 3013{3038]. The main tool used is a partial smoothing property that we prove for the transition semigroup associated to the uncontrolled problem. Such results hold for a specic class of equations and data which arise naturally in many applied problems.

Stochastic Optimal Control with Delay in the Control I: solution through partial smoothing / Gozzi, Fausto; Masiero, Federica. - In: SIAM JOURNAL ON CONTROL AND OPTIMIZATION. - ISSN 0363-0129. - 55:5(2017), pp. 2981-3012. [10.1137/16M1070128]

Stochastic Optimal Control with Delay in the Control I: solution through partial smoothing.

Fausto Gozzi;
2017

Abstract

Stochastic optimal control problems governed by delay equations with delay in the control are usually more dicult to study than those in which the delay appears only in the state. This is particularly true when we look at the associated Hamilton{Jacobi{Bellman (HJB) equation. Indeed, even in the simplied setting (introduced rst by Vinter and Kwong [SIAM J. Control Optim., 19 (1981), pp. 139{153] for the deterministic case) the HJB equation is an innite-dimensional second order semilinear partial dierential equation that does not satisfy the so-called structure condition, which substantially means that the control can act on the system, modifying its dynamics at most along the same directions upon which the noise acts. The absence of such a condition|together with the lack of smoothing properties, a common feature of problems with delay|prevents the use of known techniques (based on backward stochastic dierential equations or on the smoothing properties of the linear part) to prove the existence of regular solutions of this HJB equation, and so no results in this direction have been proved till now. In this paper we provide a result on existence of regular solutions of HJB equations of this type. This opens the door to proving existence of optimal feedback controls, a task that will be accomplished in the companion paper [F. Gozzi and F. Masiero, SIAM J. Control Optim., 55 (2017), pp. 3013{3038]. The main tool used is a partial smoothing property that we prove for the transition semigroup associated to the uncontrolled problem. Such results hold for a specic class of equations and data which arise naturally in many applied problems.
2017
Stochastic Optimal Control with Delay in the Control I: solution through partial smoothing / Gozzi, Fausto; Masiero, Federica. - In: SIAM JOURNAL ON CONTROL AND OPTIMIZATION. - ISSN 0363-0129. - 55:5(2017), pp. 2981-3012. [10.1137/16M1070128]
File in questo prodotto:
File Dimensione Formato  
FMFG1_CorrectedFMFG11Gen18.pdf

Solo gestori archivio

Tipologia: Documento in Post-print
Licenza: DRM (Digital rights management) non definiti
Dimensione 454.79 kB
Formato Adobe PDF
454.79 kB Adobe PDF   Visualizza/Apri
11385-178843.pdf

Solo gestori archivio

Tipologia: Versione dell'editore
Licenza: DRM (Digital rights management) non definiti
Dimensione 358.78 kB
Formato Adobe PDF
358.78 kB Adobe PDF   Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11385/178843
Citazioni
  • Scopus 18
  • ???jsp.display-item.citation.isi??? 19
social impact