We examine discrete-time optimal control problems with general, possibly non-linear or non-smooth dynamic equations, and state-control inequality and equality constraints. A new generalized convexity condition for the dynamics and constraints is defined, and it is proved that this property, together with a constraint qualification constitute sufficient conditions for the strong Lagrange duality result and saddle-point optimality conditions for the problem. The discrete maximum principle of Pontryagin is obtained in a straightforward manner from the strong Lagrange duality theorem, first in a new form in which the Lagrangian is minimized both with respect to the state and to the control variables. Assuming differentiability, the maximum principle is obtained in the usual form. It is shown that dynamic systems satisfying a global controllability condition with convex costs, have the required convexity property. This controllability condition is a natural extension of the customary directional convexity condition applied in the derivation of the discrete maximum principle for local optima in the literature.
Mots-clés : Optimal control, discrete time, Lagrange duality, Pontryagin discrete maximum principle, convexity condition, non-linear dynamics, controllability
@article{COCV_2019__25__A20_0, author = {Tamminen, Eero V.}, title = {Strong {Lagrange} duality and the maximum principle for nonlinear discrete time optimal control problems}, journal = {ESAIM: Control, Optimisation and Calculus of Variations}, publisher = {EDP-Sciences}, volume = {25}, year = {2019}, doi = {10.1051/cocv/2018012}, zbl = {1442.49044}, mrnumber = {3982965}, language = {en}, url = {http://www.numdam.org/articles/10.1051/cocv/2018012/} }
TY - JOUR AU - Tamminen, Eero V. TI - Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2019 VL - 25 PB - EDP-Sciences UR - http://www.numdam.org/articles/10.1051/cocv/2018012/ DO - 10.1051/cocv/2018012 LA - en ID - COCV_2019__25__A20_0 ER -
%0 Journal Article %A Tamminen, Eero V. %T Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems %J ESAIM: Control, Optimisation and Calculus of Variations %D 2019 %V 25 %I EDP-Sciences %U http://www.numdam.org/articles/10.1051/cocv/2018012/ %R 10.1051/cocv/2018012 %G en %F COCV_2019__25__A20_0
Tamminen, Eero V. Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems. ESAIM: Control, Optimisation and Calculus of Variations, Tome 25 (2019), article no. 20. doi : 10.1051/cocv/2018012. http://www.numdam.org/articles/10.1051/cocv/2018012/
[1] Nonlinear Programming: Theory and Algorithms, John Wiley & Sons, New York (2006) | DOI | MR | Zbl
, and ,[2] Optimal Control of Discrete Systems, John Wiley & Sons, New York, Toronto, Ontario (1978) | MR
,[3] Pontryagin maximum principle for finite dimensional nonlinear optimal control problems on time scales. SIAM J. Control Optim. 51 (2013) 3781–3813 | DOI | MR | Zbl
and ,[4] Optimal sampled-data control, and generalizations on time-scales. Math. Control Related Fields 6 (2016) 53–94 | DOI | MR | Zbl
and ,[5] Theory of Optimal Control and Mathematical Programming, McGraw-Hill, New York (1970) | MR | Zbl
, and ,[6] Optimization and Nonsmooth Analysis. Republished by Université de Montréal, Montréal 1990 John Wiley & Sons, New York (1983). | MR | Zbl
,[7] Optimality conditions for some nonconvex problems, in Optimization Techniques, Part 2, edited by , , , Springer, Berlin (1980) 1–9 | MR | Zbl
and ,[8] Theorems of the alternative and optimality conditions. J. Optim. Theory Appl. 42 (1984) 331–365 | DOI | MR | Zbl
,[9] Theorems of the alternative for multifunctions with applications to optimization: general results. J. Optim. Theory Appl. 55 (1987) 233–256 | DOI | MR | Zbl
,[10] Lagrange duality theory for convex control problrms. SIAM J. Control Optim. 14 (1976) 843–856 | DOI | MR | Zbl
and ,[11] Optimal control for systems described by difference equations, in Advances in Control Systems: Theory and Applications, Academic Press, New York (1964) 173–196 | MR
,[12] A Maximum principle of the Pontryagin type for systems described by nonlinear difference equations. J. SIAM Control 4 (1966) 90–111 | DOI | MR | Zbl
,[13] Perfect duality for convexlike programs. J. Optim. Theory Appl. 38 (1982) 179–189 | DOI | MR | Zbl
and ,[14] Convexity and the maximum principle for discrete systems. IEEE Trans. Autom. Control 11 (1966) 30–35 | DOI | MR
,[15] On the maximum principle for nonlinear discrete-time systems. IEEE Trans. Autom. Control 11 (1966) 273–274 | DOI
,[16] Directional convexity and the maximum principle for discrete systems. J. SIAM Control 4 (1966) 263–275 | DOI | MR | Zbl
and ,[17] Theorems of the alternative and optimality conditions for convexlike and general convexlike programming. J. Optim. Theory Appl. 101 (1999) 243–57 | DOI | MR | Zbl
and ,[18] Theory of Extremal Problems, North-Holland, Amsterdam (1979) | MR | Zbl
and[19] Duality relations in dynamic linear programming. Autom. Remote Control 34 (1973) 1945–1952 | MR | Zbl
and ,[20] Convexlike alternative theorems and mathematical programming. Optimization 16 (1985) 643–652 | DOI | MR | Zbl
,[21] Lagrangian multipliers, saddle points, and duality in vector optimization of set-valued maps. J. Math. Anal. Appl. 215 (1997) 297–316 | DOI | MR | Zbl
and ,[22] Optimization by Vector Space Methods. John Wiley & Sons, New York (1969) | MR | Zbl
,[23] Variational Analysis and Generalized Differentiation. Springer-Verlag, Berlin (2006) | MR | Zbl
,[24] Some general separation theorems. Math. Nachr. 84 (1978) 319–327 | DOI | MR | Zbl
,[25] Discrete maximum principle with state constrained control. J. SIAM Control 15 (1977) 984–990 | DOI | MR | Zbl
and ,[26] The Mathematical Theory of Optimal Processes. John Wiley & Sons, New York (1962) | MR | Zbl
, , and ,[27] The maximum principle for discrete systems. Autom. Remote Control 26 (1965) 1169–1177 | MR | Zbl
,[28] Discrete control problems with phase constraints. Zh. Vychisl. Mat. Mat. Fiz. 12 (1972) 1128–1144 | MR | Zbl
,[29] Hamiltonian trajectories and duality in the optimal control of linear systems with convex costs. SIAM J. Control Optim. 27 (1989) 1007–1025 | DOI | MR | Zbl
,[30] Lagrange multipliers and optimality. SIAM Rev. 35 (1993) 183–238 | DOI | MR | Zbl
,[31] Variational Analysis. Springer-Verlag, Berlin (1998) | DOI | MR | Zbl
and[32] Optimal Control Theory, 2nd edn. Kluwer Academic Publishers, Boston, MA (2000) | MR | Zbl
and[33] Abstract Kuhn-Tucker theorems. J. Optim. Theory Appl. 58 (1988) 147–152 | DOI | MR | Zbl
,[34] Sufficient conditions for the existence of multipliers and Lagrangian duality in abstract optimization problems. J. Optim. Theory Appl. 82 (1994) 93–104 | DOI | MR | Zbl
,[35] Saddle-point-type optimality conditions and Lagrangian-type duality for a class of constrained generalized fractional optimal control problems. Optimization 44 (1998) 351–372 | DOI | MR | Zbl
,Cité par Sources :