Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems
ESAIM: Control, Optimisation and Calculus of Variations, Tome 25 (2019), article no. 20.

We examine discrete-time optimal control problems with general, possibly non-linear or non-smooth dynamic equations, and state-control inequality and equality constraints. A new generalized convexity condition for the dynamics and constraints is defined, and it is proved that this property, together with a constraint qualification constitute sufficient conditions for the strong Lagrange duality result and saddle-point optimality conditions for the problem. The discrete maximum principle of Pontryagin is obtained in a straightforward manner from the strong Lagrange duality theorem, first in a new form in which the Lagrangian is minimized both with respect to the state and to the control variables. Assuming differentiability, the maximum principle is obtained in the usual form. It is shown that dynamic systems satisfying a global controllability condition with convex costs, have the required convexity property. This controllability condition is a natural extension of the customary directional convexity condition applied in the derivation of the discrete maximum principle for local optima in the literature.

DOI : 10.1051/cocv/2018012
Classification : 90C46, 93C55
Mots-clés : Optimal control, discrete time, Lagrange duality, Pontryagin discrete maximum principle, convexity condition, non-linear dynamics, controllability
Tamminen, Eero V. 1

1
@article{COCV_2019__25__A20_0,
     author = {Tamminen, Eero V.},
     title = {Strong {Lagrange} duality and the maximum principle for nonlinear discrete time optimal control problems},
     journal = {ESAIM: Control, Optimisation and Calculus of Variations},
     publisher = {EDP-Sciences},
     volume = {25},
     year = {2019},
     doi = {10.1051/cocv/2018012},
     zbl = {1442.49044},
     mrnumber = {3982965},
     language = {en},
     url = {http://www.numdam.org/articles/10.1051/cocv/2018012/}
}
TY  - JOUR
AU  - Tamminen, Eero V.
TI  - Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems
JO  - ESAIM: Control, Optimisation and Calculus of Variations
PY  - 2019
VL  - 25
PB  - EDP-Sciences
UR  - http://www.numdam.org/articles/10.1051/cocv/2018012/
DO  - 10.1051/cocv/2018012
LA  - en
ID  - COCV_2019__25__A20_0
ER  - 
%0 Journal Article
%A Tamminen, Eero V.
%T Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems
%J ESAIM: Control, Optimisation and Calculus of Variations
%D 2019
%V 25
%I EDP-Sciences
%U http://www.numdam.org/articles/10.1051/cocv/2018012/
%R 10.1051/cocv/2018012
%G en
%F COCV_2019__25__A20_0
Tamminen, Eero V. Strong Lagrange duality and the maximum principle for nonlinear discrete time optimal control problems. ESAIM: Control, Optimisation and Calculus of Variations, Tome 25 (2019), article no. 20. doi : 10.1051/cocv/2018012. http://www.numdam.org/articles/10.1051/cocv/2018012/

[1] M.S. Bazaraa, H.D. Sherali and C.M. Shetty, Nonlinear Programming: Theory and Algorithms, John Wiley & Sons, New York (2006) | DOI | MR | Zbl

[2] V.G. Boltyanskii, Optimal Control of Discrete Systems, John Wiley & Sons, New York, Toronto, Ontario (1978) | MR

[3] L. Bourdin and E. Trélat, Pontryagin maximum principle for finite dimensional nonlinear optimal control problems on time scales. SIAM J. Control Optim. 51 (2013) 3781–3813 | DOI | MR | Zbl

[4] L. Bourdin and E. Trélat, Optimal sampled-data control, and generalizations on time-scales. Math. Control Related Fields 6 (2016) 53–94 | DOI | MR | Zbl

[5] M.D. Canon, C. Cullum and E. Polak, Theory of Optimal Control and Mathematical Programming, McGraw-Hill, New York (1970) | MR | Zbl

[6] F.C. Clarke, Optimization and Nonsmooth Analysis. Republished by Université de Montréal, Montréal 1990 John Wiley & Sons, New York (1983). | MR | Zbl

[7] K.H. Elster and R. Nehse, Optimality conditions for some nonconvex problems, in Optimization Techniques, Part 2, edited by K. Iracki, K. Malanowski, S. Walukiewicz, Springer, Berlin (1980) 1–9 | MR | Zbl

[8] F. Giannessi, Theorems of the alternative and optimality conditions. J. Optim. Theory Appl. 42 (1984) 331–365 | DOI | MR | Zbl

[9] F. Giannessi, Theorems of the alternative for multifunctions with applications to optimization: general results. J. Optim. Theory Appl. 55 (1987) 233–256 | DOI | MR | Zbl

[10] W.W. Hager and S.K. Mitter, Lagrange duality theory for convex control problrms. SIAM J. Control Optim. 14 (1976) 843–856 | DOI | MR | Zbl

[11] H. Halkin, Optimal control for systems described by difference equations, in Advances in Control Systems: Theory and Applications, Academic Press, New York (1964) 173–196 | MR

[12] H. Halkin, A Maximum principle of the Pontryagin type for systems described by nonlinear difference equations. J. SIAM Control 4 (1966) 90–111 | DOI | MR | Zbl

[13] M. Hayashi and H. Komiya, Perfect duality for convexlike programs. J. Optim. Theory Appl. 38 (1982) 179–189 | DOI | MR | Zbl

[14] J.M. Holtzman, Convexity and the maximum principle for discrete systems. IEEE Trans. Autom. Control 11 (1966) 30–35 | DOI | MR

[15] J.M. Holtzman, On the maximum principle for nonlinear discrete-time systems. IEEE Trans. Autom. Control 11 (1966) 273–274 | DOI

[16] J.M. Holtzman and H. Halkin, Directional convexity and the maximum principle for discrete systems. J. SIAM Control 4 (1966) 263–275 | DOI | MR | Zbl

[17] T. Illés and G. Kassay, Theorems of the alternative and optimality conditions for convexlike and general convexlike programming. J. Optim. Theory Appl. 101 (1999) 243–57 | DOI | MR | Zbl

[18] A.D. Ioffe and V.M. Tihomirov. Theory of Extremal Problems, North-Holland, Amsterdam (1979) | MR | Zbl

[19] Y.P. Ivanilov and A.I. Propoi, Duality relations in dynamic linear programming. Autom. Remote Control 34 (1973) 1945–1952 | MR | Zbl

[20] V. Jeyakumar, Convexlike alternative theorems and mathematical programming. Optimization 16 (1985) 643–652 | DOI | MR | Zbl

[21] Z. Li and G. Chen, Lagrangian multipliers, saddle points, and duality in vector optimization of set-valued maps. J. Math. Anal. Appl. 215 (1997) 297–316 | DOI | MR | Zbl

[22] D.G. Luenberger, Optimization by Vector Space Methods. John Wiley & Sons, New York (1969) | MR | Zbl

[23] B.S. Mordukhovich, Variational Analysis and Generalized Differentiation. Springer-Verlag, Berlin (2006) | MR | Zbl

[24] R. Nehse, Some general separation theorems. Math. Nachr. 84 (1978) 319–327 | DOI | MR | Zbl

[25] J.A. Ortega and J.R. Leake, Discrete maximum principle with state constrained control. J. SIAM Control 15 (1977) 984–990 | DOI | MR | Zbl

[26] L.S. Pontryagin, V.G. Boltyanskii, R.V. Gamkrelidze and E.F. Mishchenko, The Mathematical Theory of Optimal Processes. John Wiley & Sons, New York (1962) | MR | Zbl

[27] A.I. Propoi, The maximum principle for discrete systems. Autom. Remote Control 26 (1965) 1169–1177 | MR | Zbl

[28] A.I. Propoi, Discrete control problems with phase constraints. Zh. Vychisl. Mat. Mat. Fiz. 12 (1972) 1128–1144 | MR | Zbl

[29] R.T. Rockafellar, Hamiltonian trajectories and duality in the optimal control of linear systems with convex costs. SIAM J. Control Optim. 27 (1989) 1007–1025 | DOI | MR | Zbl

[30] R.T. Rockafellar, Lagrange multipliers and optimality. SIAM Rev. 35 (1993) 183–238 | DOI | MR | Zbl

[31] R.T. Rockafellar and R.J.-B. Wets. Variational Analysis. Springer-Verlag, Berlin (1998) | DOI | MR | Zbl

[32] S.P. Sethi and G.L. Thompson. Optimal Control Theory, 2nd edn. Kluwer Academic Publishers, Boston, MA (2000) | MR | Zbl

[33] S. Simons, Abstract Kuhn-Tucker theorems. J. Optim. Theory Appl. 58 (1988) 147–152 | DOI | MR | Zbl

[34] E.V. Tamminen, Sufficient conditions for the existence of multipliers and Lagrangian duality in abstract optimization problems. J. Optim. Theory Appl. 82 (1994) 93–104 | DOI | MR | Zbl

[35] G.J. Zalmai, Saddle-point-type optimality conditions and Lagrangian-type duality for a class of constrained generalized fractional optimal control problems. Optimization 44 (1998) 351–372 | DOI | MR | Zbl

Cité par Sources :