On expansions for nonlinear systems Error estimates and convergence issues

Beauchard, Karine; Le Borgne, Jérémy; Marbach, Frédéric

Comptes Rendus. Mathématique, Tome 361 (2023) no. G1, pp. 97-189

Explicit formulas expressing the solution to non-autonomous differential equations are of great importance in many application domains such as control theory or numerical operator splitting. In particular, intrinsic formulas allowing to decouple time-dependent features from geometry-dependent features of the solution have been extensively studied.

First, we give a didactic review of classical expansions for formal linear differential equations, including the celebrated Magnus expansion (associated with coordinates of the first kind) and Sussmann’s infinite product expansion (associated with coordinates of the second kind). Inspired by quantum mechanics, we introduce a new mixed expansion, designed to isolate the role of a time-invariant drift from the role of a time-varying perturbation.

Second, in the context of nonlinear ordinary differential equations driven by regular vector fields, we give rigorous proofs of error estimates between the exact solution and finite approximations of the formal expansions. In particular, we derive new estimates focusing on the role of time-varying perturbations. For scalar-input systems, we derive new estimates involving only a weak Sobolev norm of the input.

Third, we investigate the local convergence of these expansions. We recall known positive results for nilpotent dynamics and for linear dynamics. Nevertheless, we also exhibit arbitrarily small analytic vector fields for which the convergence of the Magnus expansion fails, even in very weak senses. We state an open problem concerning the convergence of Sussmann’s infinite product expansion.

Eventually, we derive approximate direct intrinsic representations for the state and discuss their link with the choice of an appropriate change of coordinates.

[1] Abe, Eiichi Hopf algebras, Cambridge Tracts in Mathematics, 74, Cambridge University Press, 1980 | Zbl

[2] Achilles, Rüdiger; Bonfiglioli, Andrea The early proofs of the theorem of Campbell, Baker, Hausdorff, and Dynkin, Arch. Hist. Exact Sci., Volume 66 (2012) no. 3, pp. 295-358 | Zbl | MR | DOI

[3] Agračev, Andrei; Gamkrelidze, Revaz Exponential representation of flows and a chronological enumeration, Mat. Sb., N. Ser., Volume 107(149) (1978) no. 4, p. 467-532, 639 | Zbl | MR

[4] Agračev, Andrei; Gamkrelidze, Revaz Chronological algebras and nonstationary vector fields, Problems in geometry, Vol. 11 (Russian), Akad. Nauk SSSR, Vsesoyuz. Inst. Nauchn. i Tekhn. Informatsii, Moscow, 1980, p. 135-176, 243 | MR

[5] Agračev, Andrei; Sachkov, Yuri Control theory from the geometric viewpoint, Encyclopaedia of Mathematical Sciences, 87, Springer, 2004 | DOI | Zbl

[6] Al-Kaabi, Mahdi Jasim Hasan; Ebrahimi-Fard, Kurusch; Manchon, Dominique Post-Lie-Magnus expansion and BCH-recursion, SIGMA, Symmetry Integrability Geom. Methods Appl., Volume 18 (2022), 23 | MR | Zbl | DOI

[7] Arango, Jaime; Gómez, Adriana Flows and diffeomorphisms, Rev. Colomb. Mat., Volume 32 (1998) no. 1, pp. 13-27 | MR | Zbl

[8] Arango, Jaime; Gómez, Adriana Diffeomorphisms as time one maps, Aequationes Math., Volume 64 (2002) no. 3, pp. 304-314 | DOI | MR | Zbl

[9] Arfken, George; Weber, Hans; Harris, Frank Mathematical methods for physicists. A comprehensive guide, Elsevier; Academic Press, 2013 | Zbl

[10] Arnal, Ana; Casas, Fernando; Chiralt, Cristina A note on the Baker–Campbell–Hausdorff series in terms of right-nested commutators, Mediterr. J. Math., Volume 18 (2021) no. 2, 53 | MR | Zbl

[11] Baker, Henry Alternants and Continuous Groups, Proc. Lond. Math. Soc., Volume 3 (1905), pp. 24-47 | Zbl | MR | DOI

[12] Baudoin, Fabrice An introduction to the geometry of stochastic flows, Imperial College Press, 2004 | Zbl | MR | DOI

[13] Beauchard, Karine; Le Borgne, Jérémy; Marbach, Frédéric Growth of structure constants of free Lie algebras relative to Hall bases, J. Algebra, Volume 612 (2022), pp. 281-378 | MR | Zbl | DOI

[14] Beauchard, Karine; Marbach, Frédéric Quadratic obstructions to small-time local controllability for scalar-input systems, J. Differ. Equations, Volume 264 (2018) no. 5, pp. 3704-3774 | Zbl | MR | DOI

[15] Ben Arous, Gérard Flots et séries de Taylor stochastiques, Probab. Theory Relat. Fields, Volume 81 (1989) no. 1, pp. 29-77 | Zbl | MR | DOI

[16] Biagi, Stefano; Bonfiglioli, Andrea; Matone, Marco On the Baker–Campbell–Hausdorff Theorem: non-convergence and prolongation issues, Linear Multilinear Algebra (2018), pp. 1-19 | Zbl | DOI

[17] Bianchini, Rosa Maria; Stefani, Gianna Sufficient conditions of local controllability, 1986 25th IEEE Conference on Decision and Control, IEEE (1986), pp. 967-970 | Zbl | DOI

[18] Blanes, Sergio; Casas, Fernando On the convergence and optimization of the Baker-Campbell-Hausdorff formula, Linear Algebra Appl., Volume 378 (2004), pp. 135-158 | Zbl | MR | DOI

[19] Blanes, Sergio; Casas, Fernando A concise introduction to geometric numerical integration, Monographs and Research Notes in Mathematics, CRC Press, 2016 | Zbl | MR

[20] Blanes, Sergio; Casas, Fernando; Murua, Ander Splitting and composition methods in the numerical integration of differential equations, Bol. Soc. Esp. Mat. Apl., S$\overrightarrow{\text{e}}$MA, Volume 45 (2008), pp. 89-145 | Zbl

[21] Blanes, Sergio; Casas, Fernando; Oteo, José; Ros, Javier A pedagogical approach to the Magnus expansion, Eur. J. Phys., Volume 31 (2010) no. 4, pp. 907-918 | DOI | Zbl

[22] Blanes, Sergio; Moan, Per Christian Splitting methods for non-autonomous Hamiltonian equations, J. Comput. Phys., Volume 170 (2001) no. 1, pp. 205-230 | Zbl | MR | DOI

[23] Bonfiglioli, Andrea; Fulci, Roberta Topics in noncommutative algebra. The theorem of Campbell, Baker, Hausdorff and Dynkin, Lecture Notes in Mathematics, 2034, Springer, 2012 | Zbl | MR | DOI

[24] Bourbaki, Nicolas Elements of mathematics. Lie groups and Lie algebras. Part I: Chapters 1-3. English translation (Actualités Scientifiques et Industrielles), 1975 | Zbl

[25] Bourbaki, Nicolas Éléments d’histoire des mathématiques, Masson, 1984, 376 pages (Reprints of the historical notes from the ıt Éléments) | Zbl | MR

[26] Bourbaki, Nicolas Algebra I. Chapters 1–3, Elements of Mathematics (Berlin), Springer, 1998 (Translated from the French, Reprint of the 1989 English translation) | Zbl | MR

[27] Buffoni, Boris; Toland, John Analytic theory of global bifurcation. An introduction, Princeton Series in Applied Mathematics, Princeton University Press, 2003 | DOI | Zbl

[28] Burrage, Kevin; Burrage, Pamela High strong order methods for non-commutative stochastic ordinary differential equation systems and the Magnus formula, Physica D, Volume 133 (1999) no. 1-4, pp. 34-48 Predictability: quantifying uncertainty in models of complex phenomena (Los Alamos, NM, 1998) | Zbl | MR | DOI

[29] Campbell, John Edward On a Law of Combination of Operators (Second Paper), Proc. Lond. Math. Soc., Volume 29 (1898), pp. 14-32 | MR | DOI

[30] Casas, Fernando; Iserles, Arieh Explicit Magnus expansions for nonlinear equations, J. Phys. A, Math. Gen., Volume 39 (2006) no. 19, pp. 5445-5461 | MR | Zbl | DOI

[31] Casas, Fernando; Murua, Ander An efficient algorithm for computing the Baker–Campbell–Hausdorff series and some of its applications, J. Math. Phys., Volume 50 (2009) no. 3, 033513 | Zbl | MR | DOI

[32] Castell, Fabienne Asymptotic expansion of stochastic flows, Probab. Theory Relat. Fields, Volume 96 (1993) no. 2, pp. 225-239 | Zbl | MR | DOI

[33] Chen, Kuo-Tsai Iterated integrals and exponential homomorphisms, Proc. Lond. Math. Soc., Volume 4 (1954), pp. 502-512 | Zbl | MR | DOI

[34] Chen, Kuo-Tsai Integration of paths, geometric invariants and a generalized Baker–Hausdorff formula, Ann. Math., Volume 65 (1957), pp. 163-178 | MR | Zbl | DOI

[35] Cohn, Paul Moritz Sur le critère de Friedrichs pour les commutateurs dans une algèbre associative libre, C. R. Acad. Sci. Paris, Volume 239 (1954), pp. 743-745 | Zbl | MR

[36] Coron, Jean-Michel Control and nonlinearity, Mathematical Surveys and Monographs, 136, American Mathematical Society, 2007 | Zbl

[37] Curry, Charles; Ebrahimi-Fard, Kurusch; Munthe-Kaas, Hans What is a post-Lie algebra and why is it useful in geometric integration, Numerical mathematics and advanced applications—ENUMATH 2017 (Lecture Notes in Computational Science and Engineering), Volume 126, Springer (2017), pp. 429-437 | Zbl | DOI

[38] Driver, Bruce On truncated logarithms of flows on a Riemannian manifold (2018) (https://arxiv.org/abs/1810.02414)

[39] Dynkin, Evgenii Calculation of the coefficients in the Campbell-Hausdorff formula, Dokl. Akad. Nauk SSSR, Volume 57 (1947), pp. 323-326 | Zbl | MR

[40] Dynkin, Evgenii On the representation by means of commutators of the series $\log \left(e^x{e}^y\right)$ for noncommutative $x$ and $y$, Mat. Sb., N. Ser., Volume 25(67) (1949), pp. 155-162 | Zbl | MR

[41] Ebrahimi-Fard, Kurusch; Manchon, Dominique A Magnus- and Fer-type formula in dendriform algebras., Found. Comput. Math., Volume 9 (2009) no. 3, pp. 295-316 | MR | Zbl | DOI

[42] Ebrahimi-Fard, Kurusch; Manchon, Dominique The Magnus expansion, trees and Knuth’s rotation correspondence, Found. Comput. Math., Volume 14 (2014) no. 1, pp. 1-25 | MR | Zbl | DOI

[43] Ebrahimi-Fard, Kurusch; Patras, Frédéric The pre-Lie structure of the time-ordered exponential, Lett. Math. Phys., Volume 104 (2014) no. 10, pp. 1281-1302 | MR | Zbl | DOI

[44] Finkelstein, David On relations between commutators, Commun. Pure Appl. Math., Volume 8 (1955), pp. 245-250 | Zbl | MR | DOI

[45] Fliess, Michel Fonctionnelles causales non linéaires et indéterminées non commutatives, Bull. Soc. Math. Fr., Volume 109 (1981) no. 1, pp. 3-40 | DOI | Zbl | MR

[46] Fliess, Michel Réalisation locale des systèmes non linéaires, algèbres de Lie filtrées transitives et séries génératrices non commutatives, Invent. Math., Volume 71 (1983) no. 3, pp. 521-537 | DOI | Zbl

[47] Fløystad, Gunnar; Munthe-Kaas, Hans Pre- and post-Lie algebras: the algebro-geometric view, Computation and combinatorics in dynamics, stochastics and control. The Abel symposium, Rosendal, Norway, August 16–19, 2016. Selected papers, Springer, 2018, pp. 321-367 | Zbl | DOI

[48] Friedrichs, Kurt Mathematical aspects of the quantum theory of fields. V. Fields modified by linear homogeneous forces, Commun. Pure Appl. Math., Volume 6 (1953), pp. 1-72 | Zbl | MR | DOI

[49] Gamkrelidze, Revaz Exponential representation of solutions of ordinary differential equations, Equadiff IV (Proc. Czechoslovak Conf. Differential Equations and their Applications, Prague, 1977) (Lecture Notes in Mathematics), Volume 703, Springer, 1979, pp. 118-129 | Zbl | MR

[50] Gel’fand, Israel; Naĭmark, Mark On the imbedding of normed rings into the ring of operators in Hilbert space, Mat. Sb., N. Ser., Volume 12 (54) (1943), pp. 197-213 | Zbl

[51] Giraldi, Laetitia; Lissy, Pierre; Moreau, Clément; Pomet, Jean-Baptiste Necessary conditions for local controllability of a particular class of systems with two scalar controls (2019) (https://arxiv.org/abs/1907.04706)

[52] Grabowski, Janusz Free subgroups of diffeomorphism groups, Fundam. Math., Volume 131 (1988) no. 2, pp. 103-121 | MR | Zbl | DOI

[53] Gray, W. Steven; Duffaut Espinosa, Luis A. A Faà di Bruno Hopf algebra for a group of Fliess operators with applications to feedback, Syst. Control Lett., Volume 60 (2011) no. 7, pp. 441-449 | Zbl | DOI

[54] Gray, W. Steven; Duffaut Espinosa, Luis A.; Ebrahimi-Fard, Kurusch Faà di Bruno Hopf algebra of the output feedback group for multivariable Fliess operators, Syst. Control Lett., Volume 74 (2014), pp. 64-73 | Zbl | DOI

[55] Gray, W. Steven; Duffaut Espinosa, Luis A.; Ebrahimi-Fard, Kurusch Additive Networks of Chen–Fliess Series: Local Convergence and Relative Degree (2021) (https://arxiv.org/abs/2104.08950)

[56] Gray, W. Steven; Ebrahimi-Fard, Kurusch Generating series for networks of Chen-Fliess series, Syst. Control Lett., Volume 147 (2021), 104827 | MR | Zbl | DOI

[57] Gray, W. Steven; Wang, Yuan Fliess operators on $L^p$ spaces: convergence and continuity, Syst. Control Lett., Volume 46 (2002) no. 2, pp. 67-74 | MR | Zbl | DOI

[58] Hairer, Ernst; Lubich, Christian; Wanner, Gerhard Geometric numerical integration, Springer Series in Computational Mathematics, 31, Springer, 2010 | Zbl | MR

[59] Hall, Marshall jun. A basis for free Lie rings and higher commutators in free groups, Proc. Am. Math. Soc., Volume 1 (1950), pp. 575-581 | DOI | MR | Zbl

[60] Hall, Philip A contribution to the theory of groups of prime-power order, Proc. Lond. Math. Soc., Volume 36 (1933), pp. 29-95 | MR | Zbl

[61] Hausdorff, Felix Die symbolische Exponentialformel in der Gruppentheorie, Ber. Verh. Kgl. Schs. Ges. Wiss. Leipzig., Math.-phys. Kl., Volume 58 (1906), pp. 19-48 | Zbl

[62] Hermes, Henry Local controllability and sufficient conditions in singular problems. II, SIAM J. Control Optim., Volume 14 (1976) no. 6, pp. 1049-1062 | DOI | MR | Zbl

[63] Hermes, Henry; Kawski, Matthias Local controllability of a single input, affine system, Nonlinear analysis and applications (Arlington, Tex., 1986) (Lecture Notes in Pure and Applied Mathematics), Volume 109, Marcel Dekker, 1987, pp. 235-248 | MR

[64] Iserles, Arieh; Munthe-Kaas, Hans; Nørsett, Syvert; Zanna, Antonella Lie-group methods (Acta Numerica), Volume 9, Cambridge University Press, 2000, pp. 215-365 | Zbl | MR | DOI

[65] Jacobson, Nathan Lie algebras, Dover Publications, 1979 | MR

[66] Jean, Frédéric Control of nonholonomic systems: from sub-Riemannian geometry to motion planning, SpringerBriefs in Mathematics, Springer; Bilbao: BCAM – Basque Center for Applied Mathematics, 2014 | MR | Zbl

[67] Jurdjevic, Velimir; Sussmann, Héctor Control systems on Lie groups, J. Differ. Equations, Volume 12 (1972), pp. 313-329 | Zbl | MR | DOI

[68] Karasev, Mikhail; Mosolova, Mikhail Infinite products and T-products of exponents, Teor. Mat. Fiz., Volume 28 (1976) no. 2, pp. 189-200 | MR

[69] Kawski, Matthias Controllability via chronological calculus, Proceedings of the IEEE Conference on Decision and Control, Volume 3, IEEE (1999), pp. 2920-2925 | DOI

[70] Kawski, Matthias Calculating the logarithm of the Chen Fliess series, Proc. MTNS, Perpignan (2000)

[71] Kawski, Matthias The combinatorics of nonlinear controllability and noncommuting flows, Mathematical control theory, Part 1, 2 (Trieste, 2001) (ICTP Lecture Notes), Volume VIII, Abdus Salam International Centre for Theoretical Physics, 2002, pp. 223-311 | Zbl | MR

[72] Kawski, Matthias Chronological calculus in systems and control theory, Mathematics of Complexity and Dynamical Systems, Springer, 2012, pp. 88-101 | MR | DOI

[73] Kawski, Matthias High-order small-time local controllability, Nonlinear controllability and optimal control (Sussmann, H. J., ed.), Routledge, 2017, pp. 431-467 | DOI

[74] Kawski, Matthias; Sussmann, Héctor Noncommutative power series and formal Lie-algebraic techniques in nonlinear control theory, Operators, systems, and linear algebra (Kaiserslautern) (European Consortium for Mathematics in Industry), Teubner, 1997, pp. 111-128 | DOI | Zbl | MR

[75] Krener, Arthur On the equivalence of control systems and the linearization of nonlinear systems, SIAM J. Control, Volume 11 (1973), pp. 670-676 | DOI | MR | Zbl

[76] Krener, Arthur Local approximation of control systems, J. Differ. Equations, Volume 19 (1975), pp. 125-133 | DOI | MR | Zbl

[77] Lee, John Introduction to smooth manifolds, Graduate Texts in Mathematics, 218, Springer, 2013 | Zbl

[78] Lyndon, Roger A theorem of Friedrichs, Mich. Math. J., Volume 3 (1956), pp. 27-29 | Zbl | MR

[79] Maggia, Marco; Eisa, Sameh A; Taha, Haithem E. On higher-order averaging of time-periodic systems: reconciliation of two averaging techniques, Nonlinear Dyn., Volume 99 (2020) no. 1, pp. 813-836 | Zbl | DOI

[80] Magnus, Wilhelm On the exponential solution of differential equations for a linear operator, Commun. Pure Appl. Math., Volume 7 (1954), pp. 649-673 | Zbl | MR | DOI

[81] McLachlan, Robert Composition methods in the presence of small parameters, BIT, Volume 35 (1995) no. 2, pp. 258-268 | Zbl | MR | DOI

[82] McLachlan, Robert; Modin, Klas; Munthe-Kaas, Hans; Verdier, Olivier Butcher series: a story of rooted trees and numerical methods for evolution equations (2015) (https://arxiv.org/abs/1512.00906v1)

[83] Moan, Per Christian; Niesen, Jitse Convergence of the Magnus series, Found. Comput. Math., Volume 8 (2008) no. 3, pp. 291-301 | Zbl | MR | DOI

[84] Mouhot, Clément; Villani, Cédric On Landau damping, Acta Math., Volume 207 (2011) no. 1, pp. 29-201 | DOI | MR | Zbl

[85] Munthe-Kaas, Hans; Owren, Brynjulf Computations in a free Lie algebra, Philos. Trans. R. Soc. Lond., Ser. A, Volume 357 (1999) no. 1754, pp. 957-981 | MR | Zbl | DOI

[86] Murua, Ander The Hopf algebra of rooted trees, free Lie algebras, and Lie series, Found. Comput. Math., Volume 6 (2006) no. 4, pp. 387-426 | Zbl | MR | DOI

[87] Nagel, Alexander; Stein, Elias; Wainger, Stephen Balls and metrics defined by vector fields. I. Basic properties, Acta Math., Volume 155 (1985) no. 1-2, pp. 103-147 | Zbl | MR | DOI

[88] Palis, Jacob Vector fields generate few diffeomorphisms, Bull. Am. Math. Soc., Volume 80 (1974), pp. 503-505 | MR | Zbl | DOI

[89] Ree, Rimhak Lie elements and an algebra associated with shuffles, Ann. Math., Volume 68 (1958), pp. 210-220 | Zbl | MR | DOI

[90] Reutenauer, Christophe Free Lie algebras, London Mathematical Society Monographs. New Series, 7, Clarendon Press, 1993 | Zbl | MR

[91] Saenz, Leonardo; Suarez, Rodolfo Lie algebras associated with the exponential solutions of nonautonomous linear differential equations, J. Math. Phys., Volume 42 (2001) no. 9, pp. 4582-4605 | Zbl | MR | DOI

[92] Saenz, Leonardo; Suarez, Rodolfo A combinatorial approach to the generalized Baker-Campbell-Hausdorff-Dynkin formula, Syst. Control Lett., Volume 45 (2002) no. 5, pp. 357-370 | Zbl | MR | DOI

[93] Sarychev, Andrei Lie- and chronologico-algebraic tools for studying stability of time-varying systems, Syst. Control Lett., Volume 43 (2001) no. 1, pp. 59-76 | MR | Zbl | DOI

[94] Shirshov, Anatolii On the bases of a free Lie algebra, Algebra Logika, Volume 1 (1962) no. 1, pp. 14-19 | MR | Zbl

[95] Specht, Wilhelm Die linearen Beziehungen zwischen höheren Kommutatoren, Math. Z., Volume 51 (1948), pp. 367-376 | Zbl | MR | DOI

[96] Stefani, Gianna On the local controllability of a scalar-input control system, Theory and applications of nonlinear control systems (Stockholm, 1985), North-Holland, 1986, pp. 167-179 | Zbl | MR

[97] Strichartz, Robert The Campbell–Baker–Hausdorff–Dynkin formula and solutions of differential equations, J. Funct. Anal., Volume 72 (1987) no. 2, pp. 320-345 | Zbl | MR | DOI

[98] Sussmann, Héctor An extension of a theorem of Nagano on transitive Lie algebras, Proc. Am. Math. Soc., Volume 45 (1974), pp. 349-356 | DOI | MR | Zbl

[99] Sussmann, Héctor Lie brackets and local controllability: a sufficient condition for scalar-input systems, SIAM J. Control Optim., Volume 21 (1983) no. 5, pp. 686-713 | Zbl | MR | DOI

[100] Sussmann, Héctor A product expansion for the Chen series, Theory and applications of nonlinear control systems (Stockholm, 1985), North-Holland, 1986, pp. 323-335 | Zbl | MR | DOI

[101] Trotter, Hale On the product of semi-groups of operators, Proc. Am. Math. Soc., Volume 10 (1959), pp. 545-551 | DOI | MR | Zbl

[102] Viennot, Gérard Algèbres de Lie libres et monoïdes libres. Bases des algèbres de Lie libres et factorisations des monoïdes libres, Lecture Notes in Mathematics, 691, Springer, 1978 | DOI | Zbl | MR

[103] Wei, James Note on the global validity of the Baker-Hausdorff and Magnus theorems, J. Math. Phys., Volume 4 (1963), pp. 1337-1341 | Zbl | MR | DOI

[104] Wever, Franz Operatoren in Lieschen Ringen, J. Reine Angew. Math., Volume 187 (1949), pp. 44-55 | Zbl | MR | DOI