?. , F. Lipschitz-continuous, and S. Let, We say (S, F ) is strongly invariant (positively invariant) if for each initial condition x 0 ? S the corresponding trajectory x(t) ? S for t ? R + . We recall two properties of Theorem 3

]. R. Agarwal, Difference Equations and Inequalities: Theory, Methods, and Applications, Bibliography, issue.1, 2000.

F. Albertini and E. D. Sontag, Continuous control-Lyapunov functions for asymptotically controllable time-varying systems, International Journal of Control, vol.72, issue.18, pp.721630-1641, 1999.
DOI : 10.1080/002071799219977

D. Angeli and A. Astolfi, A tight small-gain theorem for not necessarily ISS systems, Systems & Control Letters, vol.56, issue.1, pp.87-91, 2007.
DOI : 10.1016/j.sysconle.2006.08.003

D. Angeli, E. D. Sontag, and Y. Wang, A characterization of integral input-to-state stability, IEEE Transactions on Automatic Control, vol.45, issue.6, pp.451082-1097, 2000.
DOI : 10.1109/9.863594

R. Baier, L. Grüne, and S. F. Hafstein, Linear programming based Lyapunov function computation for differential inclusions, Discrete and Continuous Dynamical Systems - Series B, vol.17, issue.1, pp.33-56, 2012.
DOI : 10.3934/dcdsb.2012.17.33
URL : https://hal.archives-ouvertes.fr/hal-00724864

H. Ban and W. D. Kalies, A computational approach to Conley's decomposition theroem, J. Comput. Nonlinear Dynam, pp.1-4312, 2006.

E. A. Barbashin, Stability Theory by Liapunov's Second Method, Doklady Akademii Nauk SSSR, vol.72, pp.445-447, 1950.

M. Bardi and I. C. Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations, 1997.
DOI : 10.1007/978-0-8176-4755-1

F. Camilli, L. Grüne, and F. Wirth, A regularization of Zubov???s equation for robust domains of attraction, Nonlinear Control in the Year, pp.277-290, 2000.
DOI : 10.1007/BFb0110220

F. Camilli, L. Grüne, and F. Wirth, A Generalization of Zubov's Method to Perturbed Systems, SIAM Journal on Control and Optimization, vol.40, issue.2, pp.496-515, 2001.
DOI : 10.1137/S036301299936316X

F. Camilli, L. Grüne, and F. Wirth, A generalization of Zubov's method to perturbed systems, Proc. 41st IEEE Conference on Decision and Control, CDC2002, pp.3518-3523, 2002.

F. Camilli, L. Grüne, and F. Wirth, Control Lyapunov Functions and Zubov's Method, SIAM Journal on Control and Optimization, vol.47, issue.1, pp.301-326, 2008.
DOI : 10.1137/06065129X

F. Camilli, L. Grüne, and F. Wirth, Domains of attraction of interconnected systems: A Zubov method approach, Proc. European Control Conference, pp.91-96, 2009.

F. H. Clarke, Y. S. Ledyaev, and R. J. Stern, Asymptotic Stability and Smooth Lyapunov Functions, Journal of Differential Equations, vol.149, issue.1, pp.69-114, 1998.
DOI : 10.1006/jdeq.1998.3476
URL : http://doi.org/10.1006/jdeq.1998.3476

F. H. Clarke, Y. S. Ledyaev, R. J. Stern, and P. R. Wolenski, Nonsmooth analysis and control theory, 1998.
URL : https://hal.archives-ouvertes.fr/hal-00863298

S. Dashkovskiy, H. Ito, and F. Wirth, On a Small Gain Theorem for ISS Networks in Dissipative Lyapunov Form, European Journal of Control, vol.17, issue.4, pp.357-365, 2011.
DOI : 10.3166/ejc.17.357-365

S. Dashkovskiy, B. S. Rüffer, and F. Wirth, A small-gain type stability criterion for large scale networks of ISS systems, Proceedings of the 44th IEEE Conference on Decision and Control, 2005.
DOI : 10.1109/CDC.2005.1583060

S. Dashkovskiy, B. S. Rüffer, and F. Wirth, An ISS Lyapunov function for networks of ISS systems, Proc. 17th Int. Symp. Math. Theory of Networks and Systems, pp.77-82, 2006.

S. Dashkovskiy, B. S. Rüffer, and F. Wirth, An ISS small gain theorem for general networks, Mathematics of Control, Signals, and Systems, vol.43, issue.7, pp.93-122, 2007.
DOI : 10.1007/s00498-007-0014-8

S. Dashkovskiy, B. S. Rüffer, and F. Wirth, A LYAPUNOV ISS SMALL-GAIN THEOREM FOR STRONGLY CONNECTED NETWORKS, Proc. 7th IFAC Symposium on Nonlinear Control Systems, NOLCOS2007, pp.283-288, 2007.
DOI : 10.3182/20070822-3-ZA-2920.00043

L. C. Evans, Partial differential equations, Graduate Studies in Mathematics, vol.19, 1998.

M. Fiedler and P. Vlastimil, On matrices with non-positive off-diagonal elements and positive principal minors, Czechoslovak Mathematical Journal, vol.12, issue.3, pp.382-400, 1962.

R. Geiselhart, R. Gielen, M. Lazar, and F. Wirth, An alternative converse Lyapunov theorem for discrete-time systems, Systems & Control Letters, vol.70, pp.49-59, 2014.
DOI : 10.1016/j.sysconle.2014.05.007

R. Geiselhart, M. Lazar, and F. Wirth, A Non-conservative Small-Gain Theorem for Interconnected Discrete-Time Systems, 2015.

R. Geiselhart and F. Wirth, Relaxed ISS small-gain theorems for discretetime systems, submitted to SIAM J. Control Optim, 2014.

P. Giesl and S. Hafstein, Existence of piecewise linear Lyapunov functions in arbitrary dimensions, Discrete and Continuous Dynamical Systems, vol.32, issue.10, pp.3539-3565, 2012.
DOI : 10.3934/dcds.2012.32.3539

P. Giesl and S. Hafstein, Computation of Lyapunov functions for nonlinear discrete time systems by linear programming, Journal of Difference Equations and Applications, vol.36, issue.3, pp.610-640, 2014.
DOI : 10.1017/CBO9780511617539

P. Giesl and S. Hafstein, Revised CPA method to compute Lyapunov functions for nonlinear systems, Journal of Mathematical Analysis and Applications, vol.410, issue.1, pp.292-306, 2014.
DOI : 10.1016/j.jmaa.2013.08.014

S. P. Gordon, On Converses to the Stability Theorems for Difference Equations, SIAM Journal on Control, vol.10, issue.1, pp.76-81, 1972.
DOI : 10.1137/0310007

L. Grüne, F. Camilli, and F. Wirth, Zubov's method for perturbed differential equations, Proceedings of the Mathematical Theory of Networks and Systems (MTNS2000), 2000.

L. Grüne and F. Wirth, Computing control Lyapunov functions via a Zubov type algorithm, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187), pp.2129-2134, 2000.
DOI : 10.1109/CDC.2000.914109

L. Grüne and H. Zidani, Zubov's equation for state-constrained perturbed nonlinear systems, Mathematical Control and Related Fields, vol.5, issue.1, pp.55-71, 2015.

L. T. Gruji´cgruji´c and D. D. Siljak, Asymptotic stability and instability of large-scale systems

L. Grüne, Asymptotic behavior of dynamical and control systems under perturbation and discretization, volume 1783 of Lecture Notes in Mathematics, 2002.

L. Grüne and M. Sigurani, Numerical ISS controller design via a dynamic game approach, 52nd IEEE Conference on Decision and Control, pp.1732-1737, 2013.
DOI : 10.1109/CDC.2013.6760132

L. Grüne and M. Sigurani, A Lyapunov based nonlinear small-gain theorem for discontinuous discrete-time large-scale systems, Proceedings of the 21st International Symposium on Mathematical Theory of Networks and Systems, 2014.

L. Grüne, E. D. Sontag, and F. Wirth, Asymptotic stability equals exponential stability, and ISS equals finite energy gain ??? if you twist your eyes, Systems & Control Letters, vol.38, issue.2, pp.127-134, 1999.
DOI : 10.1016/S0167-6911(99)00053-5

L. Grüne and C. M. Kellett, ISS-Lyapunov Functions for Discontinuous Discrete-Time Systems, IEEE Transactions on Automatic Control, vol.59, issue.11, pp.3098-3103, 2014.
DOI : 10.1109/TAC.2014.2321667

S. Hafstein, A constructive converse Lyapunov theorem on exponential stability. Discrete Contin, Dyn. Syst, vol.10, issue.3, pp.657-678, 2004.

S. Hafstein, A constructive converse Lyapunov theorem on asymptotic stability for nonlinear autonomous ordinary differential equations, Dynamical Systems, vol.20, issue.3, pp.281-299, 2005.
DOI : 10.1016/j.sysconle.2004.09.006

S. Hafstein, An algorithm for constructing Lyapunov functions, volume 8 of Electron, J. Differ. Equ. Monogr. Texas State University?, 2007.

S. Hafstein, C. M. Kellett, and H. Li, Continuous and piecewise affine Lyapunov functions using the Yoshizawa construction, 2014 American Control Conference, 2014.
DOI : 10.1109/ACC.2014.6858660
URL : https://hal.archives-ouvertes.fr/hal-00944393

S. Hafstein, C. M. Kellett, and H. Li, A fast method for computing continuous and piecewise affine Lyapunov functions for nonlinear systems, Automatica, 2015.

W. Hahn, Stability of motion. Translated from the German manuscript by Arne P. Baartz. Die Grundlehren der mathematischen Wissenschaften, 1967.

M. A. Hassan and C. Storey, Numerical determination of domains of attraction for electrical power systems using the method of Zubov, International Journal of Control, vol.86, issue.2, pp.371-381, 1981.
DOI : 10.1080/00207178108922536

A. Hatcher, Algebraic topology, 2002.

D. J. Hill, A generalization of the small-gain theorem for nonlinear feedback systems, Automatica, vol.27, issue.6, pp.1043-1045, 1991.
DOI : 10.1016/0005-1098(91)90140-W

D. Hinrichsen and A. J. Pritchard, Mathematical systems theory. I, volume 48 of Texts in Applied Mathematics, Modelling, state space analysis, stability and robustness, 2005.

H. Ito, A constructive proof of ISS small-gain theorem using generalized scaling, Proceedings of the 41st IEEE Conference on Decision and Control, 2002., pp.2286-2291, 2002.
DOI : 10.1109/CDC.2002.1184873

H. Ito, State-Dependent Scaling Problems and Stability of Interconnected iISS and ISS Systems, IEEE Transactions on Automatic Control, vol.51, issue.10, pp.1626-1643, 2006.
DOI : 10.1109/TAC.2006.882930

H. Ito, A Lyapunov Approach to Cascade Interconnection of Integral Input-to-State Stable Systems, IEEE Transactions on Automatic Control, vol.55, issue.3, pp.702-708, 2010.
DOI : 10.1109/TAC.2009.2037457

H. Ito, S. Dashkovskiy, and F. Wirth, On a small gain theorem for networks of iISS systems, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, pp.4210-4215, 2009.
DOI : 10.1109/CDC.2009.5399595

H. Ito, S. Dashkovskiy, and F. Wirth, Capability and limitation of max- and sum-type construction of Lyapunov functions for networks of iISS systems, Automatica, vol.48, issue.6, pp.481197-1204, 2012.
DOI : 10.1016/j.automatica.2012.03.018

H. Ito, Z. Jiang, S. Dashkovskiy, and B. S. Rüffer, A small-gain theorem and construction of sum-type Lyapunov functions for networks of iISS systems, Proceedings of the 2011 American Control Conference
DOI : 10.1109/ACC.2011.5991069

Z. Jiang, Y. Lin, and Y. Wang, Nonlinear small-gain theorems for discrete-time feedback systems and applications, Automatica J. IFAC, vol.40, issue.12, pp.2129-2136, 2004.

Z. Jiang, I. M. Mareels, and Y. Wang, A Lyapunov formulation of the nonlinear small-gain theorem for interconnected ISS systems, Automatica, vol.32, issue.8, pp.321211-1215, 1996.
DOI : 10.1016/0005-1098(96)00051-9

Z. Jiang, A. R. Teel, and L. Praly, Small-gain theorem for ISS systems and applications, Mathematics of Control, Signals, and Systems, vol.27, issue.2, pp.95-120, 1994.
DOI : 10.1007/BF01211469

Z. Jiang and Y. Wang, Input-to-state stability for discrete-time nonlinear systems, Automatica, vol.37, issue.6, pp.857-869, 2001.
DOI : 10.1016/S0005-1098(01)00028-0

Z. Jiang and Y. Wang, A converse Lyapunov theorem for discrete-time systems with disturbances, Systems & Control Letters, vol.45, issue.1, pp.49-58, 2002.
DOI : 10.1016/S0167-6911(01)00164-5

T. Johansen, Computation of Lyapunov functions for smooth nonlinear systems using convex optimization, Automatica, vol.36, issue.11, pp.1617-1626, 2000.
DOI : 10.1016/S0005-1098(00)00088-1

W. D. Kalies, K. Mischaikow, and R. C. Vandervorst, An Algorithmic Approach to Chain Recurrence, Foundations of Computational Mathematics, vol.5, issue.4, pp.409-449, 2005.
DOI : 10.1007/s10208-004-0163-9

C. M. Kellett, A compendium of comparison function results, Mathematics of Control, Signals, and Systems, vol.43, issue.7, pp.339-374, 2014.
DOI : 10.1007/s00498-014-0128-8

C. M. Kellett and A. R. Teel, Smooth Lyapunov functions and robustness of stability for difference inclusions, Systems & Control Letters, vol.52, issue.5, pp.395-405, 2004.
DOI : 10.1016/j.sysconle.2004.02.015

C. M. Kellett and A. R. Teel, On the Robustness of $\mathcalKL$-stability for Difference Inclusions: Smooth Discrete-Time Lyapunov Functions, SIAM Journal on Control and Optimization, vol.44, issue.3, pp.777-800, 2005.
DOI : 10.1137/S0363012903435862

N. E. Kirin, R. A. Nelepin, and V. N. Bajdaev, Construction of the attraction region by Zubov's method, Differ. Equations, vol.17, pp.871-880, 1982.

D. S. Laila and D. Ne?i´ne?i´c, Discrete-time Lyapunov-based small-gain theorem for parameterized interconnected ISS systems, IEEE Trans. Automat. Control, issue.10, pp.481783-1788, 2003.

R. I. Leine, The historical development of classical stability concepts: Lagrange, Poisson and Lyapunov stability, Nonlinear Dynamics, vol.23, issue.1, pp.173-182, 2010.
DOI : 10.1007/s11071-009-9530-z

H. Li, R. Baier, S. Hafstein, L. Grüne, and F. Wirth, Computation of local ISS Lyapunov functions with low gains via linear programming, Proceedings of the 21st International Symposium on Mathematical Theory of Networks and Systems, 2014.
DOI : 10.3934/dcdsb.2015.20.2477
URL : https://hal.archives-ouvertes.fr/hal-01101284

H. Li, R. Baier, S. Hafstein, L. Grüne, and F. Wirth, Computation of local ISS Lyapunov functions with low gains via linear programming, Discrete and Continuous Dynamical Systems? Series B, 2015.
DOI : 10.3934/dcdsb.2015.20.2477
URL : https://hal.archives-ouvertes.fr/hal-01101284

H. Li, S. Hafstein, and C. M. Kellett, Computation of Lyapunov functions for discretetime systems using the Yoshizawa construction, 53rd IEEE Conference on Decision and Control, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01101289

H. Li and F. Wirth, Zubov's method for interconnected systems ? a dissipative formulation, Proc. 20th Int. Symp. Math. Theory of Networks and Systems, 2012.

Y. Lin, E. D. Sontag, and Y. Wang, A Smooth Converse Lyapunov Theorem for Robust Stability, SIAM Journal on Control and Optimization, vol.34, issue.1, pp.124-160, 1996.
DOI : 10.1137/S0363012993259981

A. M. Lyapunov, The general problem of the stability of motion Translated from Edouard Davaux's French translation (1907) of the 1892 Russian original and edited by A. T. Fuller, With an introduction and preface by Fuller, a biography of Lyapunov by V. I. Smirnov, and a bibliography of Lyapunov's works compiled by Lyapunov centenary issue, Reprint of Internat, J. Control, vol.5593, issue.3, 1992.

S. Marinosson, Lyapunov function construction for ordinary differential equations with linear programming, Dynamical Systems, vol.40, issue.2, pp.137-150, 2002.
DOI : 10.1007/BF01600051

J. L. Massera, On Liapounoff's Conditions of Stability, The Annals of Mathematics, vol.50, issue.3, pp.705-721, 1949.
DOI : 10.2307/1969558

A. N. Michel, On the status of stability of interconnected systems, IEEE Trans. Systems Man Cybernet, vol.13, issue.4, pp.439-453, 1983.

A. N. Michel, N. R. Sarabudla, and R. K. Miller, Stability analysis of complex dynamical systems: Some computational methods, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes, pp.171-202, 1982.
DOI : 10.1109/CDC.1981.269528

A. Mironchenko, Input-to-state stability of infinite-dimensional control systems, 2012.

J. R. Munkres, Elements of algebraic topology, 1984.

A. Papachristodoulou and S. Prajna, On the construction of Lyapunov functions using the sum of squares decomposition, Proceedings of the 41st IEEE Conference on Decision and Control, 2002., pp.3482-3487, 2002.
DOI : 10.1109/CDC.2002.1184414

M. Peet and A. Papachristodoulou, A converse sum-of-squares Lyapunov result: An existence proof based on the Picard iteration, 49th IEEE Conference on Decision and Control (CDC), pp.5949-5954, 2010.
DOI : 10.1109/CDC.2010.5717536

L. Praly and Z. Jiang, Stabilization by output feedback for systems with ISS inverse dynamics, Systems & Control Letters, vol.21, issue.1, pp.19-33, 1993.
DOI : 10.1016/0167-6911(93)90040-D

N. Rouche, P. Habets, and M. Laloy, Stability theory by Liapunov's direct method, Applied Mathematical Sciences, vol.22, 1977.
DOI : 10.1007/978-1-4684-9362-7

B. S. Rüffer, Monotone Systems, Graphs, and Stability of Large-Scale Interconnected Systems. Dissertation, Fachbereich 3 Available online, pp.46-000109058, 2007.

M. Sigurani, C. Stöcker, L. Grüne, and J. Lunze, Experimental evaluation of two complementary decentralized event-based control methods, Control Engineering Practice, vol.35, 2015.
DOI : 10.1016/j.conengprac.2014.10.002
URL : https://hal.archives-ouvertes.fr/hal-01068877

E. D. Sontag, Smooth stabilization implies coprime factorization, IEEE Transactions on Automatic Control, vol.34, issue.4, pp.435-443, 1989.
DOI : 10.1109/9.28018

E. D. Sontag, Some connections between stabilization and factorization, Proceedings of the 28th IEEE Conference on Decision and Control, pp.990-995, 1989.
DOI : 10.1109/CDC.1989.70273
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.53.3258

E. D. Sontag, Further facts about input to state stabilization, IEEE Transactions on Automatic Control, vol.35, issue.4, pp.473-476, 1990.
DOI : 10.1109/9.52307

E. D. Sontag, On the Input-to-State Stability Property, European Journal of Control, vol.1, issue.1, pp.24-36, 1995.
DOI : 10.1016/S0947-3580(95)70005-X

E. D. Sontag, Comments on integral variants of ISS, Systems & Control Letters, vol.34, issue.1-2, pp.93-100, 1998.
DOI : 10.1016/S0167-6911(98)00003-6

E. D. Sontag, Mathematical control theory, volume 6 of Texts in Applied Mathematics, Deterministic finite-dimensional systems, 1998.

E. D. Sontag, The ISS philosophy as a unifying framework for stability-like behavior In Nonlinear control in the year 2000, Lecture Notes in Control and Inform. Sci, vol.2, issue.259, pp.443-467, 2001.

E. D. Sontag, Input to State Stability: Basic Concepts and Results, Nonlinear and optimal control theory, pp.163-220, 1932.
DOI : 10.1007/978-3-540-77653-6_3

E. D. Sontag and A. Teel, Changing supply functions in input/state stable systems, IEEE Transactions on Automatic Control, vol.40, issue.8, pp.1476-1478, 1995.
DOI : 10.1109/9.402246

E. D. Sontag and Y. Wang, On characterizations of the input-to-state stability property, Systems & Control Letters, vol.24, issue.5, pp.351-359, 1995.
DOI : 10.1016/0167-6911(94)00050-6

E. D. Sontag and Y. Wang, New characterizations of input-to-state stability, IEEE Transactions on Automatic Control, vol.41, issue.9, pp.1283-1294, 1996.
DOI : 10.1109/9.536498

A. M. Stuart and A. R. Humphries, Numerical analysis of dynamical systems, Acta Numerica, vol.25, 1996.
DOI : 10.1007/BF01385623

A. R. Teel, A nonlinear small gain theorem for the analysis of control systems with saturation, IEEE Transactions on Automatic Control, vol.41, issue.9, pp.1256-1270, 1996.
DOI : 10.1109/9.536496

A. R. Teel and L. Praly, A smooth Lyapunov function from a class-${\mathcal{KL}}$ estimate involving two positive semidefinite functions, ESAIM: Control, Optimisation and Calculus of Variations, vol.5, pp.313-367, 2000.
DOI : 10.1051/cocv:2000113

J. Tsinias, Sontag's ???input to state stability condition??? and global stabilization using state detection, Systems & Control Letters, vol.20, issue.3, pp.219-226, 1993.
DOI : 10.1016/0167-6911(93)90063-C

J. Tsinias, Versions of Sontag's input to state stability condition and output feedback global stabilization, J. Math. Systems Estim. Control, vol.6, issue.1, p.17, 1996.

A. Vannelli and M. Vidyasagar, Maximal lyapunov functions and domains of attraction for autonomous nonlinear systems, Automatica, vol.21, issue.1, pp.69-80, 1985.
DOI : 10.1016/0005-1098(85)90099-8

M. Vidyasagar, Decomposition techniques for large-scale systems with nonadditive interactions: Stability and stabilizability, IEEE Transactions on Automatic Control, vol.25, issue.4, pp.773-779, 1980.
DOI : 10.1109/TAC.1980.1102422

M. Vidyasagar, Input-output analysis of large-scale interconnected systems, Lecture Notes in Control and Information Sciences, vol.29, 1981.
DOI : 10.1007/BFb0044060

T. Yoshizawa, Stability Theory by Liapunov's Second Method, 1966.

V. I. Zubov, Questions of the theory of Lyapunov's second method, construction of a general solution in the region of asymptotic stability, Prikl. Mat. Meh, vol.19, pp.179-210, 1955.

V. I. Zubov, Kolebaniya v nelineinykh i upravlyaemykh sistemakh, Gos. Sojuz. Izdat. Sudostroitel. Promy?l, 1962.

V. I. Zubov, Methods of A. M. Lyapunov and their application. Translation prepared under the auspices of the United States Atomic Energy Commission, 1964.