P. Absil, R. Mahony, and R. Sepulchre, Optimization Algorithms on Matrix Manifolds, 2008.

F. Alvarez, J. Bolte, and O. Brahic, Hessian Riemannian gradient flows in convex programming, SIAM Journal on Control and Optimization, vol.43, issue.2, pp.477-501, 2004.
URL : https://hal.archives-ouvertes.fr/hal-01928141

F. Bach and K. Y. Levy, A universal algorithm for variational inequalities adaptive to smoothness and noise, COLT '19: Proceedings of the 32nd Annual Conference on Learning Theory, 2019.

J. Baillon and G. Haddad, Quelques propriétés des opérateurs angle-bornés et n-cycliquement monotones, Israel Journal of Mathematics, vol.26, pp.137-150, 1977.

D. D. Bao, S. Chern, and Z. Shen, An Introduction to Riemann-Finsler Geometry, Number 200 in Graduate Texts in Mathematics, 2000.

H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01517477

H. H. Bauschke, J. Bolte, and M. Teboulle, A descent lemma beyond Lipschitz gradient continuity: First-order methods revisited and applications, Mathematics of Operations Research, vol.42, issue.2, pp.330-348, 2017.

J. Bolte, S. Sabach, M. Teboulle, and Y. Vaisbourd, First order methods beyond convexity and Lipschitz gradient continuity with applications to quadratic inverse problems, SIAM Journal on Optimization, vol.28, issue.3, pp.2131-2151, 2018.

R. E. Bruck, On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert space, Journal of Mathematical Analysis and Applications, vol.61, issue.1, pp.159-164, 1977.

A. Chambolle and T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging, Journal of Mathematical Imaging and Vision, vol.40, issue.1, pp.120-145, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00490826

G. Chen and M. Teboulle, Convergence analysis of a proximal-like minimization algorithm using Bregman functions, SIAM Journal on Optimization, vol.3, issue.3, pp.538-543, 1993.

P. L. Combettes and V. R. Wajs, Signal recovery by proximal forward-backward splitting, Multiscale Modeling and Simulation, vol.4, issue.4, pp.1168-1200, 2005.
URL : https://hal.archives-ouvertes.fr/hal-00017649

C. Daskalakis, A. Ilyas, V. Syrgkanis, and H. Zeng, Training GANs with optimism, ICLR '18: Proceedings of the 2018 International Conference on Learning Representations, 2018.

F. Facchinei and J. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problems, 2003.

G. Gidel, H. Berard, G. Vignoud, P. Vincent, and S. Lacoste-julien, A variational inequality perspective on generative adversarial networks, ICLR '19: Proceedings of the 2019 International Conference on Learning Representations, 2019.

G. Gidel, R. A. Hemmat, M. Pezehski, R. L. Priol, G. Huang et al., Negative momentum for improved game dynamics, AISTATS '19: Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, 2019.

I. J. Goodfellow, J. Pouget-abadie, M. Mirza, B. Xu, D. Warde-farley et al., Generative adversarial nets, NIPS '14: Proceedings of the 27th International Conference on Neural Information Processing Systems, 2014.

F. Hanzely, P. Richtarik, and L. Xiao, Accelerated Bregman proximal gradient methods for relatively smooth convex optimization, 2018.

A. N. Iusem, A. Jofré, R. I. Oliveira, and P. Thompson, Extragradient method with variance reduction for stochastic variational inequalities, SIAM Journal on Optimization, vol.27, issue.2, pp.686-724, 2017.

A. Juditsky, A. S. Nemirovski, and C. Tauvel, Solving variational inequalities with stochastic mirror-prox algorithm, Stochastic Systems, vol.1, issue.1, pp.17-58, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00318043

S. M. Kakade, S. Shalev-shwartz, and A. Tewari, Regularization techniques for learning with matrices, The Journal of Machine Learning Research, vol.13, pp.1865-1890, 2012.

L. Kleinrock, Queueing Systems, vol.1, 1975.

G. M. Korpelevich, The extragradient method for finding saddle points and other problems, Èkonom. i Mat. Metody, vol.12, pp.747-756, 1976.

T. Liang and J. Stokes, Interaction matters: A note on non-asymptotic local convergence of generative adversarial networks, AISTATS '19: Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, 2019.

H. Lu, Relative-continuity" for non-Lipschitz non-smooth convex optimization using stochastic (or deterministic) mirror descent, 2017.

H. Lu, R. M. Freund, and Y. Nesterov, Relatively-smooth convex optimization by first-order methods and applications, SIAM Journal on Optimization, vol.28, issue.1, pp.333-354, 2018.

Y. Malitsky, Projected reflected gradient methods for monotone variational inequalities, SIAM Journal on Optimization, vol.25, issue.1, pp.502-520, 2015.

P. Mertikopoulos and W. H. Sandholm, Learning in games via reinforcement and regularization, Mathematics of Operations Research, vol.41, issue.4, pp.1297-1324, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01073491

P. Mertikopoulos and W. H. Sandholm, Riemannian game dynamics, Journal of Economic Theory, vol.177, pp.315-364, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01382281

P. Mertikopoulos and M. Staudigl, On the convergence of gradient-like flows with noisy gradient input, SIAM Journal on Optimization, vol.28, issue.1, pp.163-197, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01404586

P. Mertikopoulos and Z. Zhou, Learning in games with continuous action sets and unknown payoff functions, Mathematical Programming, vol.173, issue.1-2, pp.465-507, 2019.

P. Mertikopoulos, E. V. Belmega, R. Negrel, and L. Sanguinetti, Distributed stochastic optimization via matrix exponential learning, IEEE Trans. Signal Process, vol.65, issue.9, pp.2277-2290, 2017.
URL : https://hal.archives-ouvertes.fr/hal-01382285

P. Mertikopoulos, C. H. Papadimitriou, and G. Piliouras, Cycles in adversarial regularized learning, SODA '18: Proceedings of the 29th annual ACM-SIAM Symposium on Discrete Algorithms, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01643338

P. Mertikopoulos, B. Lecouat, H. Zenati, C. Foo, V. Chandrasekhar et al., Optimistic mirror descent in saddle-point problems: Going the extra (gradient) mile, ICLR '19: Proceedings of the 2019 International Conference on Learning Representations, 2019.
URL : https://hal.archives-ouvertes.fr/hal-02111937

A. Mokhtari, A. Ozdaglar, and S. Pattathil, A unified analysis of extra-gradient and optimistic gradient methods for saddle point problems: proximal point approach, 2019.

A. S. Nemirovski, Prox-method with rate of convergence O(1/t) for variational inequalities with Lipschitz continuous monotone operators and smooth convex-concave saddle point problems, SIAM Journal on Optimization, vol.15, issue.1, pp.229-251, 2004.

A. S. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro, Robust stochastic approximation approach to stochastic programming, SIAM Journal on Optimization, vol.19, issue.4, pp.1574-1609, 2009.
URL : https://hal.archives-ouvertes.fr/hal-00976649

Y. Nesterov, Dual extrapolation and its applications to solving variational inequalities and related problems, Mathematical Programming, vol.109, issue.2, pp.319-344, 2007.

Y. Nesterov, Primal-dual subgradient methods for convex problems, Mathematical Programming, vol.120, issue.1, pp.221-259, 2009.

N. Nisan, T. Roughgarden, É. Tardos, and V. V. Vazirani, Algorithmic Game Theory, 2007.

A. Odena, C. Olah, and J. Shlens, Conditional image synthesis with auxiliary classifier GANs, 2016.

G. B. Passty, Ergodic convergence to a zero of the sum of monotone operators in Hilbert space, Journal of Mathematical Analysis and Applications, vol.72, issue.2, pp.383-390, 1979.

A. Rakhlin and K. Sridharan, Online learning with predictable sequences, COLT '13: Proceedings of the 26th Annual Conference on Learning Theory, 2013.

A. Rakhlin and K. Sridharan, Optimization, learning, and games with predictable sequences, NIPS '13: Proceedings of the 26th International Conference on Neural Information Processing Systems, 2013.

S. M. Shahshahani, A New Mathematical Framework for the Study of Linkage and Selection. Number 211 in Memoirs of the, 1979.

S. Sra, S. Nowozin, and S. J. Wright, Optimization for Machine Learning, 2012.

G. Stampacchia, Formes bilineaires coercitives sur les ensembles convexes. Comptes Rendus Hebdomadaires des Séances de l'Académie des Sciences, 1964.

J. G. Wardrop, Some theoretical aspects of road traffic research, Proceedings of the Institute of Civil Engineers, Part II, vol.1, pp.325-378, 1952.

A. Yadav, S. Shah, Z. Xu, D. Jacobs, and T. Goldstein, Stabilizing adversarial nets with prediction methods, ICLR '18: Proceedings of the 2018 International Conference on Learning Representations, 2018.