Welcome to the homepage of the

Mathematical Optimization Group

Department of Mathematics, University of Tübingen, Germany

Continuous Newton-like Methods featuring Inertia and Variable Mass

C. Castera, H. Attouch, J. Fadili and P. Ochs

Abstract:
We introduce a new dynamical system, at the interface between second-order dynamics with inertia and Newton's method. This system extends the class of inertial Newton-like dynamics by featuring a time-dependent parameter in front of the acceleration, called variable mass. For strongly convex optimization, we provide guarantees on how the Newtonian and inertial behaviors of the system can be non-asymptotically controlled by means of this variable mass. A connection with the Levenberg-Marquardt (or regularized Newton's) method is also made. We then show the effect of the variable mass on the asymptotic rate of convergence of the dynamics, and in particular, how it can turn the latter into an accelerated Newton method. We provide numerical experiments supporting our findings. This work represents a significant step towards designing new algorithms that benefit from the best of both first- and second-order optimization methods.
pdf Bibtex arXiv
Latest update: 31.01.2023
Citation:
C. Castera, H. Attouch, J. Fadili, P. Ochs:
Continuous Newton-like Methods featuring Inertia and Variable Mass. [pdf]
Technical Report, ArXiv e-prints, arXiv:2301.08726, 2023.
Bibtex:
@techreport{CAFO23,
  title        = {Continuous Newton-like Methods featuring Inertia and Variable Mass},
  author       = {C. Castera and H. Attouch and J. Fadili and P. Ochs},
  year         = {2023},
  journal      = {ArXiv e-prints, arXiv:2301.08726},
}


MOP Group
©2017-2022
The author is not
responsible for
the content of
external pages.