Matching the Lower Bounds: Stochastic Contracting Cubic Newton and Its Optimal Acceleration
In the authors' words
We study second-order methods for convex stochastic optimization, where gradients and Hessians are available only through stochastic estimates with variances and , respectively. First, we propose the Stochastic Contracting Cubic Newton method. At each iteration, it minimizes a cubic model with additional quadratic regularization and then contracts the step toward the current point. After iterations, the method achieves the expected convergence rate . Building on this construction, we develop an accelerated variant achieving , matching the known lower bounds of Agafonov et al. (2024) in all three terms.
Main resultThe abstract does not state a limitation.
Appeared: Friday, October 9. arXiv. Preprint, not yet peer-reviewed.