pipette
ESEspañol

Matching the Lower Bounds: Stochastic Contracting Cubic Newton and Its Optimal Acceleration

Artem Agafonov, Aslan Ashabokov, Dmitry Kamzolov, Alexander D'yakonov, Alexander Gasnikov, Martin Tak\'a\v{c}

Preprint

In the authors' words

We study second-order methods for convex stochastic optimization, where gradients and Hessians are available only through stochastic estimates with variances and , respectively. First, we propose the Stochastic Contracting Cubic Newton method. At each iteration, it minimizes a cubic model with additional quadratic regularization and then contracts the step toward the current point. After iterations, the method achieves the expected convergence rate . Building on this construction, we develop an accelerated variant achieving , matching the known lower bounds of Agafonov et al. (2024) in all three terms.

Main resultThe abstract does not state a limitation.

Appeared: Friday, October 9. arXiv. Preprint, not yet peer-reviewed.