pipette
ENEnglish

Adaptive First-Order Methods with Composite Gradient Error

Artem Vasin, Alexander Tyurin, Alexander Gasnikov

Preprint

En palabras de los autores

We study first-order optimization with inexact gradients whose errors combine a component proportional to the true gradient norm and a uniformly bounded absolute component. We develop an adaptive gradient descent scheme that selects estimates of the smoothness constant and both error parameters through a computable backtracking condition using exact function values. Its analysis yields convergence for smooth objectives and functions satisfying Polyak-Lojasiewicz condition. For strongly convex objectives, we propose a composite-error intermediate gradient method, that adapts to unknown smoothness while using known error bounds and a strong convexity parameter . With fixed smoothness , acceleration is retained when , larger admissible errors yield intermediate rates. Throughout the range , the absolute error bound contributes at most to the objective residual, without additional amplification by the condition number.

Resultado principalEl resumen no menciona limitaciones.

Apareció: martes, 20 de octubre. arXiv. Preprint, todavía sin revisión por pares.