pipette
ENEnglish

Tight Stationarity Transfer and Repeatability for Inexact Proximal-Gradient Methods

Shenghan Mei

Preprint

En palabras de los autores

Proximal-gradient methods are widely used for composite optimization, but inexact proximal updates introduce a residual in the proximal optimality condition, complicating the analysis of how stationarity changes across a step. We study this question for composite objectives consisting of a smooth convex term and a possibly nonsmooth weakly convex term, focusing on the relationship between the directional-stationarity measures at the input and output points of an inexact proximal-gradient step. We first establish separate input and output bounds, but their combination can yield a conservative estimate because their worst-case residual directions may differ. By exploiting the magnitude and orientation of this shared residual, we establish tight joint bounds and derive an exact one-step stationarity-transfer factor that strictly improves the estimate from separate bounds in the short-step regime. We also identify the precise residual-tolerance threshold for finite uniform stationarity transfer. A further distinction emerges over multiple steps: endpoint worst cases can repeat over arbitrarily many iterations, whereas interior worst cases cannot persist across two consecutive steps, yielding strict two-step submultiplicativity. These results also provide principled tolerance-selection rules, descent estimates, and stationarity-complexity guarantees for inexact proximal-gradient methods.

Resultado principalEl resumen no menciona limitaciones.

Apareció: viernes, 30 de octubre. arXiv. Preprint, todavía sin revisión por pares.

Comentario de los autores: 22 pages, 2 figures