A Stochastic LineseArch Method (SLAM) for Minimizing Expectation Residuals: Weakening Boundedness of Gradient
In the authors' words
We establish convergence guarantees for the Stochastic LineseArch Method (SLAM) proposed and analyzed in Wang et al. (arXiv:2512.14979) for nonconvex composite stochastic optimization, retaining the iteration and sample complexity orders of the original analysis assuming neither the boundedness of true gradients nor the Lipschitz continuity of the convex nonsmooth term . ChatGPT was used to assist in developing a key intermediate result. Under uniformly Lipschitz continuous and unbiased sampled gradients with uniformly bounded variance with mini-batch sizes proportional to the iteration budget, SLAM achieves an iteration complexity and a sample complexity for obtaining an iterate whose expected proximal-gradient residual norm is at most .
Appeared: Friday, October 30. arXiv. Preprint, not yet peer-reviewed.