pipette
ESEspañol

On the Instance-Specific Sharp Rates for Constrained Least Squares Estimators in the Sequence Model

Zong Shang

Preprint

In the authors' words

We develop a general methodology based on the Feature Space Decomposition framework for establishing explicit, instance-specific sharp rates for the expected estimation error of convex-constrained least squares estimators in the sequence model, without requiring estimates of localized Gaussian mean widths. We apply this methodology to ellipsoids, balls, and , obtaining matching upper and lower bounds in the nondegenerate regime. Our methodology also extends beyond Gaussian noise to symmetric noise distributions satisfying a Poincar\'e inequality. We also provide an elementary proof of the instance-specific sharp rate for isotonic regression for any well-specified signal and any noise level. Combining this result with Han's asymptotic reduction, we further obtain explicit instance-specific sharp convergence rates in probability for isotonic regression in Gaussian linear regression under general signal-dependent asymptotics conditions.

Main resultLimitation the authors admit

Appeared: Tuesday, November 10. arXiv. Preprint, not yet peer-reviewed.