Optimal Randomized Proper Online Learning

More on Learning theory & optimization that day

• AI & machine learning/Learning theory & optimizationSep 21, 2026

  Bilevel Optimization of Topology and Hyperparameters (BOTH)

  Here, we propose differentiating TO itself using automatic differentiation.

  Suryanarayanan Manoj Sanu, Miguel Anibal Bessa, Alejandro Marcos Arag\'on — arXiv

  PreprintBold claims, read critically

  Save
• AI & machine learning/Learning theory & optimizationSep 21, 2026

  A Smoothed Discrepancy Principle for Random Feature Methods and Neural Networks

  Building on the discrepancy principle, we propose a multi-scale stopping rule that applies to general kernel estimators and show that, unlike previous approaches, it achieves full adaptivity over all smoothness levels in the well-specified case.

  Mike Nguyen, Nicole M\"ucke — arXiv

  Preprint

  Save
• AI & machine learning/Learning theory & optimizationSep 21, 2026

  Extreme classification: beating chance with one training example from each class

  A measurable encoding then gives a deterministic distribution-free rule which beats chance on every countably generated measurable space, in particular every separable metric space.

  Kevin Bleakley, Aaditya Ramdas — arXiv

  Preprint

  Save
• AI & machine learning/Learning theory & optimizationSep 21, 2026

  Diagonalized Attention for Individualized Regression: Latent-Row Localization and Prediction

  To estimate this model, we introduce a diagonalized attention mechanism that uses query--key scores to localize sample-specific signal rows and a value matrix for downstream regression.

  Borui Peng, Liwei Lin, Feifei Wang and 1 more — arXiv

  Preprint

  Save
• AI & machine learning/Learning theory & optimizationSep 21, 2026

  What Must Survive? Exact Task-Information--State Frontiers for Resource-Sufficient Learning

  For an advice alphabet of size $K$, the exact frontier is \[ p^*(K)= \min_{\substack{\Pcal partition of \U\\|\Pcal|\le K}} \max_{C\in\Pcal}\rank(T_C), \] with the $b$-bit frontier obtained by setting $K=\min (2^b,|\text{U}|)$.

  Ronald Katende — arXiv

  Preprint

  Save

All new papers on Learning theory & optimization