Simpler Methods Work Better for L1 Penalized Logistic Models and Large Datasets

Edward Raff; James Holt

IA y aprendizaje automáticoOtro aprendizaje automático

Simpler Methods Work Better for L1 Penalized Logistic Models and Large Datasets

Edward Raff, James Holt

PreprintAfirmaciones fuertes, leer con cuidado

En palabras de los autores

Linear models with an $L_{1}$ -norm penalty remain state-of-the-art for high-dimensional ( $d > 1, 000, 000$ ) tasks, offering a straightforward method for solving real-world industry problems. Despite their widespread use in industry and utility, many $L_{1}$ solvers are not effective for general use, are prohibitively slow, and are ineffective in parallelization. This makes them difficult to train in an MLOps pipeline on large industry-scale corpora. In this work, we test several proposed "state-of-the-art" solutions from the literature and find that older methods are currently far superior for general use. We also identify several recommendations for academics to perform research that avoids erroneously overconfident results, which can prevent the transition to production use. Equally surprising, we find that a new and simple baseline, using LBFGS on a sub-gradient, is highly effective with minor tweaks, despite being dismissed in the literature for theoretical non-convergence. In practice, we find it is an easier-to-support and easier-to-scale method for production use.

Resultado principalEl resumen no menciona limitaciones.

Leer el paper PDF

Apareció: martes, 22 de septiembre. arXiv. Preprint, todavía sin revisión por pares.

Comentario de los autores: To appear in The 13th IEEE International Conference on Data Science and Advanced Analytics (DSAA 2026)

IA y aprendizaje automático Otro aprendizaje automático 22 de sept de 2026
Complex-valued Phase-Coherent Transformers
The resulting family of phase-coherent Transformers (\PCT) matches or exceeds the strongest real-valued baseline across long-range memory, positional retrieval, hierarchical reasoning, frequency-domain classification and physical complex signals; it shows no degradation up to depth 20; and its loss decreases log-linearly over a 61-fold range of parameters.
Leona Hioki — arXiv
PreprintAfirmaciones fuertes, leer con cuidadoDice ser un gran avance
IA y aprendizaje automático Otro aprendizaje automático 22 de sept de 2026
Ask for Any Appliance: A Prompt-Programmable Foundation Model for Non-Intrusive Load Monitoring
We present FM4NILM (Foundation Model for NILM), a single prompt-programmable model that estimates a requested appliance's power trajectory from aggregate measurements, a natural-language description, and optional activation exemplars.
Xudong Wang, Jiacheng Cui, Junyu Xue y 2 más — arXiv
PreprintUso en el mundo real
IA y aprendizaje automático Otro aprendizaje automático 22 de sept de 2026
Prior-Amortized In-Context Bayesian Inference for Generalized Linear Mixed-Effects Models
We introduce metabeta, a pretrained neural network for prior-amortized in-context Bayesian inference over GLMMs.
Alex Kipnis, Marcel Binz, Eric Schulz — arXiv
Preprint
IA y aprendizaje automático Otro aprendizaje automático 22 de sept de 2026
DiaSeg: Diagonal Segment Extraction from DTW Paths for Interpretable Gait Analysis
We introduce DiaSeg, a framework that extracts diagonal segments from DTW paths with controlled breaks, characterizing each segment by five geometric features (effective length, interruption count, cost variation, temporal position, and path context), and enabling unsupervised pattern discovery without domain-specific feature engineering.
Tresor Y. Koffi, Amel Hidouri, Corentin Legrand y 1 más — arXiv
PreprintUso en el mundo real
IA y aprendizaje automático Otro aprendizaje automático 22 de sept de 2026
Brain-Token Learning: Microstate-Based Tokenization and Multi-Scale Interaction for Long-Horizon EEG Sequence Modeling
In this work, we propose Brain-Token Learning, a neuroscience-inspired framework that introduces Brain Tokenization for long-horizon EEG sequence modeling.
Weishan Ye, Yue Pan, Li Zhang y 2 más — arXiv
Preprint

Todos los papers nuevos de Otro aprendizaje automático

Simpler Methods Work Better for L1 Penalized Logistic Models and Large Datasets

En palabras de los autores

Más de Otro aprendizaje automático ese día

Complex-valued Phase-Coherent Transformers

Ask for Any Appliance: A Prompt-Programmable Foundation Model for Non-Intrusive Load Monitoring

Prior-Amortized In-Context Bayesian Inference for Generalized Linear Mixed-Effects Models

DiaSeg: Diagonal Segment Extraction from DTW Paths for Interpretable Gait Analysis

Brain-Token Learning: Microstate-Based Tokenization and Multi-Scale Interaction for Long-Horizon EEG Sequence Modeling