Exact Natarajan Dimension of Homogeneous Multiclass Linear Predictors
In the authors' words
The Natarajan dimension is a fundamental measure of the capacity of multiclass hypothesis classes and plays an important role in analyzing their generalization ability. In this paper, by establishing lower and upper bounds, we show that the exact Natarajan dimension of homogeneous multiclass linear predictors with pairwise distinct class weights is \(n(k-1)-1\), where is the dimension of the feature space and is the number of classes, for \(n,k\ge3\), \(n,k\in\mathbb N\).
Main resultThe abstract does not state a limitation.
Appeared: Tuesday, November 10. arXiv. Preprint, not yet peer-reviewed.
Authors' comment: 9 pages