pipette
ESEspañol

Two hidden layer suffice: the caterpillar net

Jakob Paul Zimmermann

PreprintCode available

In the authors' words

Every continuous piecewise linear (CPWL) function is a finite signed sum of maxima of affine functions, making maximum representation a central problem in the study of the expressiveness of ReLU networks. A now-disproved conjecture predicted logarithmic depth for maxima. Inspired by the proof by Brunck et al. (2026) that two hidden layers suffice for general CPWL functions, we give the Caterpillar Net, a nonrecursive construction for the maximum of inputs with two hidden layers of widths and . The construction has a direct geometric interpretation.

Main resultThe abstract does not state a limitation.

Appeared: Tuesday, October 20. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: 17 pages. Lean formalization and paper sources: https://github.com/JayPiZimmermann/Max_Caterpillar