pipette
ESEspañol

Can small transformers learn the language of Coxeter groups?

J. Elisenda Grigsby, Yiyao Huang, Arushi Katyal, Ryan Lin, Pranav Ramakrishnan, Weiya Wang

Preprint

In the authors' words

The field of mechanistic interpretability is well-suited to collaborative projects between mathematicians and AI researchers. This work describes one such project. We trained a small transformer to learn the language of the Coxeter group affine A2, best known as the symmetries of the tiling of the Euclidean plane by equilateral triangles. We then formulated and proved a word-theoretic conjecture about affine A2 after observing the attention patterns of the trained model.

Main resultThe abstract does not state a limitation.

Appeared: Tuesday, November 10. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: 13 pages, 13 figures, accepted as a poster at the 6th workshop on Mathematical Reasoning and AI; NeurIPS 2026, Atlanta; This version is updated from the camera-ready version which can be found at https://mathai-2026.github.io/cfp/ and https