REViT-v2: Hierarchical Windowed Roto-reflection Equivariant ViT for Equivariant Feature Extraction
In the authors' words
We propose a scalable roto-reflection-group-equivariant vision transformer based on windowed group-convolutional self-attention and a hierarchical feature architecture. We demonstrate that our approach can be scaled to group-equivariant vision transformers (ViTs) with millions of parameters and large datasets with practically sized images, i.e., ImageNet. The code and pretrained weights for the proposed Hierarchical Windowed Roto-reflection Equivariant ViTs (REViT-v2) are available at https://github.com/kc-ml2/revit.
Main resultThe abstract does not state a limitation.
Appeared: Wednesday, October 7. arXiv. Preprint, not yet peer-reviewed.
Authors' comment: 7 pages, Accepted for presentation at NeurIPS NeurREPS workshop 2026