pipette
ESEspañol

Self-Supervised Representation Learning for JWST Galaxy Images and Low Resolution Spectra

Yang Cheng, Morgan Fouesneau, Ivelina G. Momcheva, Tobias Buck, Shengxiu Sun

PreprintCode available

In the authors' words

A self-supervised multimodal model recovers galaxy stellar masses from sparse JWST data that lack the multi-band coverage required by traditional SED fitting. We train on single-band F150W imaging paired with observed-frame 1-2 m PRISM spectra and obtain a joint image-spectrum representation that recovers stellar mass at with and dex; cross-modal CLIP alignment further raises single-modality performance by (imaging) and (spectroscopy), narrowing the gap to joint-modality inference. The code and documentation are available at \href{https://github.com/2003cy/neurips2026_ssl_jwst}{GitHub}.

Main resultThe abstract does not state a limitation.

Appeared: Friday, October 23. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: 5 pages, 2 figures. Accepted for the NeurIPS 2026 RPS Workshop. Comments welcome. Detailed descriptions of the data, model training and additional benchmarks are included in the appendix (11 pages, 4 figures)