pipette
ESEspañol

Segment Anything for Microscopy 2

A. Archit, C. Teuber, T. Griebel, L. Marschhaeuser, B. Lohmann, M. Aakhte, N. Vornberger, S. von Haaren, M. Handberg-Thorsager, I. Bonne, D. Gruen, A. Beghin, J. Huisken, C. Pape

PreprintBold claims, read critically

In the authors' words

Foundation models have advanced microscopy image segmentation, but existing models are trained on two-dimensional data, struggle with complex structures in volumetric data, and address only a narrow range of analysis tasks. Here we present Segment Anything for Microscopy 2 (SAM2), a foundation model that adapts SAM2 to joint 2D and 3D segmentation in light and electron microscopy. Trained on annotations of more than 23 million cells and nuclei and 1.6 million cellular structures, SAM2 achieves state-of-the-art automatic and interactive segmentation and outperforms generalist and specialist methods on volumetric data. Dedicated models further enable accurate mitochondrion and nucleus segmentation in electron microscopy. Beyond segmentation, SAM2 supports pixel and object classification from few annotations as well as cell tracking in 2D and 3D time-lapse data. All functionality is available in the user-friendly SAM napari plugin. We demonstrated the capabilities of SAM2 on challenging use cases spanning developmental biology, organoid research, cardiac physiology, and histopathology.

Main resultThe abstract does not state a limitation.

Appeared: Wednesday, November 18. bioRxiv. Preprint, not yet peer-reviewed.

DOI: 10.64898/2026.11.12.766082