pipette
ENEnglish

Deep learning perturbation models can outperform baselines on calibrated metrics

Henry E. Miller, Gabriel Mejia, Francis Leblanc, Brendan Swain, Bo Wang, Lucas Paulo de Lima Camillo

Revista con revisión por pares

En palabras de los autores

Abstract Recent benchmarks report that deep-learning-based genetic perturbation models fail to outperform uninformative baselines. Here we introduce a positive control baseline and metric calibration framework, showing—across 14 datasets and 18 metrics—that common benchmarking metrics (for example, mean squared error and Pearson Δ ) are frequently miscalibrated, with reduced sensitivity to measure positive model performance. Under well-calibrated metrics, we find that deep-learning-based genetic perturbation models can outperform uninformative baselines.

Resultado principalEl resumen no menciona limitaciones.

Apareció: sábado, 3 de octubre. Nature Biotechnology. Revista con revisión por pares.

DOI: 10.1038/s41587-026-03307-w