pipette
ESEspañol

Sequential diagnosis with language models

Harsha Nori, Mayank Daswani, Christopher Kelly, Scott Lundberg, Marco Túlio Ribeiro, Marc Wilson, Xiaoxuan Liu, Viknesh Sounderajah, Jonathan M. Carlson, Matthew P. Lungren, Bay Gross, Peter Hames, Mustafa Suleyman, Dominic King, Eric Horvitz

Peer-reviewed journalReal-world use

In the authors' words

This journal does not let us republish the full abstract. Here are the two sentences Pipette selected, quoted from it. Read the rest at the publisher.

Main result
Using this benchmark, the system achieved 83.2% accuracy on New England Journal of Medicine clinicopathological conference cases and 80.3% on MIMIC-IV-ED emergency department admissions, outperforming generalist physicians (36.1 and 46.8%, respectively).
Limitation the authors admit
Although these findings were obtained in a controlled benchmark setting, they highlight the promise of language models for supporting more accurate, lower-cost diagnoses.

Appeared: Saturday, October 24. Science. Peer-reviewed journal.

DOI: 10.1126/science.aeh7930