pipette
ENEnglish

Behavioral Evaluation of Large Language Models Under Cognitive Biases in HAZOP Studies

Vinicius M. M\"uller, Vitor A. O. Silva, S\'avio S. V. Vianna, Fl\'avio V. Silva

PreprintUso en el mundo realCódigo disponible

En palabras de los autores

Hazard and Operability (HAZOP) studies safeguard industrial processes against catastrophic accidents. Large language models (LLMs) increasingly assist HAZOP drafting, yet evaluations rely on lexical overlap. Because LLMs internalize human heuristics, prompts may trigger biased judgments. Whether frontier LLMs withstand cognitive perturbations in safety-critical workflows remains unknown. Here we show across 420 trials that three frontier LLMs resisted 96.8% of cognitive manipulations, rendering overall susceptibility statistically inconclusive. Contrary to assumed broad fragility, models rejected confirmation and availability cues. However, safety-critical risk downgrades emerged under low anchors and gain frames. Thus, automated hazard analysis requires disciplined human-in-the-loop validation.

Resultado principalLimitación que admiten los autores

Apareció: martes, 10 de noviembre. arXiv. Preprint, todavía sin revisión por pares.

Comentario de los autores: 8 pages, 1 figure, 3 tables. Submitted to IFAC for possible publication. Supplementary material available at https://github.com/ViniMelloeMuller/psyhazop-supplementary-material