pipette
ESEspañol

The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models

Shihui Li, Mette Andersen, Martha Lewis

Preprint

In the authors' words

Metaphor is a crucial aspect of human cognition. As such, we would like to understand how it is represented in large language models (LLMs) and how it might be controlled. We use mechanistic interpretability techniques to identify causal subspaces in a range of LLMs covering different architectures and sizes. We show that we are able to steer output on classification tasks across different parts of speech. We are also able to steer output on generation tasks, indicating that these techniques can be used to control the metaphoricity of LLM output.

Main resultThe abstract does not state a limitation.

Appeared: Friday, October 23. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: BlackboxNLP 2026: The 9th Workshop on Analyzing and Interpreting Neural Networks for NLP