Externalized CPDAG Summaries Improve LLM Causal Deduction
In the authors' words
Corr2Cause asks whether a causal claim holds in every DAG compatible with observed correlations and conditional independencies. We frame this as latent-object reasoning: the label is defined by a CPDAG query, but free-form chain-of-thought often collapses the Markov-equivalence-class problem into local pattern matching. We propose Structured Thinking, a two-turn pipeline that first externalizes a typed, schema-constrained CPDAG summary and then answers against that graph state. On the Corr2Cause full test, Structured Thinking raises Qwen3.5-27B from to (Yes) over a strong PC-instruction baseline in the primary paired run ( pp; McNemar ; bootstrap CI [, ]); across three full-ID seeds, the mean gain is pp. A PC-scaffolded two-turn prose control reaches only , indicating that a detailed PC scaffold plus a schema-free prose intermediate is not sufficient. The same pattern holds on Qwen3.6-27B, Paraphrase-OOD, and GPT-5.4-mini. Scrambling the emitted CPDAG costs pp , and a full-split audit shows close agreement with the reference CPDAG (ID skeleton ; exact match ). These results support a bounded design principle: externalize the latent object that defines the label, constrain its form, and test whether downstream answers use it.
Appeared: Monday, September 28. arXiv. Preprint, not yet peer-reviewed.
Authors' comment: 18 pages, 2 figures. Accepted at NeurIPS 2026