Dropping Tokens Without Dropping Them: Causal Attribution for Diabetic Retinopathy
En palabras de los autores
In this work, we investigate whether attention-based attribution maps in a vision transformer provide causal explanations for diabetic retinopathy (DR) classification. We introduce a principled decomposition of attention into two attribution maps: the contribution (), which satisfies the completeness axiom in explainable artificial intelligence (xAI), and the pull (), which quantifies causal explanations. We define an identity relating and that characterizes when fails to capture causality. We test whether each map is causally faithful on the MAPLES-DR dataset by dropping/inserting tokens, and report Necessity (), Sufficiency (), and Faithfulness Correlation (). The pull achieves the highest causal alignment (, , ), outperforming Attention Rollout, Grad-CAM, and AttnLRP. Occlusion retains better sufficiency () but is about 800 times slower. Furthermore, on MAPLES-DR, achieves of the average precision (AP) of HRDecoder, a state-of-the-art supervised lesion segmentation model, despite the absence of pixel-level supervision. Together, these findings show that the pull and the contribution form computationally efficient attribution maps for reliable causal interpretation in safety-critical medical diagnostics. The code and demo are available at https://github.com/pramath-haritz/dr-xai.
Apareció: martes, 10 de noviembre. arXiv. Preprint, todavía sin revisión por pares.
Comentario de los autores: 4 pages, 2 figures. Submitted to ISBI 2027