pipette
ESEspañol

Localization Gains from Explanation Regularization Should Not Be Interpreted as Faithfulness Gains.

Amrin Akter, Mauro Dalla Mura, Diana Mateus, Dawood Al Chanti

Preprint

In the authors' words

Training-time explanation regularization is often evaluated by whether saliency maps become more concentrated within annotated regions. We argue that this criterion alone is insufficient: transformation consistency, lesion localization, and faithfulness to the classifier are distinct properties and should be evaluated separately, particularly in medical imaging. We examine this distinction through a case study of Contrastive Grad-CAM Consistency (CGC) in three-class brain tumor MRI classification. Using a single-channel ResNet-50 with five-fold patient-grouped cross-validation, we compare a cross-entropy baseline with CGC. CGC changes overall Pointing Game (PG) from to and Relevance Mass Accuracy (RMA) from to , while classification accuracy changes from to . Perturbation-based faithfulness metrics show inconsistent changes: Insertion Area Under the Curve (IAUC) changes from to , whereas Deletion Area Under the Curve (DAUC) favors the baseline ( versus ; lower is better), and overall Iterative Removal Of Features (IROF) is for both models. These results support our position that improved spatial agreement with pathology should not be interpreted as a general improvement in explanation faithfulness. We therefore recommend property-specific evaluation in which the property targeted by the explanation objective, spatial agreement with reference regions, and model reliance are measured and reported separately.

Main resultThe abstract does not state a limitation.

Appeared: Tuesday, October 20. arXiv. Preprint, not yet peer-reviewed.