pipette
ENEnglish

Localization Gains from Explanation Regularization Should Not Be Interpreted as Faithfulness Gains.

Amrin Akter, Mauro Dalla Mura, Diana Mateus, Dawood Al Chanti

Preprint

En palabras de los autores

Training-time explanation regularization is often evaluated by whether saliency maps become more concentrated within annotated regions. We argue that this criterion alone is insufficient: transformation consistency, lesion localization, and faithfulness to the classifier are distinct properties and should be evaluated separately, particularly in medical imaging. We examine this distinction through a case study of Contrastive Grad-CAM Consistency (CGC) in three-class brain tumor MRI classification. Using a single-channel ResNet-50 with five-fold patient-grouped cross-validation, we compare a cross-entropy baseline with CGC. CGC changes overall Pointing Game (PG) from to and Relevance Mass Accuracy (RMA) from to , while classification accuracy changes from to . Perturbation-based faithfulness metrics show inconsistent changes: Insertion Area Under the Curve (IAUC) changes from to , whereas Deletion Area Under the Curve (DAUC) favors the baseline ( versus ; lower is better), and overall Iterative Removal Of Features (IROF) is for both models. These results support our position that improved spatial agreement with pathology should not be interpreted as a general improvement in explanation faithfulness. We therefore recommend property-specific evaluation in which the property targeted by the explanation objective, spatial agreement with reference regions, and model reliance are measured and reported separately.

Resultado principalEl resumen no menciona limitaciones.

Apareció: martes, 20 de octubre. arXiv. Preprint, todavía sin revisión por pares.