Localization Gains from Explanation Regularization Should Not Be Interpreted as Faithfulness Gains.
En palabras de los autores
Training-time explanation regularization is often evaluated by whether saliency maps become more concentrated within annotated regions. We argue that this criterion alone is insufficient: transformation consistency, lesion localization, and faithfulness to the classifier are distinct properties and should be evaluated separately, particularly in medical imaging. We examine this distinction through a case study of Contrastive Grad-CAM Consistency (CGC) in three-class brain tumor MRI classification. Using a single-channel ResNet-50 with five-fold patient-grouped cross-validation, we compare a cross-entropy baseline with CGC. CGC changes overall Pointing Game (PG) from to and Relevance Mass Accuracy (RMA) from to , while classification accuracy changes from to . Perturbation-based faithfulness metrics show inconsistent changes: Insertion Area Under the Curve (IAUC) changes from to , whereas Deletion Area Under the Curve (DAUC) favors the baseline ( versus ; lower is better), and overall Iterative Removal Of Features (IROF) is for both models. These results support our position that improved spatial agreement with pathology should not be interpreted as a general improvement in explanation faithfulness. We therefore recommend property-specific evaluation in which the property targeted by the explanation objective, spatial agreement with reference regions, and model reliance are measured and reported separately.
Apareció: martes, 20 de octubre. arXiv. Preprint, todavía sin revisión por pares.