Shaping Up SHAP: Enhancing Stability through Layer-Wise Neighbor Selection - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Shaping Up SHAP: Enhancing Stability through Layer-Wise Neighbor Selection

Résumé

Machine learning techniques, such as deep learning and ensemble methods, are widely used in various domains due to their ability to handle complex real-world tasks. However, their black-box nature has raised multiple concerns about the fairness, trustworthiness, and transparency of computerassisted decision-making. This has led to the emergence of local post-hoc explainability methods, which offer explanations for individual decisions made by black-box algorithms. Among these methods, Kernel SHAP is widely used due to its model-agnostic nature and its well-founded theoretical framework. Despite these strengths, Kernel SHAP suffers from high instability: different executions of the method with the same inputs can lead to significantly different explanations, which diminishes the utility of post-hoc explainability. The contribution of this paper is twofold. On the one hand, we show that Kernel SHAP's instability is caused by its stochastic neighbor selection procedure, which we adapt to achieve full stability without compromising explanation fidelity. On the other hand, we show that by restricting the neighbors generation to perturbations of size 1-which we call the coalitions of Layer 1-we obtain a novel featureattribution method that is fully stable, computationally efficient, and still meaningful.
Fichier principal
Vignette du fichier
Shaping_up_SHAP-2.pdf (1.55 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04413022 , version 1 (23-01-2024)

Licence

Paternité

Identifiants

  • HAL Id : hal-04413022 , version 1

Citer

Gwladys Kelodjou, Laurence Rozé, Véronique Masson, Luis Galárraga, Romaric Gaudel, et al.. Shaping Up SHAP: Enhancing Stability through Layer-Wise Neighbor Selection. AAAI 2024 - 38th Annual AAAI Conference on Artificial Intelligence, Feb 2024, Vancouver, Canada. pp.1-10. ⟨hal-04413022⟩
28 Consultations
12 Téléchargements

Partager

Gmail Facebook X LinkedIn More