On the Automatic Assessment of Natural Language Expert Explanations in Medicine - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

On the Automatic Assessment of Natural Language Expert Explanations in Medicine

Résumé

The importance of explanations in decision-making, particularly in the medical domain, has been widely recognized. However, the evaluation of the quality of these explanations remains a challenging task. In this work, we propose a novel approach for assessing and evaluating the reasons provided in explanations about clinical cases. Our approach leverages an external knowledge base and a defined prevalence function to score each reason based on its pertinence in the domain. By applying a deterministic prevalence function, we ensure total transparency of the reasons' assessment, facilitating a precise explanation of the rationale behind the scoring hierarchy of each reason. We demonstrate the effectiveness of our approach in clinical cases, where medical experts explain the rationale behind a specific diagnosis and why other potential diagnoses are dismissed. Our methodology provides a nuanced and detailed evaluation of the explanation, contributing to a more comprehensive understanding of the decision-making process.
Fichier principal
Vignette du fichier
paper8.pdf (1.59 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04371254 , version 1 (03-01-2024)

Licence

Paternité

Identifiants

  • HAL Id : hal-04371254 , version 1

Citer

Santiago Marro, Theo Alkibiades Collias, Elena Cabrio, Serena Villata. On the Automatic Assessment of Natural Language Expert Explanations in Medicine. AIxIA 2023 - 22nd International Conference of the Italian Association for Artificial Intelligence, Nov 2023, Rome, Italy. pp.83--98. ⟨hal-04371254⟩
72 Consultations
31 Téléchargements

Partager

Gmail Facebook X LinkedIn More