Skip to Main content Skip to Navigation
Conference papers

Physiological Indicators for User Trust in Machine Learning with Influence Enhanced Fact-Checking

Abstract : Trustworthy Machine Learning (ML) is one of significant challenges of “black-box” ML for its wide impact on practical applications. This paper investigates the effects of presentation of influence of training data points on machine learning predictions to boost user trust. A framework of fact-checking for boosting user trust is proposed in a predictive decision making scenario to allow users to interactively check the training data points with different influences on the prediction by using parallel coordinates based visualization. This work also investigates the feasibility of physiological signals such as Galvanic Skin Response (GSR) and Blood Volume Pulse (BVP) as indicators for user trust in predictive decision making. A user study found that the presentation of influences of training data points significantly increases the user trust in predictions, but only for training data points with higher influence values under the high model performance condition, where users can justify their actions with more similar facts to the testing data point. The physiological signal analysis showed that GSR and BVP features correlate to user trust under different influence and model performance conditions. These findings suggest that physiological indicators can be integrated into the user interface of AI applications to automatically communicate user trust variations in predictive decision making.
Document type :
Conference papers
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download

https://hal.inria.fr/hal-02520035
Contributor : Hal Ifip <>
Submitted on : Thursday, March 26, 2020 - 1:48:29 PM
Last modification on : Tuesday, March 31, 2020 - 3:50:52 PM
Long-term archiving on: : Saturday, June 27, 2020 - 2:15:36 PM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2022-01-01

Please log in to resquest access to the document

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Jianlong Zhou, Huaiwen Hu, Zhidong Li, Kun Yu, Fang Chen. Physiological Indicators for User Trust in Machine Learning with Influence Enhanced Fact-Checking. 3rd International Cross-Domain Conference for Machine Learning and Knowledge Extraction (CD-MAKE), Aug 2019, Canterbury, United Kingdom. pp.94-113, ⟨10.1007/978-3-030-29726-8_7⟩. ⟨hal-02520035⟩

Share

Metrics

Record views

37