Design of an Explainable Machine Learning Challenge for Video Interviews

Abstract : This paper reviews and discusses research advances on “explainable machine learning” in computer vision. We focus on a particular area of the “Looking at People” (LAP) thematic domain: first impressions and personality analysis. Our aim is to make the computational intelligence and computer vision communities aware of the importance of developing explanatory mechanisms for computer-assisted decision making applications, such as automating recruitment. Judgments based on personality traits are being made routinely by human resource departments to evaluate the candidates' capacity of social insertion and their potential of career growth. However, inferring personality traits and, in general, the process by which we humans form a first impression of people, is highly subjective and may be biased. Previous studies have demonstrated that learning machines can learn to mimic human decisions. In this paper, we go one step further and formulate the problem of explaining the decisions of the models as a means of identifying what visual aspects are important, understanding how they relate to decisions suggested, and possibly gaining insight into undesirable negative biases. We design a new challenge on explainability of learning machines for first impressions analysis. We describe the setting, scenario, evaluation metrics and preliminary outcomes of the competition. To the best of our knowledge this is the first effort in terms of challenges for explainability in computer vision. In addition our challenge design comprises several other quantitative and qualitative elements of novelty, including a “coopetition” setting, which combines competition and collaboration.
Type de document :
Communication dans un congrès
IJCNN 2017 - 30th International Joint Conference on Neural Networks, May 2017, Anchorage, AK, United States. IEEE, pp.1-8, 2017, Neural Networks (IJCNN), 2017 International Joint Conference on. 〈http://www.ijcnn.org/〉. 〈10.1109/IJCNN.2017.7966320〉
Liste complète des métadonnées

Littérature citée [45 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01668386
Contributeur : Isabelle Guyon <>
Soumis le : vendredi 5 janvier 2018 - 21:58:37
Dernière modification le : mercredi 25 avril 2018 - 01:31:21

Fichier

design-explainable-machine.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Hugo Jair Escalante, Isabelle Guyon, Sergio Escalera, Julio Jacques, Meysam Madadi, et al.. Design of an Explainable Machine Learning Challenge for Video Interviews. IJCNN 2017 - 30th International Joint Conference on Neural Networks, May 2017, Anchorage, AK, United States. IEEE, pp.1-8, 2017, Neural Networks (IJCNN), 2017 International Joint Conference on. 〈http://www.ijcnn.org/〉. 〈10.1109/IJCNN.2017.7966320〉. 〈hal-01668386〉

Partager

Métriques

Consultations de la notice

580

Téléchargements de fichiers

367