Conceptual and Methodological Issues in Evaluating Multidimensional Visualizations for Decision Support

Evanthia Dimara 1 Anastasia Bezerianos 2, 3 Pierre Dragicevic 1
1 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France
2 ILDA - Interacting with Large Data
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
Abstract : We explore how to rigorously evaluate multidimensional visualizations for their ability to support decision making. We first define multi-attribute choice tasks, a type of decision task commonly performed with such visualizations. We then identify which of the existing multidimensional visualizations are compatible with such tasks, and set out to evaluate three elementary visualizations: parallel coordinates, scatterplot matrices and tabular visualizations. Our method consists in first giving participants low-level analytic tasks, in order to ensure that they properly understood the visualizations and their interactions. Participants are then given multi-attribute choice tasks consisting of choosing holiday packages. We assess decision support through multiple objective and subjective metrics, including a decision accuracy metric based on the consistency between the choice made and self-reported preferences for attributes. We found the three visualizations to be comparable on most metrics, with a slight advantage for tabular visualizations. In particular, tabular visualizations allow participants to reach decisions faster. Thus, although decision time is typically not central in assessing decision support, it can be used as a tie-breaker when visualizations achieve similar decision accuracy. Our results also suggest that indirect methods for assessing choice confidence may allow to better distinguish between visualizations than direct ones. We finally discuss the limitations of our methods and directions for future work, such as the need for more sensitive metrics of decision support.
Type de document :
Article dans une revue
IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2018, 24, 〈10.1109/TVCG.2017.2745138〉
Liste complète des métadonnées

Littérature citée [91 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01584729
Contributeur : Evanthia Dimara <>
Soumis le : samedi 9 septembre 2017 - 11:11:39
Dernière modification le : mercredi 11 octobre 2017 - 01:20:34

Fichier

TVCG2745138.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Evanthia Dimara, Anastasia Bezerianos, Pierre Dragicevic. Conceptual and Methodological Issues in Evaluating Multidimensional Visualizations for Decision Support. IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2018, 24, 〈10.1109/TVCG.2017.2745138〉. 〈hal-01584729〉

Partager

Métriques

Consultations de la notice

106

Téléchargements de fichiers

105