Narratives in Crowdsourced Evaluation of Visualizations: A Double-Edged Sword?

Evanthia Dimara 1 Anastasia Bezerianos 2 Pierre Dragicevic 1
1 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France
2 ILDA - Interacting with Large Data
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
Abstract : We explore the effects of providing task context when evaluating visualization tools using crowdsourcing. We gave crowd-workers i) abstract information visualization tasks without any context, ii) tasks where we added semantics to the dataset, and iii) tasks with two types of backstory narratives: an analytic narrative and a decision-making narrative. Contrary to our expectations , we did not find evidence that adding data semantics increases accuracy, and further found that our backstory narratives can even decrease accuracy. Adding dataset semantics can however increase attention and provide subjective benefits in terms of confidence, perceived easiness, task enjoyability and perceived usefulness of the visualization. Nevertheless, our backstory narratives did not appear to provide additional subjective benefits. These preliminary findings suggest that narratives may have complex and unanticipated effects, calling for more studies in this area.
Type de document :
Communication dans un congrès
ACM Conference on Human Factors in Computing Systems (CHI) , May 2017, Denver, United States. 〈10.1145/3025453.3025870〉
Liste complète des métadonnées

Littérature citée [51 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01448095
Contributeur : Evanthia Dimara <>
Soumis le : mardi 31 janvier 2017 - 17:23:19
Dernière modification le : jeudi 15 juin 2017 - 09:08:46
Document(s) archivé(s) le : lundi 1 mai 2017 - 13:02:00

Fichier

framing-paper-chi-2016.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité - Partage selon les Conditions Initiales 4.0 International License

Identifiants

Citation

Evanthia Dimara, Anastasia Bezerianos, Pierre Dragicevic. Narratives in Crowdsourced Evaluation of Visualizations: A Double-Edged Sword?. ACM Conference on Human Factors in Computing Systems (CHI) , May 2017, Denver, United States. 〈10.1145/3025453.3025870〉. 〈hal-01448095〉

Partager

Métriques

Consultations de la notice

582

Téléchargements de fichiers

427