Seven Guiding Scenarios for Information Visualization Evaluation

Heidi Lam 1 Enrico Bertini 2 Petra Isenberg 3 Catherine Plaisant 4 Sheelagh Carpendale 5
2 Department of Computer Science
Department of Computer and Information Science, University of Konstanz
3 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France
4 HCIL
Department of Computer Science [College Park]
5 InnoVis
CPSC - Department of Computer Science [Calgary]
Abstract : We take a new, scenario based look at evaluation in information visualization. Our seven scenarios, evaluating visual data analysis and reasoning, evaluating user performance, evaluating user experience, evaluating environments and work practices, evaluating communication through visualization, automated evaluation of visualizations, and evaluating collaborative data analysis were derived through an extensive literature review of over 800 visualization publications. These scenarios are described through their goals, the types of questions they embody and illustrated through example studies. Through this broad survey and the distillation of these scenarios we make two contributions. One, we encapsulate the current practices in the information visualization research community and, two, we provide a different approach to reaching decisions about what might be the most effective evaluation of a given information visualization. For example, if the research goals or evaluative questions are known they can be used to map to specific scenarios, where practical existing examples can be considered for effective evaluation approaches.
Document type :
Reports
Complete list of metadatas

Cited literature [92 references]  Display  Hide  Download


https://hal.inria.fr/hal-00723057
Contributor : Petra Isenberg <>
Submitted on : Tuesday, August 7, 2012 - 12:05:05 PM
Last modification on : Friday, August 2, 2019 - 2:30:10 PM
Long-term archiving on: Thursday, November 8, 2012 - 2:21:28 AM

Files

Lam_2011_SGS.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00723057, version 1

Collections

Citation

Heidi Lam, Enrico Bertini, Petra Isenberg, Catherine Plaisant, Sheelagh Carpendale. Seven Guiding Scenarios for Information Visualization Evaluation. [Research Report] 2011-992-04, 2011. ⟨hal-00723057⟩

Share

Metrics

Record views

1618

Files downloads

1101