Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository

Abstract : Information Visualization (InfoVis) is now an accepted and growing field but questions remain about the best uses for and the maturity of novel visualizations. Usability studies and controlled experiments are helpful but generalization is difficult. We believe that the systematic development of benchmarks will facilitate the comparison of techniques and help identify their strengths under different conditions. We were involved in the organization and management of three information visualization contests for the 2003, 2004 and 2005 IEEE Information Visualization Symposia, which requested teams to report on insights gained while exploring data. We give a summary of the state of the art of evaluation in information visualization, describe the three contests, summarize their results, discuss outcomes and lessons learned, and conjecture the future of visualization contests. All materials produced by the contests are archived in the Information Visualization Benchmark Repository.
Document type :
Journal articles
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.inria.fr/hal-00701742
Contributor : Jean-Daniel Fekete <>
Submitted on : Saturday, May 26, 2012 - 11:43:51 AM
Last modification on : Tuesday, August 6, 2019 - 11:38:37 AM
Long-term archiving on : Monday, August 27, 2012 - 2:20:34 AM

File

2004-30.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Catherine Plaisant, Jean-Daniel Fekete, Georges Grinstein. Promoting Insight-Based Evaluation of Visualizations: From Contest to Benchmark Repository. IEEE Transactions on Visualization and Computer Graphics, Institute of Electrical and Electronics Engineers, 2008, 14 (1), pp.120-134. ⟨10.1109/TVCG.2007.70412⟩. ⟨hal-00701742⟩

Share

Metrics

Record views

346

Files downloads

1203