Skip to Main content Skip to Navigation
New interface
Journal articles

Information Visualization Evaluation in Large Companies: Challenges, Experiences and Recommendations

Michael Sedlmair 1, 2 Petra Isenberg 3 Dominikus Baur 2 Andreas Butz 2 
3 AVIZ - Analysis and Visualization
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
Abstract : We examine the implications of evaluating data analysis processes and information visualization tools in a large company setting. While several researchers have addressed the difficulties of evaluating information visualizations with regards to changing data, tasks, and visual encodings, considerably less work has been published on the difficulties of evaluation within specific work contexts. We specifically focus on the challenges which arise in the context of large companies with several thousand employees. Based on our own experience from a 3.5-year collaboration within a large automotive company, we first present a collection of nine information visualization evaluation challenges. We then discuss these challenges by means of two concrete visualization case studies from our own work. We finally derive a set of sixteen recommendations for planning and conducting evaluations in large company settings. The set of challenges and recommendations and the discussion of our experience are meant to provide practical guidance to other researchers and practitioners who plan to study information visualization in large company settings.
Document type :
Journal articles
Complete list of metadata

Cited literature [51 references]  Display  Hide  Download
Contributor : Petra Isenberg Connect in order to contact the contributor
Submitted on : Saturday, November 5, 2011 - 4:39:30 PM
Last modification on : Sunday, June 26, 2022 - 11:54:47 AM
Long-term archiving on: : Monday, February 6, 2012 - 2:20:56 AM


Files produced by the author(s)




Michael Sedlmair, Petra Isenberg, Dominikus Baur, Andreas Butz. Information Visualization Evaluation in Large Companies: Challenges, Experiences and Recommendations. Information Visualization, 2011, 10 (3), pp.248--266. ⟨10.1177/1473871611413099⟩. ⟨inria-00638541⟩



Record views


Files downloads