HCI Statistics without p-values

Pierre Dragicevic 1
1 AVIZ - Analysis and Visualization
Inria Saclay - Ile de France
Abstract : Statistics are tools to help end users (here,researchers) accomplish their task (advance scientific knowledge). Science is a collective and cumulative enterprise, so to be qualified as usable, statistical tools should support and promote clear thinking as well as clear and truthful communication. Yet areas such as human-computer interaction (HCI) have adopted tools – i.e., p-values and statistical significance testing – that have proven to be quite poor at supporting these tasks. The use and misuse of p-values and significance testing has been severely criticized in a range of disciplines for several decades, suggesting that tools should be blamed, not end users. This article explains why it would be beneficial for HCI to switch from statistical significance testing to estimation, i.e., reporting informative charts with effect sizes and confidence intervals, and offering nuanced interpretations of our results. Advice is offered on how to communicate our empirical results in a clear, accurate, and transparent way without using any p-value.
Document type :
Reports
Complete list of metadatas

Cited literature [116 references]  Display  Hide  Download

https://hal.inria.fr/hal-01162238
Contributor : Pierre Dragicevic <>
Submitted on : Tuesday, June 9, 2015 - 11:28:32 PM
Last modification on : Saturday, February 18, 2017 - 1:14:44 AM
Long-term archiving on : Tuesday, April 25, 2017 - 7:11:55 AM

File

RR-8738.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

  • HAL Id : hal-01162238, version 1

Citation

Pierre Dragicevic. HCI Statistics without p-values. [Research Report] RR-8738, Inria. 2015, pp.32. ⟨hal-01162238⟩

Share

Metrics

Record views

673

Files downloads

7003