My Technique is 20% Faster: Problems with Reports of Speed Improvements in HCI - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2012

My Technique is 20% Faster: Problems with Reports of Speed Improvements in HCI

Pierre Dragicevic

Résumé

In human-computer interaction (HCI), speed improvements are often used as an informal measure of effect size, with statements such as "technique A was about 20% faster than technique B". Such statements are however surrounded by confusion. A quick analysis of the literature reveals that half of the time, the term "% faster" actually refers to a percent change in task completion time, while one third of the time it correctly refers to a percent change in speed. The rest of the time, the meaning is unknown or the calculation is wrong. We explain why percent changes are inherently confusing, and propose to focus effect size discussions on ratios, or on measures of percent difference where the normalizer is the mean of the compared values. When percent changes need to be reported, it is suggested to focus the discussion on improvements in task completion times rather than speed.
Fichier principal
Vignette du fichier
percentfaster-techreport.pdf (219.84 Ko) Télécharger le fichier
Vignette du fichier
thumbnail.png (6.83 Ko) Télécharger le fichier
Vignette du fichier
nissan-sx-848903_960_720.jpg (182.38 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00739237 , version 1 (29-11-2016)

Identifiants

  • HAL Id : hal-00739237 , version 1

Citer

Pierre Dragicevic. My Technique is 20% Faster: Problems with Reports of Speed Improvements in HCI. [Research Report] Inria Saclay Ile de France. 2012. ⟨hal-00739237⟩
638 Consultations
656 Téléchargements

Partager

Gmail Facebook X LinkedIn More