Skip to Main content Skip to Navigation
Conference papers

Transparency of CHI Research Artifacts: Results of a Self-Reported Survey

Résumé : Several fields of science are experiencing a "replication crisis" that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress. Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers' research materials and data, how they share them, and why they do not. The results (N = 460/1356, 34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices. This paper and all data and materials are freely available at https://osf.io/csy8q
Document type :
Conference papers
Complete list of metadata

https://hal.inria.fr/hal-02989964
Contributor : Steve Haroz Connect in order to contact the contributor
Submitted on : Thursday, November 5, 2020 - 1:09:25 PM
Last modification on : Wednesday, November 3, 2021 - 2:56:06 PM

Links full text

Identifiers

Citation

Chatchavan Wacharamanotham, Lukas Eisenring, Steve Haroz, Florian Echtler. Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. CHI Conference on Human Factors in Computing Systems, 2020, Event not held due to COVID, Unknown Region. ⟨10.31219/osf.io/3bu6t⟩. ⟨hal-02989964⟩

Share

Metrics

Record views

73