Skip to Main content Skip to Navigation
Book sections

Cyber Security and Privacy Experiments: A Design and Reporting Toolkit

Abstract : With cyber security increasingly flourishing into a scientific discipline, there has been a number of proposals to advance evidence-based research, ranging from introductions of evidence-based methodology [8], proposals to make experiments dependable [30], guidance for experiment design [8, 38], to overviews of pitfalls to avoid when writing about experiments [42]. However, one is still given to wonder: What are the best practices in reporting research that act as tell-tale signs of reliable research.We aim at developing a set of indicators for complete reporting that can drive the quality of experimental research as well as support the reviewing process.As method, we review literature on key ingredients for sound experiment and studied fallacies and shortcomings in other fields. We draw on lessons learned and infuse them into indicators. We provide definition, reporting examples, importance and impact and guiding steps to be taken for each indicator.As results, we offer a toolkit with nine systematic indictors for designing and reporting experiments. We report on lessons and challenges from an initial sharing of this toolkit with the community.The toolkit is a valuable companion for researchers. It incites the consideration of scientific foundations at experiment design and reporting phases. It also supports program committees and reviewers in quality decisions, thereby impacting the state of our field.
Document type :
Book sections
Complete list of metadata

Cited literature [48 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Friday, September 28, 2018 - 2:02:44 PM
Last modification on : Friday, September 28, 2018 - 3:11:22 PM
Long-term archiving on: : Monday, December 31, 2018 - 10:10:56 AM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Kovila Coopamootoo, Thomas Gross. Cyber Security and Privacy Experiments: A Design and Reporting Toolkit. Marit Hansen; Eleni Kosta; Igor Nai-Fovino; Simone Fischer-Hübner. Privacy and Identity Management. The Smart Revolution : 12th IFIP WG 9.2, 9.5, 9.6/11.7, 11.6/SIG 9.2.2 International Summer School, Ispra, Italy, September 4-8, 2017, Revised Selected Papers, AICT-526, Springer International Publishing, pp.243-262, 2018, IFIP Advances in Information and Communication Technology, 978-3-319-92924-8. ⟨10.1007/978-3-319-92925-5_17⟩. ⟨hal-01883618⟩



Record views


Files downloads