Your Paper has been Accepted, Rejected, or Whatever: Automatic Generation of Scientific Paper Reviews

Abstract : Peer review is widely viewed as an essential step for ensuring scientific quality of a work and is a cornerstone of scholarly publishing. On the other hand, the actors involved in the publishing process are often driven by incentives which may, and increasingly do, undermine the quality of published work, especially in the presence of unethical conduits. In this work we investigate the feasibility of a tool capable of generating fake reviews for a given scientific paper automatically. While a tool of this kind cannot possibly deceive any rigorous editorial procedure, it could nevertheless find a role in several questionable scenarios and magnify the scale of scholarly frauds.A key feature of our tool is that it is built upon a small knowledge base, which is very important in our context due to the difficulty of finding large amounts of scientific reviews. We experimentally assessed our method 16 human subjects. We presented to these subjects a mix of genuine and machine generated reviews and we measured the ability of our proposal to actually deceive subjects judgment. The results highlight the ability of our method to produce reviews that often look credible and may subvert the decision.
Type de document :
Communication dans un congrès
Francesco Buccafurri; Andreas Holzinger; Peter Kieseberg; A Min Tjoa; Edgar Weippl. International Conference on Availability, Reliability, and Security (CD-ARES), Aug 2016, Salzburg, Austria. Springer International Publishing, Lecture Notes in Computer Science, LNCS-9817, pp.19-28, 2016, Availability, Reliability, and Security in Information Systems. 〈10.1007/978-3-319-45507-5_2〉
Liste complète des métadonnées

Littérature citée [37 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01635011
Contributeur : Hal Ifip <>
Soumis le : mardi 14 novembre 2017 - 16:06:45
Dernière modification le : mercredi 15 novembre 2017 - 01:15:13
Document(s) archivé(s) le : jeudi 15 février 2018 - 14:03:09

Fichier

 Accès restreint
Fichier visible le : 2019-01-01

Connectez-vous pour demander l'accès au fichier

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Alberto Bartoli, Andrea De Lorenzo, Eric Medvet, Fabiano Tarlao. Your Paper has been Accepted, Rejected, or Whatever: Automatic Generation of Scientific Paper Reviews. Francesco Buccafurri; Andreas Holzinger; Peter Kieseberg; A Min Tjoa; Edgar Weippl. International Conference on Availability, Reliability, and Security (CD-ARES), Aug 2016, Salzburg, Austria. Springer International Publishing, Lecture Notes in Computer Science, LNCS-9817, pp.19-28, 2016, Availability, Reliability, and Security in Information Systems. 〈10.1007/978-3-319-45507-5_2〉. 〈hal-01635011〉

Partager

Métriques

Consultations de la notice

15