Skip to Main content Skip to Navigation
Conference papers

The Impact of a Low Level of Agreement Among Reviewers in a Code Review Process

Abstract : Software code review systems are commonly used in software development. In these systems, many patches are submitted to improve the quality. To verify the quality, voting is commonly used by contributors; however, there still exists a major problem, namely, that reviewers do not always simply reach a broad agreement. In our previous study, we found that consensus is not usually reached, implying that an individual reviewer’s final decision usually differs from that of the majority of the other reviewers. In this study, we further investigate the reasons why such situations often occur, and provide suggestions for better handling of these problems. Our analysis of the Qt and OpenStack project datasets allow us to suggest that a patch owner should select more appropriate reviewers who often agree with others’ decisions.
Document type :
Conference papers
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/hal-01369055
Contributor : Hal Ifip <>
Submitted on : Tuesday, September 20, 2016 - 2:15:42 PM
Last modification on : Tuesday, September 20, 2016 - 2:25:55 PM

File

426535_1_En_8_Chapter.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Toshiki Hirao, Akinori Ihara, Yuki Ueda, Passakorn Phannachitta, Ken-Ichi Matsumoto. The Impact of a Low Level of Agreement Among Reviewers in a Code Review Process. 12th IFIP International Conference on Open Source Systems (OSS), May 2016, Gothenburg, Sweden. pp.97-110, ⟨10.1007/978-3-319-39225-7_8⟩. ⟨hal-01369055⟩

Share

Metrics

Record views

166

Files downloads

208