Skip to Main content Skip to Navigation
Conference papers

On Fair Selection in the Presence of Implicit Variance

Abstract : Quota-based fairness mechanisms like the so-called Rooney rule or four-fifths rule are used in selection problems such as hiring or college admission to reduce inequalities based on sensitive demographic attributes. These mechanisms are often viewed as introducing a trade-off between selection fairness and utility. In recent work, however, Kleinberg and Raghavan showed that, in the presence of implicit bias in estimating candidates' quality, the Rooney rule can increase the utility of the selection process. We argue that even in the absence of implicit bias, the estimates of candidates' quality from different groups may differ in another fundamental way, namely, in their variance. We term this phenomenon implicit variance and we ask: can fairness mechanisms be beneficial to the utility of a selection process in the presence of implicit variance (even in the absence of implicit bias)? To answer this question, we propose a simple model in which candidates have a true latent quality that is drawn from a group-independent normal distribution. To make the selection, a decision maker receives an unbiased estimate of the quality of each candidate, with normal noise, but whose variance depends on the candidate's group. We then compare the utility obtained by imposing a fairness mechanism that we term $\gamma$-rule (it includes demographic parity and the four-fifths rule as special cases), to that of a group-oblivious selection algorithm that picks the candidates with the highest estimated quality independently of their group. Our main result shows that the demographic parity mechanism always increases the selection utility, while any $\gamma$-rule weakly increases it. We extend our model to a two-stage selection process where the true quality is observed at the second stage. We discuss multiple extensions of our results, in particular to different distributions of the true latent quality.
Complete list of metadatas

https://hal.inria.fr/hal-02880578
Contributor : Vitalii Emelianov <>
Submitted on : Thursday, June 25, 2020 - 9:59:19 AM
Last modification on : Thursday, July 9, 2020 - 9:45:38 AM

Links full text

Identifiers

Citation

Vitalii Emelianov, Nicolas Gast, Krishna P. Gummadi, Patrick Loiseau. On Fair Selection in the Presence of Implicit Variance. The Twenty-First ACM Conference on Economics and Computation (EC'20), Jul 2020, Budapest, Hungary. ⟨10.1145/3391403.3399482⟩. ⟨hal-02880578⟩

Share

Metrics

Record views

41