The “four-fifths rule” or “80 percent rule” of the Uniform Guidelines on Employee Selection Procedures is a rule of thumb whereby a selection process will be deemed to have a disparate impact if the success rate of the disadvantaged group is less than four-fifths (80%) of the success rate of the advantaged group. Clarifying Questions and Answers, however, indicate that in the case of policies such as refusing to hire applicants with arrest records (where well over 80% of both groups commonly meet the criterion of failing to have an arrest record and hence where the disadvantaged group’s rate of meeting the criterion cannot be less than 80% of the advantaged group’s rate) it would be appropriate to focus on disqualification rates rather than selection rates. As discussed in the June 23, 1993 Legal Times article “Getting it Straight When Statistics Can Lie,” a difficulty with this approach is that the alternative measures that typically would be deemed less discriminatory would tend to increase the disparity in adverse outcome rates. See the Lending Disparities and Discipline Disparities pages regarding federal civil rights enforcement policies based on the mistaken perception that reducing adverse outcome rates will reduce, rather than increase, relative differences in rates of experiencing those outcomes, with the consequence that an entity’s compliance with government encouragements to reduce adverse outcomes makes the entity more like to be sued for discrimination. See “Misunderstanding of Statistics Leads to Misguided Law Enforcement Policies” (Amstat News, Dec. 2012). See also the March 4, 2013 letter to the Federal Reserve Board, April 23, 2012 letter to the Department of Justice, and April 18, 2012 letter to the Department of Education attempting to explain this issue to those agencies. See also the Less Discriminatory Alternative - Substantive subpage of the Disparate Impact page of this site.
The point of this page, however, involves the problematic nature of the four-fifths rule as a measure of association. Many regard the four-fifths rule as a useful indicator of effect size (see, e.g., this explanation on the site adverseimpact.org) and, indeed, the rate ratio is commonly regarded as the most useful indicator of the size of an effect. But not only is a rate ratio not a useful indicator of effect size, it is illogical to regard the rate ratio as such. See the Illogical Premises II sub-page of the Scanlan’s Rule page (SR), which explains that it is illogical to regard a rate ratio as reflecting the same measure of association as to different baseline rates given that, if the rate ratios are the same as to one outcome, they must be different as to the opposite outcome. The point is easier to explain with regard to the mistaken perception that a factor will typically cause equal proportionate changes across a range of baseline rates, as discussed in the Subgroup Effects, Illogical Premises, and Inevitability of Interaction sub-pages of SR. See also the February 25, 2013 BMJ comment “Goodbye to the Rate Ratio.”
Table 1 below, which is an illustration akin to that in Table 1 of the 2009 Royal Statistical Society presentation, shows the various effect sizes (reflected by the EES for estimated effect size, see Solutions sub-page of Measuring Health Disparities), consistent with a situation where the success rates of the disadvantaged group is 80 percent of the success rate of the advantaged group (as reflected in the SRR column) The table thus shows at different overall selection rates (benchmarked by the selection rate of the advantaged group (AGSR)), an 80% disadvantaged to advantaged group selection rate ratio (SRR) means quite different things as to the strength of the forces causing the rates to differ.
The penultimate column (RRR for rejection rate ratio) shows how the matter would be viewed in terms of ratios of experiencing the adverse outcome (though the adverse outcome ratio is not more useful a measure of association than the favorable outcome ratio)..
In order to provide some perspective on meaning of each EES figure, the final column (%DG>AGMean) shows the proportion of the disadvantaged group risk distribution for the outcome at issue that is above the mean of the distribution of the advantaged group. By way of explanation, the first row reflects that fact that with a 0.1 standard deviation, 46.4% of the disadvantaged group is above the advantaged group mean, which is to say the distributions are fairly similar. The subsequent rows reflect increasingly dissimilar distributions.
For a fuller discussion of the implications of reliance on standard measures of differences between outcome rates in the employment context, see pages of 24-28 of the Harvard University Measurement Letter.
Table 1. Illustration of Differences in Level of Association Reflected by Situations Where Success Rate of Disadvantaged Group is Four-Fifths of the Success Rate of the Advantaged Group at Different Levels of Prevalence [ref b3811 a 3]
|
EES
|
DGSR
|
AGSR
|
SRR
|
FRR
|
%DG>AGMean
|
0.1
|
2.87%
|
3.59%
|
0.80
|
1.01
|
46.41%
|
0.2
|
28.43%
|
35.57%
|
0.80
|
1.11
|
42.47%
|
0.3
|
46.41%
|
57.93%
|
0.80
|
1.27
|
38.59%
|
0.4
|
58.32%
|
72.91%
|
0.80
|
1.54
|
34.83%
|
0.5
|
64.80%
|
81.06%
|
0.80
|
1.86
|
31.21%
|
0.6
|
69.15%
|
86.43%
|
0.80
|
2.27
|
27.76%
|
0.7
|
71.91%
|
89.97%
|
0.80
|
2.80
|
24.51%
|
0.8
|
73.89%
|
92.51%
|
0.80
|
3.48
|
21.48%
|
0.9
|
75.49%
|
94.41%
|
0.80
|
4.38
|
18.67%
|
1
|
76.42%
|
95.73%
|
0.80
|
5.52
|
16.11%
|