These appeals call upon us to review the judgment of the district court that appellee Jeffboat, Incorporated (“Jeffboat”), did not discriminate against the appellant employees and the class they represent. The case was tried to the court below for almost four months and after the trial the district court ruled that the plaintiffs had failed to establish by a preponderance of the evidence that they were discriminated against. Regretably, we find the findings of fact made after trial by the district court insufficient to permit meaningful appellate review. Therefore, we vacate the judgment of the district court and remand the case for a new trial.
I.
Jeffboat is engaged in the manufacture and construction of barges, towboats and other marine-related equipment. Its facilities are located in Jeffersonville, Indiana, which is close to Louisville, Kentucky. From 1968 to 1980, the number of hourly employees at Jeffboat varied between 700 and 2000 with an average of 1500 such employees. During the same period, the number of salaried employees increased from 140 to 280.
At all relevant times a fairly large percentage of the hourly employees at Jeff-boat were black. From 1967 to 1971, the hourly employees were represented by the Industrial Union of Marine and Shipbuilding Workers of America Local 65. In 1971, Local 65 was decertified and replaced by General Drivers, Warehousemen and Helpers, Local Union No. 89.
In 1977, the appellant employees filed a class action complaint charging Jeffboat with racial discrimination against its black employees in promotion, compensation, discipline, seniority, training and other practices. The complaint alleged that Jeff-boat’s practices violated both Title VII of the Civil Rights Act of 1964, 42 U.S.C. §§ 2000e et seq. (“Title VII”), and 42 U.S.C. § 1981. 1 The classes were made up of all present black Jeffboat bargaining unit (hourly) employees and all such employees who are no longer employed by Jeffboat but who were employed within the relevant limitations period. 2
The claim of discrimination in discipline and discharge requires examination of union collective bargaining agreements which regulated the imposition of discipline by Jeffboat. Violations of disciplinary rules were classified as minor, major or intolera *368 ble. Further, the collective bargaining agreements specified the maximum allowable penalty for each type of offense. For example, the first minor offense could draw, at most, a written reprimand. A second minor offense was punishable by a written reprimand and a three day suspension. 3 Some minor changes in the severity of the penalties were made during the relevant years but, with one exception, the structure of the discipline system remained generally the same.
The one exceptional change noted above was that, after 1974, discipline for tardiness and absenteeism was deleted from the list of minor offenses and was provided for separately from other offenses. At that time also, the maximum penalties for attendance infractions were increased. Apparently, Jeffboat intended to “get tough” on matters of absenteeism and tardiness by imposing maximum penalties for such infractions. However, plaintiffs have alleged, and Jeffboat has not denied, that Jeffboat officials retained substantial discretion in these matters. Evidence was presented at trial that white employees often were not given the maximum penalties for attendance violations. See Brief for Appellants at 16 n. 20.
The plaintiffs conducted a statistical analysis designed to measure the disparity in the discharge rates of black and white hourly employees. The data for the analysis were drawn from information supplied by Jeffboat during discovery. The analysis revealed that black hourly employees were discharged at a significantly higher rate in relation to their numbers than were their white counterparts. 4 The results were the same when the analysis was conducted for different time periods and when the study was confined to terminations for specific rule infractions.
With respect to allegations of discrimination in promotions, we must examine the seniority provisions of the collective bargaining agreement. The contract provided for sixteen separate seniority units and also employed the concept of plant wide seniority. Further, the agreement provided that promotions were to be made from within a seniority unit when possible and, if two equally qualified employees applied for a job, seniority would govern.
One of the class claims was that Jeffboat discriminated in the selection of “leadmen.” A leadman is an hourly employee who directs other hourly employees apparently as a surrogate for, or an assistant to, a foreman. The collective bargaining agreements provided that leadmen could be selected without regard to seniority and that such selections were not subject to the grievance procedure. Experience as a lead-man apparently was a proving ground for ultimate promotion to foreman. Jeffboat’s vice president of production estimated at trial that only 25 percent of foremen had not been leadmen. The plaintiffs’ statistical analysis of promotions to leadman showed a relatively low statistical disparity between the rates of black and of white promotion. Plaintiffs in their brief allege, however, that no blacks were among the 96 persons promoted to leadman status between 1971 and 1978. Jeffboat, in its brief, has not disputed this allegation.
The complaint also alleges that Jeffboat discriminated in its selection of foremen. Between 1971 and 1978, 99 people were promoted to foreman, of whom only three were black. The district court declined to *369 consider this allegation on the ground that the position of foreman, to which promotion was made, was outside the class. However, as is elaborated below, discrimination against class members in promotion to positions outside the class is a proper class claim — and thus on retrial the discrimination claims relating to promotions to foreman must be considered.
Plaintiffs also allege that Jeffboat discriminated against black employees by punishing them in retaliation for their participation in protests against Jeffboat’s treatment of black workers. The protests— called “Black Days” — were held on work days, requiring that participants be absent from work. The plaintiffs claim that the discipline imposed for these absences violated Title VII’s prohibition against retaliation for protesting unlawful discrimination.
There were several other allegations, all of which were rejected by the district court, including charges that the defendants generally practiced racial discrimination in the selection of employees for higher paying jobs. In addition, plaintiffs allege that at least one of the black plaintiffs, who was an alcoholic, was treated more harshly than white alcoholic employees. There is also evidence that Jeffboat failed to maintain an affirmative action plan as required under a consent decree it had entered into with the Indiana Civil Rights Commission and also as mandated because Jeffboat was a government contractor. In general, the plaintiffs attempted to paint a portrait of Jeffboat as a company afflicted with widespread racism.
H.
In this Title VII case, our ultimate task is “to determine whether the [plaintiffs have] proven that the defendant discriminated against [them].”
Epstein v. Secretary,
The first and perhaps most striking error committed by the district court is its failure to address the significance of what may be called plaintiffs’ “comparative evidence.” This evidence consists of voluminous anecdotal evidence which compares the treatment of black employees with the treatment of allegedly similarly situated white employees. Comparative evidence was presented to support many of the individual and class claims including the allegations of discrimination in discipline, discharge, promotions, transfers, leaves of absence and attendance policies. See, e.g., Brief for Appellants, notes 19, 20, 26, 70, 82, 93, 103, 104, 105, 156 and accompanying text. This evidence was offered to establish that there was a pattern of treating black employees more severely than white employees. For example, the plaintiffs used comparative evidence to try to prove that black employees were given the maximum allowable penalty under the union contract for attendance violations while white employees were given less severe penalties.
The district court held, in fact, that, as long as the maximum penalty provided *370 by the union contract was not exceeded, there was no violation of the law. See District Court’s Findings of Fact, Conclusions of Law and Judgment at 60-61 (hereinafter “Findings”). This was error. As a hypothetical example, suppose the maximum penalty for one unverified absence were a one day suspension. Suppose further that ten white employees and ten black employees were absent for one day and that all ten black employees received one day suspensions but that the ten white employees received only written reprimands, a less severe penalty. From this evidence one could readily infer discrimination against blacks, and the mere fact that all of the black employees received penalties authorized by the collective bargaining agreement would not immunize the employer from liability for racial discrimination.
The district court’s failure even to address this comparative evidence requires us to remand the case for retrial. This court, as a court of review, is not equipped to determine, as an original matter, the appropriate weight to be accorded the plaintiffs’ evidence. Nor are we able to weigh this evidence against the testimony and documentary evidence presented by the defendant. In many respects, the case before us is thus similar to
Rucker v. Higher Educational Aids Board,
While we believe that the district court’s failure to make findings with respect to the plaintiffs’ comparative evidence is alone sufficient to merit retrial, there are other alleged errors which we find it appropriate to resolve so as to provide guidance on retrial.
For example, the district court appears to have refused to consider plaintiffs’ claim that promotions to foreman and other *371 supervisory positions were awarded in a discriminatory fashion. The district court wrote:
The positions of foreman, general foreman, superintendent, and all other salaried promotions, are outside the terms of the collective bargaining agreements [sic] and Local Union No. 89. The class, being limited to hourly employees within the bargaining unit of Local Union No. 89, does not include the positions of foreman, general foreman and superintendent. Thus limited, the plaintiffs’ claims that defendant used subjective criteria for the selection of these salaried positions is not a proper class claim.
Findings at 57. Contrary to the district court’s conclusion, we do not think that the fact that a promotion would place the complainant outside of the plaintiff class can immunize the promotion from Title VII scrutiny. The Supreme Court’s recent decision in
Hishon v. King & Spalding,
— U.S.-,
Another deficiency which makes it extremely difficult to review the findings of the district court is the inconclusive discussion of the subjective factors involved in many of the employment decisions challenged here. We recognize that frequently subjective and other intangible factors may influence employment decisions and that even subjective
misjudgments
may not necessarily be the basis for Title VII liability.
See Nellis v. Brown County,
In addition, to a significant extent, the allegedly
sui generis
nature of many of the defendant’s decisions convinced the district court that plaintiffs’ statistical evidence was useless. For example, the district court held that “[b]ecause each discharge and/or disciplinary action is conducted on a case-by-case basis and involves a wide variety of conduct and rule violations, such is not readily susceptible to statistical analysis.” Findings at 62. A similar conclusion was reached as to the statistics on promotions.
See
Findings at 58. In this connection, we note here that the statistical disparities shown in this case were, in some instances, extremely large. Of course, determining the technical validity of statistical evidence is often highly problematic.
See Soria v. Ozinga Bros., Inc.,
The district court found the plaintiffs’ discipline statistics to be of “no value” because “each disciplinary action and/or discharge utilizes a separate factual situation, considering the employee’s past and present conduct, and a separate rule violation.” Findings at 62. This observation may contain a grain of truth; but it does not necessarily signify that the statistics in question are worthless. We note that statistics are an effective means of measuring the cumulative effects of employment actions and that statistically significant disparities in the treatment of comparably situated persons are often quite probative of unlawful discrimination. Of course, the difficulty of showing comparability of situations is a significant limitation.
See Segar v. Smith,
Plaintiffs argue that the district court’s reliance on the subjective nature of the imposition of discipline would effectively shield all but the most unarguably objectively comparable practices from statistical analysis. We recognize that the probative value of statistical evidence may be significantly undermined by information which casts into question the comparability of data. As noted, the district court generally failed to identify the subjective and other factors that led it to disregard the statistical evidence. This failure makes it impossible for us to determine on review what weight the statistical evidence should have been accorded.
Further, in a case such as this where the statistical pool consists of persons already employed by the defendant, courts have sometimes assumed that desirable employee traits are evenly distributed among the relevant pool.
See Segar v. Smith,
The district court also refused to consider the plaintiffs’ promotion statistics.
8
The district court found that the plaintiffs’ statistical analysis of promotions failed to narrow the applicable labor pool to employees with the requisite minimum qualifications. Findings at 58. The district court did not specify what the required qualifications were or what the proper labor pool would have been. To the extent that these minimum qualifications are subjective, the district court’s decision here suffers from the same infirmities as its decision with respect to disciplinary statistics. If the minimum qualifications are significantly objective, the district court should have specified what these objective qualifications were. Without these findings, we are unable to determine whether,
*373
and to what extent, the promotion statistics should have been taken into account.
Cf Davis v. Califano,
In particular, we think that the significance of all of the statistics may be related to the probative impact of the comparative evidence. The stark statistical disparities presented here, if accompanied by representative anecdotal evidence that black and white employees were treated differently in similar situations, may present highly relevant evidence which the district court should consider on remand.
See Valentino v. United States Postal Service,
Another issue that has not been adequately dealt with by the district court is the question whether Jeffboat retaliated against the plaintiffs for participating in protests against unlawful discrimination. In this connection, section 704(a) of the Civil Rights Act of 1964, 42 U.S.C. § 2000e-3(a) prohibits retaliation by an employer against its employees for opposing unlawful employment practices. 9 The plaintiffs alleged that Jeffboat retaliated unlawfully for their participation in “Black Days,” which were a series of protests against Jeffboat’s allegedly discriminatory practices. The district court rejected this claim on the following ground:
The record discloses and the Court finds that the defendant treated absenteeism and tardiness on these “Black Days” in the same manner as it treated absenteeism and tardiness of Caucasian employees for the Louisville, Kentucky, anti-school busing protest days. In both instances, the absenteeism and tardiness was [sic] processed under the terms of the applicable collective bargaining agreements. No special treatment, either in the form of retaliation or favoritism, was shown to either the Negro or Caucasian employees who were absent on these days.
Findings at 65. The district court thus concluded that Jeffboat did not retaliate against black employees for their participation in Black Days.
But the district court’s discussion, as quoted above, fails to mention the elements of a claim for unlawful retaliation. To prevail on such a claim, the plaintiffs would have had to show, as a threshold matter, that they reasonably believed that Jeffboat practiced unlawful discrimination and that their opposition to the discrimination caused the employer to take the adverse action alleged.
See McCluney v. Jos. Schlitz Brewing Co.,
*374
Of course, employees may not engage in conduct which is “excessively disloyal or hostile or disruptive and damaging to the employer’s business” and then claim the shield of § 704(a) as protection against adverse action.
Croushorn v. Board of Trustees,
Other issues have been raised in this case that need not be addressed in detail because they will be more susceptible of resolution after a new trial and new findings of fact. In particular, the issue whether Jeffboat lived up to its affirmative action obligation under the consent decree with the Indiana Civil Rights Commission will need to be addressed at a new trial. Further, we are not certain what effect the seniority provisions of the union contracts have on plaintiffs’ claims with respect to promotion in rank and to higher paying jobs. We recognize that Title VII protects the operation of the seniority agreement unless the agreement was adopted with the intent to discriminate. 42 U.S.C. § 2000e-2(h).
See Teamsters v. United States,
We emphasize that we have not specifically addressed other issues raised on appeal. On remand, the district court, in exercising its judgment in matters normal *375 ly within its province, should not be constrained by our failure to address an issue here. Further, the district court should, in general, not feel bound by the law of the case doctrine or some like constraint to adhere to the modes of analysis or procedures pursued at the first trial unless it is persuaded of their correctness.
The judgment is vacated and the case is remanded for a new trial on all of plaintiffs’ claims.
Notes
. Appellant Harold Barnes filed his own complaint in 1978. His Title VII and § 1981 action was consolidated with the other case and he was made a class representative.
. The classes for Title VII purposes and for § 1981 purposes are slightly different because of the different periods of limitations applied under the two statutes.
. Jeffboat always retained discretion not to impose the maximum penalty. This was especially true with respect to intolerable offenses for which the penalty was "suspension pending disciplinary action up to and including discharge." Plaintiffs allege that there were no guidelines for the imposition of discipline with respect to an intolerable offense and thus discipline could be meted out unevenly. Jeffboat has not taken issue in its brief with plaintiffs' claim that there were no such guidelines.
. The data included terminations from 1970 through 1978 except 1974. Over the entire period, the discharge rate for blacks was 10.73 standard deviations more than would be expected employing the white experience. This means that the probability of the black discharge rate being a random occurrence was less than one in a billion. Similar disparities were found when the time period was broken up into two four-year periods.
. We find it unnecessary to address separately plaintiffs' § 1981 claim. While there are differences between Title VII and § 1981, the differences are largely immaterial to the issues addressed in this opinion.
See Movement for Opportunity v. General Motors,
. In
Rucker,
the panel was split over whether a new trial before a new district judge, as opposed to supplemental findings by the original district judge, was the appropriate remedy.
See Rucker,
. This failure to address the comparative evidence appears to have infected various aspects of the case. For instance, plaintiff Joe Malone alleged that after he was hospitalized for alcoholism, he was treated less favorably than similarly situated white employees. The Equal Employment Opportunity Commission found that Jeffboat "gave other Caucasians more opportunities for treatment of alcoholism via leaves of absence" than were given to Malone. See Brief for Appellants at 52 n. 102. On retrial, the district court should analyze the comparative evidence and make findings on the significance of the evidence both with respect to the individual and to the class claims.
. We are uncertain to what extent this decision was dictated by the district court’s view that discrimination in promotions was not a proper class claim.
. The provision reads:
It shall be an unlawful employment practice for an employer to discriminate against any of his employees or applicants for employment, for an employment agency, or joint labor-management committee controlling apprenticeship or other training or retraining, including on-the-job training programs, to discriminate against any individual, or for a labor organization to discriminate against any member thereof or applicant for membership, because he has opposed any practice made an unlawful employment practice by this sub-chapter, or because he has made a charge, testified, assisted, or participated in any manner in an investigation, proceeding, or hearing under this subchapter.
. We have not found cases like this one in which employees absented themselves from work for brief periods to engage in opposition to unlawful discrimination. We note that the EEOC has determined that an employee's refusal to report to work may be protected opposition under § 704(a). See EEOC Decision No. 74-56, 10 F.E.P. Cases 280 (1973). The Administrator’s interpretation is entitled, of course, to considerable weight. Therefore, the district court should note this interpretation as well as other relevant factors when it balances the disruption caused by the absences during Black Days against the employees’ interest in lawful opposition to employment discrimination.
We also note that two courts have determined that a
strike
against unlawful practices, if in disregard of a no-strike clause in a union contract, is too disruptive to be protected opposition under § 704(a).
See King v. Illinois Bell Telephone Co.,
