Most people assume a rejected job application is a one-off: a single company, a single decision, move on. A Stanford study published this year suggests that is not how AI hiring screening actually works. Because so many employers plug into the same small set of vendors, a low score from one algorithm can quietly follow an applicant from company to company, long before any human ever reads a resume.
The study, in plain numbers
Researchers Rishi Bommasani, Sarah Bana, Kathleen Creel, Dan Jurafsky, and Percy Liang tracked 3.4 million people who submitted 4 million job applications across 1,700 postings at 150 employers, all screened by one AI hiring tool from a single vendor. That scale makes it the largest independent study of a real-world hiring algorithm to date.
Using the same four-fifths rule that regulators have long used to flag adverse impact, the researchers found that 26% of Black applicants and about 15% of Asian applicants had applied to positions where the tool's outcomes crossed that threshold. The study estimates roughly 40,000 additional applications would have advanced to the next round if the tool had scored those groups at the same rate as the most-favored group.
Why one vendor's bias becomes everyone's bias
The more striking finding is not the bias itself but how it compounds. When dozens of unrelated employers rely on the same vendor's model, the researchers describe the effect as "algorithmic monoculture": the same scoring patterns show up again and again, because it is effectively the same underlying judgment being applied at every company that buys the tool.
The practical effect is what the researchers call systemic rejection. Applicants who submitted several applications through positions screened by this one vendor were rejected from all of them far more often than you would expect if each company were deciding independently. Their simulation found that getting the odds of being rejected everywhere down below 0.1% would take an applicant roughly 25 separate applications, more than double what independent, uncorrelated decisions would require.
In other words, a mediocre or biased score is not contained to one job posting. It can function like a soft blacklist across every employer that happens to use the same underlying system, even though none of those companies ever compare notes.
What the study does not show
It is worth being precise about the limits here, because overstating them would be its own kind of bias. This research covers one vendor's tool, not "AI hiring tools" as a category, and the authors are explicit that newer screening systems built on large language models were not part of this dataset. The vendor in question, Pymetrics, is owned by Harver, which did not respond to requests for comment when the study was first reported.
That matters because it would be easy to read a headline number like 26% and assume every AI résumé screener behaves this way. The honest takeaway is narrower: at least one widely deployed tool, used by employers with a combined $5 billion-plus in annual revenue, produced measurable racial disparities at a scale large enough to matter, and the industry structure that let it happen (a handful of vendors serving thousands of employers) is not unique to that one tool.
Why this is hard to catch from the inside
A separate thread of this same research looked at how these tools get audited and found that the way an algorithm is tested can hide the exact bias it is supposed to catch. Aggregate pass-rate audits, the kind many companies rely on to check for fairness, can look clean even when specific subgroups are being screened out, because the disparities only show up when you dig into intersections of race, gender, and job category rather than looking at top-line numbers.
That is part of why this is a hard problem for any single employer to fix on its own. A company can audit its own hiring funnel in good faith, see numbers that look fine in aggregate, and still be using a tool that disadvantages specific groups in specific roles.
What this means if you are job hunting or hiring
- If you are applying for jobs: a string of rejections from similar roles is not necessarily a reflection of your resume. It may reflect how one scoring system is treating applicants like you across many employers at once.
- If you are hiring: a vendor contract does not transfer legal responsibility. Employers remain accountable for discriminatory outcomes even when a third party built and runs the screening tool.
- Either way, aggregate "it looks fair overall" audits are not enough evidence that a specific tool is fair for specific groups in specific roles.
The takeaway
The uncomfortable part of this study is not that one algorithm had bias. Bias in any single tool is almost expected and, in theory, fixable. The uncomfortable part is the structure: a small number of vendors effectively setting the odds for a huge share of the job market, with audits that can look clean while real disparities persist underneath. Fixing one tool does not fix that. Until hiring algorithms are checked the way the researchers checked this one, by subgroup and by job, "the audit passed" and "the system is fair" are not the same statement.