cornell, hiring, algorithm
Research by scholars at the Cornell University Department of Computing and Information Science found the way many hiring algorithms work to prevent bias and ensure fairness is unclear and subjective. (Photo credit: everything possible/

Cornell Study Shows Companies Prefer to Keep Hiring Algorithms a Black Box

To combat time constraints and attempt to eliminate human bias, many companies have taken to entrusting at least part of their hiring processes to outside companies that use machine-learning algorithms to weed out applicants. However, with little known about how these algorithms work, they, too, may be perpetuating bias. New research from a Cornell University Computing and Information Science team found companies prefer obscurity over transparency when it comes to this emerging technology.

Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices by Manish Raghavan, Solon Barocas, Jon Kleinberg and Karen Levy found that tech companies have been able to define, and therefore address, algorithmic bias subjectively. For starters, terms like “bias” and “fairness,” as they relate to these algorithms, have not been universally defined. Therefore, tech companies can be vague about how they handle these issues.

As part of the study, the researchers looked into 19 companies that create algorithmic pre-employment screenings. These screenings typically include video interviews, questions and games. The researchers looked at company sites to find information on how these algorithms work, scouring websites for webinars, pages or other documents that lay out practices and logistics surrounding the algorithms.

They found very few companies share any information on what they specifically do to prevent employment bias. The study found that those that have mentions of “bias” and “fairness” on their sites fail to explain exactly how they mitigate bias and achieve fairness.

Raghavan explained to the Cornell Chronicle that these definitions are similar in obscurity to that of the term “free-range” as it applies to animal products being marketed as ethically sourced. These products must meet minimum standards to be considered “free-range,” which might not line up with the commonly-pictured image of these animals grazing happily in acres of grass.

“In the same way, calling an algorithm ‘fair’ appeals to our intuitive understanding of the term while only accomplishing a much narrower result than we might hope for,” he told the Chronicle.

The study also says that under Title VII, employers bear legal responsibility in the outcomes of their hiring practices. Therefore, an employer can be held liable for the effects of an algorithm it uses, regardless of what the tech vendor claims the algorithm does.

Algorithms work based on knowledge backed up by research that certain traits correlate with desirable outcomes. Machine learning discovers relationships between traits and outcomes, but sometimes exactly how these connections are made is obscure.

The study asks: “When the expert is unable to explain why, for example, the cadence of a candidate’s voice is indicative of higher job performance, or why reaction time predicts employee retention, should a vendor rely on these features?”

Vendors often also outsource their use of facial-recognition technology to third-party companies. Recent coverage of racial bias in this technology makes its use a fraught issue. Additionally, the study says, artificial intelligence emotion recognition technology also could be a disadvantage for people with disabilities.

The researchers told the Chronicle they maintain that algorithms have the potential to be used to prevent human bias. The question, they said, is whether — and how — they can be made perfect.

The Cornell researchers will present their findings in January at the Association for Computing Machinery Conference on Fairness, Accountability and Transparency in Barcelona.

Related Story: Apple Card Algorithm Accused of Gender Discrimination

Related Story: Google May Have Targeted Black Homeless People in Facial Recognition Research, New York Daily News Report Says

Leave a Comment

Your email address will not be published. Required fields are marked *


Latest News

AIG’s Alessa Quane Honored on IBA Hot 100

This year, IBA Hot 100 honored Alessa Quane(Executive Vice President and Chief Risk Officer) for her leadership and notable contributions to the insurance industry. The annual list, now in its seventh year, fielded through hundreds of peer nominations before IBA’s editorial group honed in on the 100 industry leaders who…

Building More Diverse and Inclusive Workplaces

Originally published on by Candace Rivera. Over the past several years, corporate business resource groups – employee-led groups of volunteers who work together to strengthen inclusion and diversity – have evolved from networking groups to proactive enablers which support an organization’s business strategy and talent management agendas. It’s an…

Wells Fargo Advisors Offers Zero Commission Investing Opportunity

Originally published on Wells Fargo Advisors today announced $0 trades on the WellsTrade® self-directed trading platform for stocks and exchange traded funds (ETFs). “WellsTrade offers investors an online solution to make independent investment decisions. We know do-it-yourself trading is one of several ways investors manage their money,” said Jim Hays, president of…

Mastercard and Doconomy Extend Collaboration to Deliver a More Sustainable Future

Originally published on S&P Global Joins Effort to Power Global Platform Available to All Issuers Further Support Provided by Mastercard Investment in Doconomy Madrid COP25, December 10, 2019 – Doconomy and Mastercard today extended their joint effort to combat climate change. Moving beyond previously announced programs, this new arrangement brings the ability…

As Change Accelerates, Insurers Need Profound Transformation and the Right Talent, Reveals EY Insurance Outlook 2020

Originally posted on Declining interest rates, changing customer expectations and shifting demographics are defining the future of insurance Insurers must strike the right balance between achieving operational excellence and investing in technology-led innovation As insurance industry growth remains stagnant for another year due to low interest rates, the shifts…