AI tools to aid more diverse recruitment are ‘pseudoscience’, researchers say

A study from the University of Cambridge said AI-powered recruitment was flawed and could be biased against people for their clothes and expressions.
A woman’s hand presses a key of a laptop keyboard.
PA Archive
Martyn Landi10 October 2022

Artificial intelligence used by recruitment platforms to help boost diversity in the workplace is discriminating against people over random changes in clothing or lighting, a new study has warned.

A growing number of businesses have turned to AI-powered software to sift through applications and analyse interviews of candidates with the aim of boosting diversity and finding better culture fits for employers.

Such software says it helps combat unconscious bias and helps firms identify the most compatible personality for a role, but a new study from the University of Cambridge has warned that these systems can be affected by random details such as the clothes people wear, the lighting in the room they appear in and even what they have in the background for video interviews.

The researchers warn businesses that some uses of the technology are little better than “automated pseudoscience”.

The study, by the University of Cambridge’s Centre for Gender Studies – which has been published in the journal Philosophy and Technology – said the use of such AI tools was a dangerous example of “technosolutionism”, where people turn to technology to provide a quick fix to an issue that is deep-rooted and requires more time and investment.

The researchers argue that the AI tools could ultimately increase uniformity in a workplace rather than diversity because many systems are built to search for the fantasy of an employer’s ideal candidate.

They say that some firms promising their software can remove bias are guilty of spreading misinformation.

“We are concerned that some vendors are wrapping ‘snake oil’ products in a shiny package and selling them to unsuspecting customers,” study co-author Dr Eleanor Drage said.

“By claiming that racism, sexism and other forms of discrimination can be stripped away from the hiring process using artificial intelligence, these companies reduce race and gender down to insignificant data points, rather than systems of power that shape how we move through the world.

“While companies may not be acting in bad faith, there is little accountability for how these products are built or tested.

“As such, this technology, and the way it is marketed, could end up as dangerous sources of misinformation about how recruitment can be ‘de-biased’ and made fairer.”

Create a FREE account to continue reading

eros

Registration is a free and easy way to support our journalism.

Join our community where you can: comment on stories; sign up to newsletters; enter competitions and access content on our app.

Your email address

Must be at least 6 characters, include an upper and lower case character and a number

You must be at least 18 years old to create an account

* Required fields

Already have an account? SIGN IN

By clicking Create Account you confirm that your data has been entered correctly and you have read and agree to our Terms of use , Cookie policy and Privacy policy .

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged in