Anything that evaluates people, regardless of whether it sees the face. Hiring AI has a racist bent because there does not exist non-racist training data. I think it was Amazon who kept trying to fix this but when after scrubbing names and pictures it was still an issue.
That one is weird to me. Was it somehow extrapolating the race? Or was it favoring colleges with racist admissions? Not really sure how else it could get racist without access to names and pictures.
There are many indicators of race in hiring. For example, these characteristics could give a pretty good idea of the race of an applicant
Name
College or university
Clubs or fraternities
Location (address, not city)
While an ML program wouldn’t decide “don’t hire black men”, it may be reinforced by existing policies that are racist. Since these programs are trained on the existing success of employees at a company.
For example, a company may not have hired someone from an HBCU. Therefore, an applicant who attended an HBCU would be viewed negatively by the hiring program.
Anything that evaluates people, regardless of whether it sees the face. Hiring AI has a racist bent because there does not exist non-racist training data. I think it was Amazon who kept trying to fix this but when after scrubbing names and pictures it was still an issue.
That one is weird to me. Was it somehow extrapolating the race? Or was it favoring colleges with racist admissions? Not really sure how else it could get racist without access to names and pictures.
There are many indicators of race in hiring. For example, these characteristics could give a pretty good idea of the race of an applicant
While an ML program wouldn’t decide “don’t hire black men”, it may be reinforced by existing policies that are racist. Since these programs are trained on the existing success of employees at a company.
For example, a company may not have hired someone from an HBCU. Therefore, an applicant who attended an HBCU would be viewed negatively by the hiring program.
Name's being scrubbed, but the rest makes sense. Thanks!