人工智能招聘工具导致种族偏见与系统性拒绝:黑人求职者受影响比例为26%,亚裔为15%
Algorithmic Monocultures in Hiring

原始链接: https://hai.stanford.edu/news/ai-hiring-tools-can-yield-racial-bias-and-systemic-rejection

这项研究探讨了“算法单一文化”的风险,即多家雇主依赖同一家招聘服务供应商所带来的问题。通过对真实世界招聘人工智能数据的分析,研究证实,相较于各公司独立做出招聘决策,向使用同一供应商的多家公司投递简历的求职者,其被全部拒绝的可能性更高。具体而言,10%投递了四份申请的求职者遭到了所有雇主的拒绝,这种模式在缺乏人工智能筛选因素的更广泛研究中并未出现。 研究结果表明,招聘供应商的市场集中度造成了系统性障碍,实际上将合格的候选人挡在了就业市场之外。当一家供应商主导了某个行业的筛选流程时,其特定的算法偏见或标准会被统一应用,从而全面降低候选人的成功机会。这凸显了一个此前仅存在于理论中的关键问题:现代招聘技术的中心化性质可能会在无意中巩固权力,并限制人们获得就业机会的公平性。

最近斯坦福大学的一项研究指出,AI招聘工具存在种族偏见,特别是在针对黑人和亚裔候选人的推荐率较低,这在Hacker News上引发了广泛讨论。 用户讨论了美国公平就业机会委员会(EEOC)用于衡量歧视的“五分之四规则”所带来的影响;一些人质疑其有效性,另一些人则强调了过度依赖少量标准化算法所带来的系统性风险。讨论还涉及了AI应用与监管之间的广泛矛盾,并指出欧盟的《人工智能法案》为“高风险”监管提供了一个范例,而美国则正游说推动联邦预占法案。 许多评论者对AI在招聘中的有效性表示怀疑,一些用户指出,选择不接受AI筛选往往会导致申请被丢进无人审核的“黑洞”。讨论还涉及了招聘中“AI”一词在技术上的模糊性,用户质疑这些系统是有意存在偏见,还是仅仅利用了种族代理变量(如SAT成绩)。总的来说,社区表达了对缺乏透明度、行业招聘工具同质化的风险,以及训练数据中固有的偏见等问题的深切担忧。
相关文章

原文

We also study new concerns brought about by the shared dependence on a single hiring vendor. In our prior work, we theorized that algorithmic monocultures in which many employers came to rely on the same algorithmic recommendations could lead to some people being shut out from jobs. Using our large dataset of real hiring AI recommendations, we test our hypothesis. We find that people who submit multiple applications to positions screened by the same algorithmic hiring vendor are more likely to be rejected from every position to which they apply than would be true if the companies made decisions statistically independently from one another. Ten percent of applicants who submit four applications are rejected from all the places to which they apply.

Our research also found that this pattern does not appear to be the case in other circumstances. We analyzed data from the largest prior study of hiring decisions, which sent 83,000 applications to 108 Fortune 500 firms during the same time period as our study and did not focus on whether AI was used to make decisions. We found that the rate at which applicants were rejected from every firm they applied to in this data was no higher than what you’d expect if each company decided independently of the others. 

This suggests market concentration matters: As a single hiring vendor comes to dominate screening for an industry, it may be more likely that candidates are shut out.

联系我们 contact @ memedata.com