Skip to main content

2024 | OriginalPaper | Buchkapitel

Algorithmic Hiring Systems: Implications and Recommendations for Organisations and Policymakers

verfasst von : Jason D. Schloetzer, Kyoko Yoshinaga

Erschienen in: YSEC Yearbook of Socio-Economic Constitutions 2023

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Algorithms are becoming increasingly prevalent in the hiring process, as they are used to source, screen, interview, and select job applicants. This chapter examines the perspective of both organisations and policymakers about algorithmic hiring systems, drawing examples from Japan and the United States. The focus is on discussing the drivers underlying the rising demand for algorithmic hiring systems and four risks associated with their implementation: the privacy of job candidate data; the privacy of current and former employees’ workplace data; the potential for algorithmic hiring bias; and concerns surrounding ongoing oversight of algorithmically-assisted decision-making throughout the hiring process. These risks serve as the foundation for developing a risk management framework based on management control principles to facilitate dialogue within organisations to address the governance and management of such risks. The framework also identifies areas policymakers can focus on to help balance (1) granting organisations unfettered access to the personal and potentially sensitive data of job applicants and employees to develop hiring algorithms and (2) implementing strict data protection laws that safeguard individuals’ rights yet may impede innovation, and emphasises the need to establish an intra-governmental AI oversight and coordination function that tracks, analyses, and reports on adverse algorithmic incidents. The chapter concludes by highlighting seven recommendations to mitigate the risks organisations and policymakers face in the development, use, and oversight of algorithmic hiring.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
4
Details provided by various news articles compiled by Lutz, Roman. (2019-11-06) Incident Number 95. In McGregor, S. (ed.) Artificial Intelligence Incident Database. Partnership on AI from incidentdatabase.ai/cite/95.
 
5
Act on the Protection of Personal Information, available at: https://​elaws.​e-gov.​go.​jp/​document?​lawid=​415AC0000000057.
 
8
De Stefano and Doellgast (2023), pp. 9–20.
 
9
Bogen and Rieke (2018).
 
10
Garr and Jackson (2019).
 
11
Sanchez-Monedero et al. (2020).
 
12
Peter Cappelli, Prasanna Tambe, and Valery Yakubovich, Artificial intelligence in human resources management: Challenges and a path forward. Available at SSRN 3263878, 2018.
 
13
Ajunwa (2020).
 
14
Kim (2018), p. 313; Kim (2020).
 
15
Manish Raghavan, Solon Barocas, Jon Kleinberg, Karen Levy: Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices, available at: https://​arxiv.​org/​pdf/​1906.​09208.​pdf.
 
16
Tomas Chamorro-Premuzic, Dave Winsborough, Ryne A Sherman, and Robert Hogan, New talent signals: Shiny new objects or a brave new world? Industrial and Organisational Psychology, 9(3):621–640, 2016.
 
18
While we focus on the hiring process, the discussion is germane to other HRM contexts, including using algorithmic tools to predict which employees to terminate, which employees may depart the organisation voluntarily, and which employees might experience emotional issues on the job.
 
19
This section summarises the views expressed during monthly roundtables of 20–50 Chief Data Officers convened by a global consulting firm. From time to time, discussions of algorithmic hiring tools arise, focusing on their development and implementation challenges.
 
20
Mariotti (2017).
 
21
Bogen and Rieke (2018).
 
24
Manish Raghavan, Solon Barocas, Jon Kleinberg, Karen Levy: Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices, available at: https://​arxiv.​org/​pdf/​1906.​09208.​pdf.
 
26
Manish Raghavan, Solon Barocas, Jon Kleinberg, Karen Levy: Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices, available at: https://​arxiv.​org/​pdf/​1906.​09208.​pdf.
 
27
Ibid.
 
28
“71% of Hiring Decision-Makers Agree Social Media is Effective for Screening Applicants” news provided by Express Employment Professionals, available at: https://​www.​prweb.​com/​releases/​71_​of_​hiring_​decision_​makers_​agree_​social_​media_​is_​effective_​for_​screening_​applicants/​prweb17467312.​htm.
 
29
Kramer and Ward (2010), pp. 2273–2287.
 
30
Zhou et al. (2015).
 
31
Examples collected in 2022 from private conversations with executives as part of a monthly roundtable of Chief Data Officers convened by a global consulting firm.
 
32
See, for example, Leidner et al. (2021).
 
33
Example collected in May 2022 from private conversations with executives as part of a monthly roundtable of Chief Data Officers convened by a global consulting firm.
 
34
Meribeth Banaschik, How location tracking is raising the stakes on privacy protection, EY, available at: https://​www.​ey.​com/​en_​gl/​forensic-integrity-services/​how-location-tracking-is-raising-the-stakes-on-privacy-protection.
 
35
Beverley Zabow, Tracking of Employee Location Data is a significant violation of privacy according to the Israeli Privacy Protection Authority, INPLP, available at: https://​inplp.​com/​latest-news/​article/​tracking-of-employee-location-data-is-a-significant-violation-of-privacy-according-to-the-israeli-privacy-protection-authority/​.
 
36
Example collected in September 2021 from a private research study with a start-up developing algorithms that use the tone of employee emails to predict a measure of “corporate culture” that senior executives and boards of directors can routinely monitor and intervene if necessary.
 
37
Example collected in December 2022 from private conversations with executives as part of a monthly roundtable of Chief Data Officers convened by a prominent global consulting firm.
 
39
All details about the Amazon situation are provided by various news articles compiled by Anonymous. (2016-08-10) Incident Number 37. In McGregor, S. (ed.) Artificial Intelligence Incident Database. Partnership on AI from incidentdatabase.ai/cite/37.
 
40
Peter Cappelli, Prasanna Tambe, and Valery Yakubovich, Artificial intelligence in human resources management: Challenges and a path forward. Available at SSRN 3263878, 2018.
 
41
Example collected in June 2021 from private conversations with executives as part of a monthly roundtable of Chief Data Officers convened by a prominent global consulting firm.
 
42
Sidanius and Crane (1989), pp. 174–197.
 
43
Neumark et al. (1996), pp. 915–941.
 
44
Riach and Rich (2002), pp. F480–F518.
 
46
See Merchant and Van der Stede (2017), for an excellent treatment of management control system theory.
 
47
Reid Blackman, Why you need an AI ethics committee, Harvard Business Review, July-August 2002, available at: https://​hbr.​org/​2022/​07/​why-you-need-an-ai-ethics-committee.
 
49
The EU’s General Data Protection Regulation emphasises the importance of human intervention in automatic decision-making, as does the Japanese Ministry of Internal Affairs and Communication’s AI R&D guidelines.
 
51
The EU’s proposed AI Act, available at: https://​artificialintell​igenceact.​eu/​the-act/​.
 
52
The Conference toward AI Network Society, Draft AI R&D Guidelines for International Discussions, 28 July 2017, available at: https://​www.​soumu.​go.​jp/​main_​content/​000507517.​pdf.
 
53
The ten principles are: proper utilization, data quality, collaboration, safety, security, privacy, human dignity and individual autonomy, fairness, transparency, and accountability. The Conference toward AI Network Society, AI Utilization Guidelines - Practical Reference for AI Utilization, 9 August 2019, available at: https://​www.​soumu.​go.​jp/​main_​content/​000658284.​pdf.
 
54
See, for example, NTT’s “Our Approach to the Use and R&D of AI,” available at: https://​www.​rd.​ntt/​e/​ai/​0005.​html.
 
56
Governance Innovation Ver. 2 - A Guide to Designing and Implementing Agile Governance, METI, available at: https://​www.​meti.​go.​jp/​press/​2021/​07/​20210730005/​20210730005-2.​pdf.
 
61
Amendments to Legislation on High Frequency Trading, Anderson Mori and Tomotsune, June 2017, available at: https://​www.​amt-law.​com/​asset/​pdf/​bulletins2_​pdf/​170614_​00.​pdf.
 
62
The White House, “Blueprint For An AI Bill of Rights - Making Automated Systems Work For The American People,” October 2022, available at: https://​www.​whitehouse.​gov/​wp-content/​uploads/​2022/​10/​Blueprint-for-an-AI-Bill-of-Rights.​pdf.
 
67
Ibid.
 
69
Information Security Governance in Japan, OECD Homepage, available at: https://​www.​oecd.​org/​sti/​ieconomy/​35493201.​pdf.
 
70
See Gary Marchant, “Why Soft Law is the Best Way to Approach the Pacing Problem in AI,” Artificial Intelligence & Equality Initiative, September 29, 2021, available at: https://​www.​carnegiecouncil.​org/​media/​article/​why-soft-law-is-the-best-way-to-approach-the-pacing-problem-in-ai for an interesting discussion of this issue in the context of AI.
 
71
See “Chapter 19 Government-Business Relations in Japan and Korea,” Min Chen from “Understanding Business Environments,” edited by Michael Lucas, Taylor & Francis Group, 2000. ProQuest Ebook Central, available at: http://​ebookcentral.​proquest.​com/​lib/​georgetown/​detail.​action?​docID=​242233.
 
72
Effective and Trustworthy Implementation of AI Soft Law Governance", IEEE TRANSACTIONS ON TECHNOLOGY AND SOCIETY, VOL. 2, NO. 4, DECEMBER 2021, https://par.nsf.gov/servlets/purl/10344125; Ryan Calo, Artificial Intelligence and the Carousel of Soft Law, IEEE Transactions on Technology and Society, Vol. 2, No. 4, December 2021, available at: https://ieeexplore.ieee.org/document/9539878 .
 
73
Feedback from: University of Cambridge (Leverhulme Centre for the Future of Intelligence and Centre for the Study of Existential Risk), https://​ec.​europa.​eu/​info/​law/​better-regulation/​have-your-say/​initiatives/​12527-Artificial-intelligence-ethical-and-legal-requirements/​F2665626_​en.
 
77
Judgment of the General Court (Eighth Chamber, Extended Composition) of 26 April, 2023. Case T-557/20: https://​eur-lex.​europa.​eu/​legal-content/​EN/​TXT/​?​uri=​CELEX%3A62020TJ0557.
 
78
Santiago De Ampuero Castellanos, Gonzalo Gállego, Juan Ramón Robles, Hogan Lovells, Sending personal data, receiving non-personal data: Recent EU judgment reinforces the power of pseudonymization, https://​www.​jdsupra.​com/​legalnews/​sending-personal-data-receiving-non-4948289/​.
 
81
Ron Wyden Press release “Wyden, Booker and Clarke Introduce Algorithmic Accountability Act of 2022 To Require New Transparency And Accountability For Automated Decision Systems” (February 3, 2022) available at: https://​www.​wyden.​senate.​gov/​news/​press-releases/​wyden-booker-and-clarke-introduce-algorithmic-accountability-act-of-2022-to-require-new-transparency-and-accountability-for-automated-decision-systems.
 
82
Digital Policy Alert, “United States of America: Rejected Algorithmic Accountability Act of 2022,” available at: https://​digitalpolicyale​rt.​org/​event/​8384-rejected-algorithmic-accountability-act-of-2022.
 
83
Title VII of the Civil rights Act of 1964, EEOC, available at: https://​www.​eeoc.​gov/​statutes/​title-vii-civil-rights-act-1964.
 
84
Equal Employment Opportunity Commission, Civil Service Commission et al., Uniform guidelines on employee selection procedures. Federal Register, 43(166):38290–38315, 1978.
 
85
Artificial Intelligence and Algorithmic Fairness Initiative, EEOC, available at: https://​www.​eeoc.​gov/​ai.
 
86
Select Issues: Assessing Adverse Impact in Software, Algorithms, and Artificial Intelligence Used in Employment Selection Procedures Under Title VII of the Civil Rights Act of 1964, EEOC, available at: https://​www.​eeoc.​gov/​select-issues-assessing-adverse-impact-software-algorithms-and-artificial-intelligence-used.
 
92
Institute for Traffic Accident Research and Data Analysis (Japan): https://​www.​itarda.​or.​jp/​.
 
93
Consumer Product Safety Commission: https://​www.​cpsc.​gov/​Recalls.
 
Literatur
Zurück zum Zitat Ajunwa I (2020) The paradox of automation as anti-bias intervention. Cardozo Law Rev 41 Ajunwa I (2020) The paradox of automation as anti-bias intervention. Cardozo Law Rev 41
Zurück zum Zitat Garr SS, Jackson C (2019) Diversity & inclusion technology: the rise of a transformative market. Technical report, RedThread Research Garr SS, Jackson C (2019) Diversity & inclusion technology: the rise of a transformative market. Technical report, RedThread Research
Zurück zum Zitat Kim PT (2018) Big data and artificial intelligence: new challenges for workplace equality. Univ Louisville Law Rev 57:313 Kim PT (2018) Big data and artificial intelligence: new challenges for workplace equality. Univ Louisville Law Rev 57:313
Zurück zum Zitat Kim PT (2020) Manipulating opportunity. Virginia Law Rev 106 Kim PT (2020) Manipulating opportunity. Virginia Law Rev 106
Zurück zum Zitat Kramer RSS, Ward R (2010) Internal facial features are signals of personality and health. Q J Exp Psychol 63(11):2273–2287CrossRef Kramer RSS, Ward R (2010) Internal facial features are signals of personality and health. Q J Exp Psychol 63(11):2273–2287CrossRef
Zurück zum Zitat Leidner D, Tona O, Wixom BH, Someh IA (2021) Putting dignity and the core of employee data use. MIT Sloan Manag Rev Leidner D, Tona O, Wixom BH, Someh IA (2021) Putting dignity and the core of employee data use. MIT Sloan Manag Rev
Zurück zum Zitat Mariotti A (2017) Talent acquisition benchmarking report. Technical report, Society for Human Resource Management Mariotti A (2017) Talent acquisition benchmarking report. Technical report, Society for Human Resource Management
Zurück zum Zitat Neumark D, Bank RJ, Van Nort KD (1996) Sex discrimination in restaurant hiring: an audit study. Q J Econ 111(3):915–941CrossRef Neumark D, Bank RJ, Van Nort KD (1996) Sex discrimination in restaurant hiring: an audit study. Q J Econ 111(3):915–941CrossRef
Zurück zum Zitat Riach PA, Rich J (2002) Field experiments of discrimination in the marketplace. Econ J 112(483):F480–F518CrossRef Riach PA, Rich J (2002) Field experiments of discrimination in the marketplace. Econ J 112(483):F480–F518CrossRef
Zurück zum Zitat Sidanius J, Crane M (1989) Job evaluation and gender: the case of university faculty. J Appl Soc Psychol 19(2):174–197CrossRef Sidanius J, Crane M (1989) Job evaluation and gender: the case of university faculty. J Appl Soc Psychol 19(2):174–197CrossRef
Zurück zum Zitat Bogen M, Rieke A (2018) Help wanted: an exploration of hiring algorithms, equity, and bias. Technical report, Upturn Bogen M, Rieke A (2018) Help wanted: an exploration of hiring algorithms, equity, and bias. Technical report, Upturn
Zurück zum Zitat De Stefano V, Doellgast V (2023) Regulating AI at work: labour relations, automation, and algorithmic management. Transfer 29(1):9–20CrossRef De Stefano V, Doellgast V (2023) Regulating AI at work: labour relations, automation, and algorithmic management. Transfer 29(1):9–20CrossRef
Zurück zum Zitat Merchant K, Van der Stede W (2017) Management control systems: performance measurement, evaluation and incentives, 4th edn Merchant K, Van der Stede W (2017) Management control systems: performance measurement, evaluation and incentives, 4th edn
Zurück zum Zitat Sanchez-Monedero J, Dencik L, Edwards L (2020) What does it mean to solve the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systems. In Proceedings of the conference on fairness, accountability, and transparency. ACM, 2020 Sanchez-Monedero J, Dencik L, Edwards L (2020) What does it mean to solve the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systems. In Proceedings of the conference on fairness, accountability, and transparency. ACM, 2020
Zurück zum Zitat Zhou D, Luo J, Silenzio VMB, Zhou Y, Hu J, Currier G, Kautz H (2015) Tackling mental health by integrating unobtrusive multimodal sensing. In 29th AAAI conference on artificial intelligence, 2015 Zhou D, Luo J, Silenzio VMB, Zhou Y, Hu J, Currier G, Kautz H (2015) Tackling mental health by integrating unobtrusive multimodal sensing. In 29th AAAI conference on artificial intelligence, 2015
Zurück zum Zitat Cappelli P, Tambe P, Yakubovich V (2018) Artificial intelligence in human resources management: challenges and a path forward. Available at SSRN 3263878 Cappelli P, Tambe P, Yakubovich V (2018) Artificial intelligence in human resources management: challenges and a path forward. Available at SSRN 3263878
Zurück zum Zitat Various news articles compiled by Anonymous. (2016-08-10) Incident Number 37. in McGregor, S. (ed.) Artificial Intelligence Incident Database. Partnership on AI from incidentdatabase.ai/cite/37 Various news articles compiled by Anonymous. (2016-08-10) Incident Number 37. in McGregor, S. (ed.) Artificial Intelligence Incident Database. Partnership on AI from incidentdatabase.ai/cite/37
Zurück zum Zitat Various news articles compiled by Lutz, Roman. (2019-11-06) Incident Number 95. in McGregor, S. (ed.) Artificial Intelligence Incident Database. Partnership on AI from incidentdatabase.ai/cite/95 Various news articles compiled by Lutz, Roman. (2019-11-06) Incident Number 95. in McGregor, S. (ed.) Artificial Intelligence Incident Database. Partnership on AI from incidentdatabase.ai/cite/95
Metadaten
Titel
Algorithmic Hiring Systems: Implications and Recommendations for Organisations and Policymakers
verfasst von
Jason D. Schloetzer
Kyoko Yoshinaga
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/16495_2023_61