AI auditing and impact assessment: according to the UK information commissioner’s office

Published on Feb 7, 2021
· DOI :10.1007/S43681-021-00039-2
Emre Kazim3
Estimated H-index: 3
(UCL: University College London),
Danielle Mendes Thame Denny2
Estimated H-index: 2
,
Adriano Koshiyama7
Estimated H-index: 7
(UCL: University College London)
Source
Abstract
As the use of data and artificial intelligence systems becomes crucial to core services and business, it increasingly demands a multi-stakeholder and complex governance approach. The Information Commissioner's Office’s ‘Guidance on the AI auditing framework: Draft guidance for consultation’ is a move forward in AI governance. The aim of this initiative is toward producing guidance that encompasses both technical (e.g. system impact assessments) and non-engineering (e.g. human oversight) components to governance and represents a significant milestone in the movement towards standardising AI governance. This paper will summarise and critically evaluate the ICO effort and try to anticipate future debates and present some general recommendations.
References26
Newest
#1Patrick van Esch (AUT: Auckland University of Technology)H-Index: 11
#2J. Stewart Black (Ad: INSEAD)H-Index: 37
Last. Denni Arli (UMN: University of Minnesota)H-Index: 18
view all 3 authors...
Organizations are increasingly using AI-enabled technology and tools in their recruiting processes. However, little is known about how job candidates view AI-enabled job application systems and whether those views influence the likelihood that they will apply for jobs in such cases. Our research finds that attitudes toward AI use in the job application process in general, and attitudes toward organizations that use AI in the job application process in particular, are strongly related to the inte...
2 CitationsSource
#1Luca Oneto (UniPi: University of Pisa)H-Index: 26
#2Silvia ChiappaH-Index: 16
Machine learning based systems are reaching society at large and in many aspects of everyday life. This phenomenon has been accompanied by concerns about the ethical issues that may arise from the adoption of these technologies. ML fairness is a recently established area of machine learning that studies how to ensure that biases in the data and model inaccuracies do not lead to models that treat individuals unfavorably on the basis of characteristics such as e.g. race, gender, disabilities, and ...
121 CitationsSource
#1Emre Kazim (UCL: University College London)H-Index: 3
#2Adriano Koshiyama (UCL: University College London)H-Index: 7
In the growing literature on artificial intelligence (AI) impact assessments, the literature on data protection impact assessments is heavily referenced. Given the relative maturity of the data protection debate and that it has translated into legal codification, it is indeed a natural place to start for AI. In this article, we anticipate directions in what we believe will become a dominant and impactful forthcoming debate, namely, how to conceptualise the relationship between data protection an...
2 CitationsSource
#1Patrick van Esch (AUT: Auckland University of Technology)H-Index: 11
#2J. Stewart Black (Ad: INSEAD)H-Index: 37
Last. Mark HarderH-Index: 1
view all 4 authors...
Abstract Both researchers and practitioners are only in the early stages of examining and understanding the application of artificial intelligence (AI) in terms of marketing themselves as employers or the open jobs they have. AI has the potential to significantly affect how firms reach, identify, attract, and select human capital. We examine factors that can influence a job candidate's intent to complete AI-enabled recruiting processes, especially the influence of a firm's use of biometrics in t...
8 CitationsSource
#1Trevor HastieH-Index: 124
#2Robert TibshiraniH-Index: 154
Last. Jerome H. FriedmanH-Index: 72
view all 3 authors...
154 Citations
#1Stuart Russell (University of California, Berkeley)H-Index: 73
#2Peter Norvig (SC: University of Southern California)H-Index: 22
The long-anticipated revision of this #1 selling book offers the most comprehensive, state of the art introduction to the theory and practice of artificial intelligence for modern applications. Intelligent Agents. Solving Problems by Searching. Informed Search Methods. Game Playing. Agents that Reason Logically. First-order Logic. Building a Knowledge Base. Inference in First-Order Logic. Logical Reasoning Systems. Practical Planning. Planning and Acting. Uncertainty. Probabilistic Reasoning Sys...
16.7k Citations
#1Paul LukowiczH-Index: 1
3 CitationsSource
#1Anna Jobin (ETH Zurich)H-Index: 2
#2Marcello Ienca (ETH Zurich)H-Index: 15
Last. Effy Vayena (ETH Zurich)H-Index: 30
view all 3 authors...
In the last five years, private companies, research institutions as well as public sector organisations have issued principles and guidelines for ethical AI, yet there is debate about both what constitutes "ethical AI" and which ethical requirements, technical standards and best practices are needed for its realization. To investigate whether a global agreement on these questions is emerging, we mapped and analyzed the current corpus of principles and guidelines on ethical AI. Our results reveal...
454 CitationsSource
#1Ninareh MehrabiH-Index: 4
#2Fred MorstatterH-Index: 19
Last. Aram GalstyanH-Index: 38
view all 5 authors...
With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive environments to make important and life-changing decisions; thus, it is crucial to ensure that the decisions do not reflect discriminatory behavior toward certain groups or populations. We have recently seen work in machine learning, natural language processing, a...
303 Citations
#1Luciano FloridiH-Index: 71
#2Josh CowlsH-Index: 12
Artificial Intelligence (AI) is already having a major impact on society. As a result, many organizations have launched a wide range of initiatives to establish ethical principles for the adoption of socially beneficial AI. Unfortunately, the sheer volume of proposed principles threatens to overwhelm and confuse. How might this problem of ‘principle proliferation’ be solved? In this paper, we report the results of a fine-grained analysis of several of the highest-profile sets of ethical principl...
93 CitationsSource
Cited By9
Newest
Business psychologists study and assess relevant individual differences, such as intelligence and personality, in the context of work. Such studies have informed the development of artificial intelligence systems (AI) designed to measure individual differences. This has been capitalized on by companies who have developed AI-driven recruitment solutions that include aggregation of appropriate candidates (Hiretual), interviewing through a chatbot (Paradox), video interview assessment (MyInterview)...
Source
Last. Elizabeth LomasH-Index: 3
view all 3 authors...
The rapid development of facial recognition technologies (FRT) has led to complex ethical choices in terms of balancing individual privacy rights versus delivering societal safety. Within this space, increasingly commonplace use of these technologies by law enforcement agencies has presented a particular lens for probing this complex landscape, its application, and the acceptable extent of citizen surveillance. This analysis focuses on the regulatory contexts and recent case law in the United St...
1 CitationsSource
An independent ethical assessment of an artificial intelligence system is an impartial examination of the system's development, deployment, and use in alignment with ethical values. System-level qualitative frameworks that describe high-level requirements and component-level quantitative metrics that measure individual ethical dimensions have been developed over the past few years. However, there exists a gap between the two, which hinders the execution of independent ethical assessments in prac...
#2Emre Kazim (UCL: University College London)H-Index: 3
1 CitationsSource
#1Jakob Mokander (University of Oxford)H-Index: 1
#2Jessica Morley (University of Oxford)H-Index: 12
Last. Luciano Floridi (University of Oxford)H-Index: 71
view all 4 authors...
Important decisions that impact humans lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called automated decision-making systems (ADMS) can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design an...
1 CitationsSource
The rapid spread of artificial intelligence (AI) systems has precipitated a rise in ethical and rights-based frameworks intended to guide the development and use of these technologies. Despite the proliferation of these "AI principles", there is mounting public concern over the influence that the AI systems have in our society, and coalitions in all sectors are organizing to resist harmful applications of AI worldwide. Responses from peoples everywhere, from workers protesting unethical conduct ...
1 CitationsSource
#1Abigail Goldsteen (IBM)H-Index: 4
#2Gilad Ezov (IBM)
Last. Ariel Farkash (IBM)H-Index: 5
view all 5 authors...
There is a known tension between the need to analyze personal data to drive business and privacy concerns. Many data protection regulations, including the EU General Data Protection Regulation (GDPR) and the California Consumer Protection Act (CCPA), set out strict restrictions and obligations on companies that collect or process personal data. Moreover, machine learning models themselves can be used to derive personal information, as demonstrated by recent membership and attribute inference att...
1 Citations