How artificial intelligence can help to keep us safe

Dom Byrne

DOI: https://doi.org/10.1038/d41586-024-02902-8

IF: 64.8

2024-10-03

Nature

Abstract:Sociologist Gabriele Jacobs believes AI can be a useful tool in public safety, if developed ethically and responsibly. Sociologist Gabriele Jacobs believes AI can be a useful tool in public safety, if developed ethically and responsibly.

multidisciplinary sciences

What problem does this paper attempt to address?

How to harness AI's potential in research — responsibly and ethically

Jane Palmer

DOI: https://doi.org/10.1038/d41586-024-02762-2

IF: 64.8

2024-08-26

Nature

Abstract:Artificial intelligence is propelling advances in all areas of science. But vigilance is needed, warn four researchers at the leading edge. Artificial intelligence is propelling advances in all areas of science. But vigilance is needed, warn four researchers at the leading edge.

multidisciplinary sciences
Introduction to AI Safety, Ethics, and Society

Dan Hendrycks

2024-11-16

Abstract:Artificial Intelligence is rapidly embedding itself within militaries, economies, and societies, reshaping their very foundations. Given the depth and breadth of its consequences, it has never been more pressing to understand how to ensure that AI systems are safe, ethical, and have a positive societal impact. This book aims to provide a comprehensive approach to understanding AI risk. Our primary goals include consolidating fragmented knowledge on AI risk, increasing the precision of core ideas, and reducing barriers to entry by making content simpler and more comprehensible. The book has been designed to be accessible to readers from diverse backgrounds. You do not need to have studied AI, philosophy, or other such topics. The content is skimmable and somewhat modular, so that you can choose which chapters to read. We introduce mathematical formulas in a few places to specify claims more precisely, but readers should be able to understand the main points without these.

Machine Learning,Artificial Intelligence,Computers and Society
AI Safety: Necessary, but insufficient and possibly problematic

Deepak P

DOI: https://doi.org/10.1007/s00146-024-01899-y

2024-03-26

Abstract:This article critically examines the recent hype around AI safety. We first start with noting the nature of the AI safety hype as being dominated by governments and corporations, and contrast it with other avenues within AI research on advancing social good. We consider what 'AI safety' actually means, and outline the dominant concepts that the digital footprint of AI safety aligns with. We posit that AI safety has a nuanced and uneasy relationship with transparency and other allied notions associated with societal good, indicating that it is an insufficient notion if the goal is that of societal good in a broad sense. We note that the AI safety debate has already influenced some regulatory efforts in AI, perhaps in not so desirable directions. We also share our concerns on how AI safety may normalize AI that advances structural harm through providing exploitative and harmful AI with a veneer of safety.

Artificial Intelligence,Computers and Society
Why scientists trust AI too much — and what to do about it

DOI: https://doi.org/10.1038/d41586-024-00639-y

IF: 64.8

2024-03-07

Nature

Abstract:Some researchers see superhuman qualities in artificial intelligence. All scientists need to be alert to the risks this creates. Some researchers see superhuman qualities in artificial intelligence. All scientists need to be alert to the risks this creates.

multidisciplinary sciences
Artificial intelligence as law

Bart Verheij

DOI: https://doi.org/10.1007/s10506-020-09266-0

IF: 4.1

2020-05-14

Artificial Intelligence and Law

Abstract:Information technology is so ubiquitous and AI's progress so inspiring that also legal professionals experience its benefits and have high expectations. At the same time, the powers of AI have been rising so strongly that it is no longer obvious that AI applications (whether in the law or elsewhere) help promoting a good society; in fact they are sometimes harmful. Hence many argue that safeguards are needed for AI to be trustworthy, social, responsible, humane, ethical. In short: AI should be good for us. But how to establish proper safeguards for AI? One strong answer readily available is: consider the problems and solutions studied in AI & Law. AI & Law has worked on the design of social, explainable, responsible AI aligned with human values for decades already, AI & Law addresses the hardest problems across the breadth of AI (in reasoning, knowledge, learning and language), and AI & Law inspires new solutions (argumentation, schemes and norms, rules and cases, interpretation). It is argued that the study of AI as Law supports the development of an AI that is good for us, making AI & Law more relevant than ever.

computer science, artificial intelligence, interdisciplinary applications,law
Filling gaps in trustworthy development of AI

Shahar Avin,Haydn Belfield,Miles Brundage,Gretchen Krueger,Jasmine Wang,Adrian Weller,Markus Anderljung,Igor Krawczuk,David Krueger,Jonathan Lebensold,Tegan Maharaj,Noa Zilberman

DOI: https://doi.org/10.48550/arXiv.2112.07773

IF: 14.4

2021-12-14

Artificial Intelligence

Abstract:The range of application of artificial intelligence (AI) is vast, as is the potential for harm. Growing awareness of potential risks from AI systems has spurred action to address those risks, while eroding confidence in AI systems and the organizations that develop them. A 2019 study found over 80 organizations that published and adopted "AI ethics principles'', and more have joined since. But the principles often leave a gap between the "what" and the "how" of trustworthy AI development. Such gaps have enabled questionable or ethically dubious behavior, which casts doubts on the trustworthiness of specific organizations, and the field more broadly. There is thus an urgent need for concrete methods that both enable AI developers to prevent harm and allow them to demonstrate their trustworthiness through verifiable behavior. Below, we explore mechanisms (drawn from arXiv:2004.07213) for creating an ecosystem where AI developers can earn trust - if they are trustworthy. Better assessment of developer trustworthiness could inform user choice, employee actions, investment decisions, legal recourse, and emerging governance regimes.
Artificial Intelligence and Crime

Roderic Broadhurst,Donald Maxim,Paige Brown,Harshit Trivedi,Joy Wang

DOI: https://doi.org/10.2139/ssrn.3407779

2019-01-01

SSRN Electronic Journal

Abstract:This review of the rapidly growing literature on the impact of artificial intelligence (AI) on crime and crime prevention outlines some of the likely limits and potential of AI applications as a crime enabler or crime fighter. In short, our focus is on the criminogenic potential as well as preventative role of AI.Investment and interest in developing machine learning (ML) technologies that underpin AI capabilities across industry, civil and military applications have grown exponentially in the past decade. This investment in AI research and development has boosted innovation and productivity as well as intensifying competition between states in the race to gain technological advantage. The scale of data acquisition and aggregation essential for the ‘training’ of effective AI via ML processes also poses broader associated risks to privacy and fairness as such technology shifts from a niche to general purpose technology. The potential weaponization of AI applications such as computational marketing, ‘deep’ fake images or news and enhanced surveillance, however, are pressing challenges to democracies and human rights. Poorly implemented ethical, accountability and regulatory measures will also provide opportunities for criminal activity as well as the potential of accidents, unreliability and other unintended consequences.AI is generally described as weak, medium or strong and it is widely understood that the AI currently in use can be classified as weak. This is because the underlying ML iterative processes are based on domain specific or limited ‘training’ particular to the problem or activity addressed and thus offer only narrow or highly focused AI applications. Five major functional areas have stimulated the civil development of AI and these are:● Voice and Speech Recognition● Computer Vision ● Extended Reality (XR)● Game Playing ● Natural Language Processing (NLP)We explore some of the concerns about AI as currently realised and argues that automated decision-making technology should not be relied upon as a sole decision-making tool. Scepticism is currently necessary when evaluating an AI’s performance. The United States White House’s Office of Science and Technology Policy has warned of the potential threat that AI poses to privacy, civil rights, and individual freedoms through the “Potential of encoding discrimination in automated decisions” (Executive Office of the US President, 2016, p. 45).The various ways in which AI can be used as a defensive or an offensive tool in respect to cybercrime are described and evaluate some of the opportunities and risks that arise when AI is employed either to defend and detect attacks against computer systems or to attack computer systems. A summary of the legal and regulatory dimensions of AI and discusses the extent to which existing laws are sufficiently technologically neutral or ‘future proof’ to incorporate the use and potential ‘misconduct’ or misuse of AI in decision-making.AI applications will also be used to enhance many existing surveillance systems incorporating and aggregating data from different sources including fusing individual biometric data with expenditure and activity transaction records to create ‘whole of life’ behavioural classifiers. PR China’s newly piloted social responsibility system is such a system that ‘scores’ an individual citizen’s conduct (e.g. by rating the ‘social worthiness’ of consumption and activities) so as to prioritise access to state-controlled activities or services (e.g. state offices/jobs, travel, educational or medical services). The ubiquitous melding of data to classify conduct and rate individuals driven by AI algorithms may emerge as the key method of the new surveillance state or corporation. In this sense, AI may also evolve as a self-preserving autonomous system. These new forms of total surveillance will also be a key target for manipulation by criminal actors and others.
Understanding artificial intelligence ethics and safety

David Leslie

DOI: https://doi.org/10.5281/zenodo.3240529

2019-06-12

Abstract:A remarkable time of human promise has been ushered in by the convergence of the ever-expanding availability of big data, the soaring speed and stretch of cloud computing platforms, and the advancement of increasingly sophisticated machine learning algorithms. Innovations in AI are already leaving a mark on government by improving the provision of essential social goods and services from healthcare, education, and transportation to food supply, energy, and environmental management. These bounties are likely just the start. The prospect that progress in AI will help government to confront some of its most urgent challenges is exciting, but legitimate worries abound. As with any new and rapidly evolving technology, a steep learning curve means that mistakes and miscalculations will be made and that both unanticipated and harmful impacts will occur. This guide, written for department and delivery leads in the UK public sector and adopted by the British Government in its publication, 'Using AI in the Public Sector,' identifies the potential harms caused by AI systems and proposes concrete, operationalisable measures to counteract them. It stresses that public sector organisations can anticipate and prevent these potential harms by stewarding a culture of responsible innovation and by putting in place governance processes that support the design and implementation of ethical, fair, and safe AI systems. It also highlights the need for algorithmically supported outcomes to be interpretable by their users and made understandable to decision subjects in clear, non-technical, and accessible ways. Finally, it builds out a vision of human-centred and context-sensitive implementation that gives a central role to communication, evidence-based reasoning, situational awareness, and moral justifiability.

Computers and Society,Artificial Intelligence,Machine Learning,Applications
A Case for AI Safety via Law

Jeffrey W. Johnston

2023-10-04

Abstract:How to make artificial intelligence (AI) systems safe and aligned with human values is an open research question. Proposed solutions tend toward relying on human intervention in uncertain situations, learning human values and intentions through training or observation, providing off-switches, implementing isolation or simulation environments, or extrapolating what people would want if they had more knowledge and more time to think. Law-based approaches--such as inspired by Isaac Asimov--have not been well regarded. This paper makes a case that effective legal systems are the best way to address AI safety. Law is defined as any rules that codify prohibitions and prescriptions applicable to particular agents in specified domains/contexts and includes processes for enacting, managing, enforcing, and litigating such rules.

Computers and Society,Artificial Intelligence
Artificial Tikkun Olam: AI Can Be Our Best Friend in Building an Open Human-Computer Society

Simon Kasif

DOI: https://doi.org/10.48550/arXiv.2010.12015

2020-10-20

Computers and Society

Abstract:Technological advances of virtually every kind pose risks to society including fairness and bias. We review a long-standing wisdom that a widespread practical deployment of any technology may produce adverse side effects misusing the knowhow. This includes AI but AI systems are not solely responsible for societal risks. We describe some of the common and AI specific risks in health industries and other sectors and propose both broad and specific solutions. Each technology requires very specialized and informed tracking, monitoring and creative solutions. We postulate that AI systems are uniquely poised to produce conceptual and methodological solutions to both fairness and bias in automated decision-making systems. We propose a simple intelligent system quotient that may correspond to their adverse societal impact and outline a multi-tier architecture for producing solutions of increasing complexity to these risks. We also propose that universities may consider forming interdisciplinary Study of Future Technology Centers to investigate and predict the fuller range of risks posed by technology and seek both common and AI specific solutions using computational, technical, conceptual and ethical analysis
Leveraging Artificial Intelligence for Crime Detection and Prevention

Louis Zvikomborero Kahla,

DOI: https://doi.org/10.55041/ijsrem34207

2024-05-17

INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT

Abstract:This paper sheds light on how Artificial Intelligence (AI) is reshaping the landscape of crime detection and prevention, bringing about a significant change in traditional law enforcement methods. With society increasingly embracing AI-driven solutions, it's crucial to understand how they contribute to public safety. We'll dive into various aspects of AI, such as predictive policing, video surveillance analysis, forensic science, and criminal profiling, to see how they enhance law enforcement capabilities and streamline crime resolution processes.Starting with predictive policing, AI algorithms sift through massive datasets to identify patterns and predict future criminal activity, empowering law enforcement to take proactive measures. Similarly, AI-powered video surveillance systems enhance real-time monitoring and anomaly detection, allowing for quick identification of suspicious behavior in urban environments.Moving on, we'll explore AI's impact on forensic analysis, where it expedites processes like DNA sequencing, fingerprint recognition, and ballistics analysis, speeding up the resolution of cold cases. Additionally, we'll delve into AI's role in criminal profiling, highlighting its ability to decipher behavioral patterns and predict criminal motivations, though ethical considerations remain paramount.We'll also address ethical concerns surrounding AI deployment in law enforcement, including privacy issues and algorithmic biases. Emphasizing the need for transparency and accountability, we advocate for responsible use of AI-powered crime detection systems to uphold ethical standards and protect individual rights.
Considerations Influencing Offense-Defense Dynamics From Artificial Intelligence

Giulio Corsi,Kyle Kilian,Richard Mallah

2024-12-05

Abstract:The rapid advancement of artificial intelligence (AI) technologies presents profound challenges to societal safety. As AI systems become more capable, accessible, and integrated into critical services, the dual nature of their potential is increasingly clear. While AI can enhance defensive capabilities in areas like threat detection, risk assessment, and automated security operations, it also presents avenues for malicious exploitation and large-scale societal harm, for example through automated influence operations and cyber attacks. Understanding the dynamics that shape AI's capacity to both cause harm and enhance protective measures is essential for informed decision-making regarding the deployment, use, and integration of advanced AI systems. This paper builds on recent work on offense-defense dynamics within the realm of AI, proposing a taxonomy to map and examine the key factors that influence whether AI systems predominantly pose threats or offer protective benefits to society. By establishing a shared terminology and conceptual foundation for analyzing these interactions, this work seeks to facilitate further research and discourse in this critical area.

Artificial Intelligence
Artificial Intelligence Crime: An Interdisciplinary Analysis of Foreseeable Threats and Solutions

Thomas C King,Nikita Aggarwal,Mariarosaria Taddeo,Luciano Floridi

DOI: https://doi.org/10.1007/s11948-018-00081-0

Abstract:Artificial intelligence (AI) research and regulation seek to balance the benefits of innovation against any potential harms and disruption. However, one unintended consequence of the recent surge in AI research is the potential re-orientation of AI technologies to facilitate criminal acts, term in this article AI-Crime (AIC). AIC is theoretically feasible thanks to published experiments in automating fraud targeted at social media users, as well as demonstrations of AI-driven manipulation of simulated markets. However, because AIC is still a relatively young and inherently interdisciplinary area-spanning socio-legal studies to formal science-there is little certainty of what an AIC future might look like. This article offers the first systematic, interdisciplinary literature analysis of the foreseeable threats of AIC, providing ethicists, policy-makers, and law enforcement organisations with a synthesis of the current problems, and a possible solution space.
How to Design AI for Social Good: Seven Essential Factors

Luciano Floridi,Josh Cowls,Thomas C. King,Mariarosaria Taddeo

DOI: https://doi.org/10.1007/s11948-020-00213-5

IF: 3.777

2020-04-03

Science and Engineering Ethics

Abstract:Abstract The idea of artificial intelligence for social good (henceforth AI4SG) is gaining traction within information societies in general and the AI community in particular. It has the potential to tackle social problems through the development of AI-based solutions. Yet, to date, there is only limited understanding of what makes AI socially good in theory, what counts as AI4SG in practice, and how to reproduce its initial successes in terms of policies. This article addresses this gap by identifying seven ethical factors that are essential for future AI4SG initiatives. The analysis is supported by 27 case examples of AI4SG projects. Some of these factors are almost entirely novel to AI, while the significance of other factors is heightened by the use of AI. From each of these factors, corresponding best practices are formulated which, subject to context and balance, may serve as preliminary guidelines to ensure that well-designed AI is more likely to serve the social good.

ethics,history & philosophy of science,multidisciplinary sciences,engineering, multidisciplinary
Citizen Perspectives on Necessary Safeguards to the Use of AI by Law Enforcement Agencies

Yasmine Ezzeddine,Petra Saskia Bayerl,Helen Gibson

DOI: https://doi.org/10.48550/arXiv.2306.01786

2023-05-31

Abstract:In the light of modern technological advances, Artificial Intelligence (AI) is relied upon to enhance performance, increase efficiency, and maximize gains. For Law Enforcement Agencies (LEAs), it can prove valuable in optimizing evidence analysis and establishing proactive prevention measures. Nevertheless, citizens raise legitimate concerns around privacy invasions, biases, inequalities, and inaccurate decisions. This study explores the views of 111 citizens towards AI use by police through interviews, and integrates societal concerns along with propositions of safeguards from negative effects of AI use by LEAs in the context of cybercrime and terrorism.

Computers and Society
Why we need an AI-resilient society

Thomas Bartz-Beielstein

DOI: https://doi.org/10.48550/arXiv.1912.08786

2019-12-19

Abstract:Artificial intelligence is considered as a key technology. It has a huge impact on our society. Besides many positive effects, there are also some negative effects or threats. Some of these threats to society are well-known, e.g., weapons or killer robots. But there are also threats that are ignored. These unknown-knowns or blind spots affect privacy, and facilitate manipulation and mistaken identities. We cannot trust data, audio, video, and identities any more. Democracies are able to cope with known threats, the known-knowns. Transforming unknown-knowns to known-knowns is one important cornerstone of resilient societies. An AI-resilient society is able to transform threats caused by new AI tecchnologies such as generative adversarial networks. Resilience can be seen as a positive adaptation of these threats. We propose three strategies how this adaptation can be achieved: awareness, agreements, and red flags. This article accompanies the TEDx talk "Why we urgently need an AI-resilient society", see <a class="link-external link-https" href="https://youtu.be/f6c2ngp7rqY" rel="external noopener nofollow">this https URL</a>.

Computers and Society,Artificial Intelligence
Ethical perspective on AI hazards to humans: A review

Changye Chen,Ziyu Chen,Wenyu Luo,Ying Xu,Sixia Yang,Guozhao Yang,Xuhong Chen,Xiaoxia Chi,Ni Xie,Zhuoying Zeng

DOI: https://doi.org/10.1097/MD.0000000000036163

2023-12-01

Abstract:This article explores the potential ethical hazards of artificial intelligence (AI) on society from an ethical perspective. We introduce the development and application of AI, emphasizing its potential benefits and possible negative impacts. We particularly examine the application of AI in the medical field and related ethical and legal issues, and analyze potential hazards that may exist in other areas of application, such as autonomous driving, finance, and security. Finally, we offer recommendations to help policymakers, technology companies, and society as a whole address the potential hazards of AI. These recommendations include strengthening regulation and supervision of AI, increasing public understanding and awareness of AI, and actively exploring how to use the advantages of AI to achieve a more just, equal, and sustainable social development. Only by actively exploring the advantages of AI while avoiding its negative impacts can we better respond to future challenges.
Safeguarding AI Agents: Developing and Analyzing Safety Architectures

Ishaan Domkundwar,Mukunda N S,Ishaan Bhola

2024-09-13

Abstract:AI agents, specifically powered by large language models, have demonstrated exceptional capabilities in various applications where precision and efficacy are necessary. However, these agents come with inherent risks, including the potential for unsafe or biased actions, vulnerability to adversarial attacks, lack of transparency, and tendency to generate hallucinations. As AI agents become more prevalent in critical sectors of the industry, the implementation of effective safety protocols becomes increasingly important. This paper addresses the critical need for safety measures in AI systems, especially ones that collaborate with human teams. We propose and evaluate three frameworks to enhance safety protocols in AI agent systems: an LLM-powered input-output filter, a safety agent integrated within the system, and a hierarchical delegation-based system with embedded safety checks. Our methodology involves implementing these frameworks and testing them against a set of unsafe agentic use cases, providing a comprehensive evaluation of their effectiveness in mitigating risks associated with AI agent deployment. We conclude that these frameworks can significantly strengthen the safety and security of AI agent systems, minimizing potential harmful actions or outputs. Our work contributes to the ongoing effort to create safe and reliable AI applications, particularly in automated operations, and provides a foundation for developing robust guardrails to ensure the responsible use of AI agents in real-world applications.

Cryptography and Security,Artificial Intelligence
Artificial Intelligence and the ‘Good Society’: the US, EU, and UK approach

Corinne Cath,Sandra Wachter,Brent Mittelstadt,Mariarosaria Taddeo,Luciano Floridi

DOI: https://doi.org/10.1007/s11948-017-9901-7

IF: 3.777

2017-03-28

Science and Engineering Ethics

Abstract:In October 2016, the White House, the European Parliament, and the UK House of Commons each issued a report outlining their visions on how to prepare society for the widespread use of artificial intelligence (AI). In this article, we provide a comparative assessment of these three reports in order to facilitate the design of policies favourable to the development of a ‘good AI society’. To do so, we examine how each report addresses the following three topics: (a) the development of a ‘good AI society’; (b) the role and responsibility of the government, the private sector, and the research community (including academia) in pursuing such a development; and (c) where the recommendations to support such a development may be in need of improvement. Our analysis concludes that the reports address adequately various ethical, social, and economic topics, but come short of providing an overarching political vision and long-term strategy for the development of a ‘good AI society’. In order to contribute to fill this gap, in the conclusion we suggest a two-pronged approach.

ethics,history & philosophy of science,multidisciplinary sciences,engineering, multidisciplinary
Shaping AI's Impact on Billions of Lives

Mariano-Florentino Cuéllar,Jeff Dean,Finale Doshi-Velez,John Hennessy,Andy Konwinski,Sanmi Koyejo,Pelonomi Moiloa,Emma Pierson,David Patterson

2024-12-04

Abstract:Artificial Intelligence (AI), like any transformative technology, has the potential to be a double-edged sword, leading either toward significant advancements or detrimental outcomes for society as a whole. As is often the case when it comes to widely-used technologies in market economies (e.g., cars and semiconductor chips), commercial interest tends to be the predominant guiding factor. The AI community is at risk of becoming polarized to either take a laissez-faire attitude toward AI development, or to call for government overregulation. Between these two poles we argue for the community of AI practitioners to consciously and proactively work for the common good. This paper offers a blueprint for a new type of innovation infrastructure including 18 concrete milestones to guide AI research in that direction. Our view is that we are still in the early days of practical AI, and focused efforts by practitioners, policymakers, and other stakeholders can still maximize the upsides of AI and minimize its downsides. We talked to luminaries such as recent Nobelist John Jumper on science, President Barack Obama on governance, former UN Ambassador and former National Security Advisor Susan Rice on security, philanthropist Eric Schmidt on several topics, and science fiction novelist Neal Stephenson on entertainment. This ongoing dialogue and collaborative effort has produced a comprehensive, realistic view of what the actual impact of AI could be, from a diverse assembly of thinkers with deep understanding of this technology and these domains. From these exchanges, five recurring guidelines emerged, which form the cornerstone of a framework for beginning to harness AI in service of the public good. They not only guide our efforts in discovery but also shape our approach to deploying this transformative technology responsibly and ethically.

Artificial Intelligence,Computers and Society,Emerging Technologies,Machine Learning

How artificial intelligence can help to keep us safe

How to harness AI's potential in research — responsibly and ethically

Introduction to AI Safety, Ethics, and Society

AI Safety: Necessary, but insufficient and possibly problematic

Why scientists trust AI too much — and what to do about it

Artificial intelligence as law

Filling gaps in trustworthy development of AI

Artificial Intelligence and Crime

Understanding artificial intelligence ethics and safety

A Case for AI Safety via Law

Artificial Tikkun Olam: AI Can Be Our Best Friend in Building an Open Human-Computer Society

Leveraging Artificial Intelligence for Crime Detection and Prevention

Considerations Influencing Offense-Defense Dynamics From Artificial Intelligence

Artificial Intelligence Crime: An Interdisciplinary Analysis of Foreseeable Threats and Solutions

How to Design AI for Social Good: Seven Essential Factors

Citizen Perspectives on Necessary Safeguards to the Use of AI by Law Enforcement Agencies

Why we need an AI-resilient society

Ethical perspective on AI hazards to humans: A review

Safeguarding AI Agents: Developing and Analyzing Safety Architectures

Artificial Intelligence and the ‘Good Society’: the US, EU, and UK approach

Shaping AI's Impact on Billions of Lives