Abstract:The pervasiveness of abusive content on the internet can lead to severe psychological and physical harm. Significant effort in Natural Language Processing (NLP) research has been devoted to addressing this problem through abusive content detection and related sub-areas, such as the detection of hate speech, toxicity, cyberbullying, etc. Although current technologies achieve high classification performance in research studies, it has been observed that the real-life application of this technology can cause unintended harms, such as the silencing of under-represented groups. We review a large body of NLP research on automatic abuse detection with a new focus on ethical challenges, organized around eight established ethical principles: privacy, accountability, safety and security, transparency and explainability, fairness and non-discrimination, human control of technology, professional responsibility, and promotion of human values. In many cases, these principles relate not only to situational ethical codes, which may be context-dependent, but are in fact connected to universal human rights, such as the right to privacy, freedom from discrimination, and freedom of expression. We highlight the need to examine the broad social impacts of this technology, and to bring ethical and human rights considerations to every stage of the application life-cycle, from task formulation and dataset design, to model training and evaluation, to application deployment. Guided by these principles, we identify several opportunities for rights-respecting, socio-technical solutions to detect and confront online abuse, including ‘nudging’, ‘quarantining’, value sensitive design, counter-narratives, style transfer, and AI-driven public education applications.evaluation, to application deployment. Guided by these principles, we identify several opportunities for rights-respecting, socio-technical solutions to detect and confront online abuse, including 'nudging', 'quarantining', value sensitive design, counter-narratives, style transfer, and AI-driven public education applications.

Ethical Concern Identification in NLP: A Corpus of ACL Anthology Ethics Statements

Use of Formal Ethical Reviews in NLP Literature: Historical Trends and Current Practices

Scruples: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotes

On the Ethical Limits of Natural Language Processing on Legal Text

Values, Ethics, Morals? On the Use of Moral Concepts in NLP Research

The State of NLP Literature: A Diachronic Analysis of the ACL Anthology

A Short Review of Ethical Challenges in Clinical Natural Language Processing

What Do NLP Researchers Believe? Results of the NLP Community Metasurvey

Towards Answering Open-ended Ethical Quandary Questions

Clinician voices on ethics of LLM integration in healthcare: a thematic analysis of ethical concerns and implications

Navigating LLM Ethics: Advancements, Challenges, and Future Directions

The Forgotten Margins of AI Ethics

Assessing Privacy Policies with AI: Ethical, Legal, and Technical Challenges

Bottom-Up and Top-Down Analysis of Values, Agendas, and Observations in Corpora and LLMs

EtiCor: Corpus for Analyzing LLMs for Etiquettes

Confronting Abusive Language Online: A Survey from the Ethical and Human Rights Perspective

Ethics and Governance of Artificial Intelligence: A Survey of Machine Learning Researchers (extended Abstract)

Examining Citations of Natural Language Processing Literature

Assessing LLMs for Moral Value Pluralism

Moral Foundations of Large Language Models

The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems