Application of the NIST AI Risk Management Framework to Surveillance Technology

Nandhini Swaminathan,David Danks
2024-03-23
Abstract:This study offers an in-depth analysis of the application and implications of the National Institute of Standards and Technology's AI Risk Management Framework (NIST AI RMF) within the domain of surveillance technologies, particularly facial recognition technology. Given the inherently high-risk and consequential nature of facial recognition systems, our research emphasizes the critical need for a structured approach to risk management in this sector. The paper presents a detailed case study demonstrating the utility of the NIST AI RMF in identifying and mitigating risks that might otherwise remain unnoticed in these technologies. Our primary objective is to develop a comprehensive risk management strategy that advances the practice of responsible AI utilization in feasible, scalable ways. We propose a six-step process tailored to the specific challenges of surveillance technology that aims to produce a more systematic and effective risk management practice. This process emphasizes continual assessment and improvement to facilitate companies in managing AI-related risks more robustly and ensuring ethical and responsible deployment of AI systems. Additionally, our analysis uncovers and discusses critical gaps in the current framework of the NIST AI RMF, particularly concerning its application to surveillance technologies. These insights contribute to the evolving discourse on AI governance and risk management, highlighting areas for future refinement and development in frameworks like the NIST AI RMF.
Computers and Society,Artificial Intelligence
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to apply the Artificial Intelligence Risk Management Framework (AI RMF) of the National Institute of Standards and Technology (NIST) in monitoring technologies (especially facial recognition technologies) to identify and mitigate the potential risks brought by these technologies. ### Specific problems include: 1. **High - risk nature**: - Facial recognition systems are high - risk and have a significant impact, so a structured risk management approach is required to ensure their responsible use. Specifically, these issues include privacy violations, ethical risks, and threats to civil liberties. 2. **Lack of systematic risk assessment**: - Current facial recognition technologies are often developed and deployed without fully considering relevant risk assessments, resulting in potential risks being undetected or ignored. The paper hopes to provide a systematic framework by applying NIST AI RMF to help identify and manage these risks. 3. **Insufficient stakeholder participation**: - The development and deployment of monitoring technologies usually lack the participation of relevant stakeholders, especially those individuals directly affected by monitoring. The paper emphasizes the importance of incorporating multiple opinions throughout the process. 4. **Limitations of existing frameworks**: - The existing NIST AI RMF has some limitations when applied to monitoring technologies, especially in dealing with sensitive data and complex sociotechnical systems. The paper aims to reveal these limitations through specific case studies and provide suggestions for the improvement of future frameworks. ### Main objectives of the paper: - **Develop a comprehensive risk management strategy**: Propose a six - step process specifically targeting the specific challenges of monitoring technologies to achieve more systematic and effective risk management. - **Continuous evaluation and improvement**: Emphasize the importance of continuous evaluation and improvement to help companies be more robust in managing AI - related risks. - **Promote responsible AI use**: Ensure the ethical and responsible deployment of AI systems, balancing technological innovation and social responsibility. Through these measures, the paper hopes to promote further development in the field of AI governance and risk management, especially in the high - risk field of monitoring technologies.