Abstract:In response to rising concerns surrounding the safety, security, and trustworthiness of Generative AI (GenAI) models, practitioners and regulators alike have pointed to AI red-teaming as a key component of their strategies for identifying and mitigating these risks. However, despite AI red-teaming's central role in policy discussions and corporate messaging, significant questions remain about what precisely it means, what role it can play in regulation, and how it relates to conventional red-teaming practices as originally conceived in the field of cybersecurity. In this work, we identify recent cases of red-teaming activities in the AI industry and conduct an extensive survey of relevant research literature to characterize the scope, structure, and criteria for AI red-teaming practices. Our analysis reveals that prior methods and practices of AI red-teaming diverge along several axes, including the purpose of the activity (which is often vague), the artifact under evaluation, the setting in which the activity is conducted (e.g., actors, resources, and methods), and the resulting decisions it informs (e.g., reporting, disclosure, and mitigation). In light of our findings, we argue that while red-teaming may be a valuable big-tent idea for characterizing GenAI harm mitigations, and that industry may effectively apply red-teaming and other strategies behind closed doors to safeguard AI, gestures towards red-teaming (based on public definitions) as a panacea for every possible risk verge on security theater. To move toward a more robust toolbox of evaluations for generative AI, we synthesize our recommendations into a question bank meant to guide and scaffold future AI red-teaming practices.

Turning disruption into growth opportunity: the red team strategy

Leading for Constructive Innovation: Preliminary Evidence from China

Underrated Innovators: Reactive Search of Incumbent Firms under Disruptive Innovation Shocks

Informal institutions and corporate innovation: A Perspective from Red Culture

Embracing open innovation and disruptive innovation as strategies for chinese companies

Celebrate the legacy of traditional firms

THE Impact of Disruption on the Relationship Between Exploitation, Exploration, and Organizational Adaptation

Redefining cyber resilience : Through the risk register lens

A Red Team automated testing modeling and online planning method for post-penetration

Managing Supply Chain Disruption Threat Via a Strategy Combining Pricing and Self-Protection

Resource Redeployment and the Pursuit of the New Best Use: Economic Logic and Organizational Challenges

Red-Teaming for Generative AI: Silver Bullet or Security Theater?

Resilient supply chain network design with proactive and reactive strategies under major disruptions

Disruptive Technologies for Advancing Supply Chain Resilience

The Dark Side Effect of Entrepreneurial Resilience Diversity on Pivoting: The Role of Team Reflexivity

Disruptive Transformation of Enterprise Supply Chain Performance through Strategic Technology-enabled Networking to Improve Business Value

Corporate social responsibility and disruptive innovation: The moderating effects of environmental turbulence

Looking for Meaningful Disruptive Innovation: Counterattack from Pinduoduo

Strategies for Reducing Collaboration Disruption Risk Between Logistics.

Evolving Diverse Red-team Language Models in Multi-round Multi-agent Games

An Assessment Framework for Disruptive Innovation