The Bounded Intelligence of AI: Superficiality and Deceivability

Hao Ma,Mengyue Su
DOI: https://doi.org/10.1016/j.orgdyn.2024.101100
IF: 1.133
2024-01-01
Organizational Dynamics
Abstract:Artificial Intelligence (AI) is typically designed to replace or augment human beings in making and executing decisions. In the domain of organizational management, AI has already found wide applications in many areas such as HR functions, marketing campaigns, competitive analysis, and strategy formulations, exerting increasing impacts on a host of executives and management professionals. Accurate and timely replicating or capturing the know-how of human decisions and actions becomes imperative, as AI has to be, at least as intelligent as, or even more intelligent than, those human actors whose data are being fed to AI during its training and learning iterations. Just as human beings are subject to bounded rationality due to their limited capacities in information processing, AI, too, is subject to bounded intelligence, in the sense that it could appear not as smart as expected, due to its limited capacities in replicating and capturing human expertise, to say nothing of augmenting or extending it. Such bounded intelligence of AI hinges on two underlying factors: superficiality and deceivability. Superficiality refers to the inability of AI to fully replicate human expertise during its learning process due to natural or technical barriers such as imperfect capturability, relational embeddedness, and time sensitivity. Deceivability refers to the inability of AI to accurately capture human expertise during its learning process due to human-actor-created barriers such as passive evasion, deliberate manipulation, and malicious sabotage. Understanding such boundedness of AI and the specific mechanisms of superficiality and deceivability will help us better appreciate the usefulness and limitations of AI and take measures to both remedy and utilize the bounded intelligence of AI.
What problem does this paper attempt to address?