Explainable AI As Collaborative Task Solving.

Arjun R. Akula,Changsong Liu,Sinisa Todorovic,Joyce Y. Chai,Song-Chun Zhu
2019-01-01
Abstract:We present a new framework for explainable AI systems (XAI) aimed at increasing human trust in the system’s performance through explanations. Based on the Theory of Mind, our framework X-ToM explicitly models machine’s mind (pg), human’s mind as inferred by the machine (pg), as well as machine’s mind as inferred by the human (pg). These mental representations are incorporated to (1) learn an optimal explanation policy that takes into account human’s perception and beliefs; and (2) quantitatively evaluate human’s trust of machine behaviors. We have applied X-ToM in the context of visual recognition. Compared to the most popularly used attribution based explanations (saliency maps), our X-ToM significantly improves human trust in the underlying vision system.
What problem does this paper attempt to address?