Trust Evolution Over Time in Explainable AI for Fake News Detection

Sina Mohseni,Fan Yang,Shiva Pentyala,Mengnan Du,Yi Liu,Nic Lupfer,Xia Hu,Shuiwang Ji,Eric D. Ragan
2020-01-01
Abstract:Copyright held by the owner/author(s). CHI’20,, April 25–30, 2020, Honolulu, HI, USA ACM 978-1-4503-6819-3/20/04. https://doi.org/10.1145/3334480.XXXXXXX Abstract The need for interpretable and accountable intelligent systems is strong as artificial intelligence (AI) becomes more prevalent in human life. We study the effects of interpretability on user’s trust in an AI assistant tool designed for fake news detection. In our study, we expose participants to different types of AI and Explainable AI (XAI) assistants, measure their perceived accuracy of algorithm, and cluster user trust changes over time into five types of trust evolution. We present quantitative results and analysis from human-subject studies and discuss our findings regarding how model explanations affect on user trust evolution over time.
What problem does this paper attempt to address?