"My, my, how can i resist you?" - Examining User Reactions to Bogus Explanations of AI Prediction

In human-AI-collaboration tasks, explanations with low faithfulness but high plausibility might be used to invoke unwarranted trust in the AI. We propose the term bogus explanations for these kinds of explanations and compare their effect on participant behavior to that of no explanation, for the task of determining if a Eurovision Song Contest song is a winner or a loser. Our study found that participants tended towards their own intuitive choices. Fewer of the users that were provided with bogus explanations followed the AI’s suggestions and they were more critical of the AI’s performance, but at the same time, they reported that they trusted the AI more than the group without explanations.