Balancing transparency and control: The impact of AI explanation detail on user perception in automated vehicles

As automated vehicle technology advances, explainable AI has emerged as a critical tool to enable users to understand and predict the behavior of AI systems, particularly in safety-critical applications such as automated driving. However, increased transparency in AI explanations may inadvertently contribute to an “illusion of control”, a cognitive bias in which drivers overestimate their influence or understanding of the AI’s actions. We aim to better understand how the level of detail in AI explanations affects users of automated vehicles. In a virtual reality study, N=44 participants experienced different explanation levels (low, medium, high) in an automated ride (SAE L4) compared to a baseline condition with no explanations. The results show a significant improvement in participants’ user experience, acceptance, and explanation satisfaction, with more detailed explanations. Our findings also indicate that as AI explanations become more detailed, users’ perceived level of control increases significantly, although this perception does not correlate with actual control capabilities. At the same time, it decreased their desire to take control, indicating users’ susceptibility to the ’illusion of control’ bias in the context of automated driving. Overall, this suggests that the design of explanation interfaces should strive for a balanced level of detail that promotes AI transparency without causing cognitive overload. At the same time, explainable AI can be utilized to decrease users’ desire to intervene in the AI’s actions.