A superb demonstration of one of the wonders of technology providing the people with great aid is the employment of Artificial Intelligence in the medical field, and mainly the introduction of Clinical Decision Support Systems (CDSS). Nevertheless, non-’black-box’ AI systems have a significant problem, that is, although they are visible and understandable, there is still a considerable issue of trust by healthcare professionals. Explainable AI (XAI) technology is a means to overcome all the obstacles by unveiling more and offering the explanations of the procedures that AI performs in decision making. This study was conducted by examining various widely used approaches to XAI, which illustrate how XAI verifies the trustworthiness of CDSS and, consequently, facilitates the incorporation of AI-generated predictions into decision-making. Additionally, the paper also refers to the possible influence of XAI on healthcare, providing the patients’ benefits, gaining clinical trust, and facilitating delivery systems. This article highlights that an AI explanation is a key point in the process of narrowing the distance between the complexity of machine learning models and the medical domain where they are employed as reliable and trustworthy applications.
Alzuabidi et al. (Thu,) studied this question.