The development and introduction of an artificial intelligence (AI)-based clinical decision support system (CDSS) in surgical departments as part of the "Supporting Surgery with Geriatric Co-management and AI" project addresses the challenges of an increasingly aging population. The system enables digital comanagement of older patients by providing evidence-based evaluations of their health status, along with corresponding medical recommendations, with the aim of improving their perioperative care. The use of an AI-based CDSS in patient care raises ethical challenges. Gathering the opinions, expectations, and concerns of older adults (as potential patients) regarding the CDSS enables the identification of ethical opportunities, concerns, and limitations associated with implementing such a system in hospitals. We conducted 5 focus groups with participants aged 65 years or older. The transcripts were evaluated using qualitative content analysis and ethically analyzed. Categories were inductively generated, followed by a thematic classification of participants' statements. We found that technical understanding did not influence the older adults' opinions. Ethical opportunities and concerns were identified. On the one hand, diagnosis and treatment could be accelerated, the patient-AI-physician interaction could enhance medical treatment, and the coordination of hospital processes could be improved. On the other hand, the quality of the CDSS depends on an adequate data foundation and robust cybersecurity. Potential risks included habituation effects, loss of a second medical opinion, and illness severity influencing patients' attitude toward medical recommendations. The risk of overdiagnosis and overtreatment was discussed controversially, and treatment options could be influenced by interests and finances. Additional concerns included challenges with time savings, potential declines in medical skills, and effects on the length of hospital stay. To address the ethical challenges, we recommend allocating sufficient time for use of the CDSS and emphasizing individualized review of the CDSS results. Furthermore, we suggest limiting private financial sponsorship.
Parchmann et al. (2025) studied this question.