Ensuring patient and public involvement in the transition to AI‐assisted mental health care: A systematic scoping review and agenda for design justice

BACKGROUND: Machine-learning algorithms and big data analytics, popularly known as 'artificial intelligence' (AI), are being developed and taken up globally. Patient and public involvement (PPI) in the transition to AI-assisted health care is essential for design justice based on diverse patient needs. OBJECTIVE: To inform the future development of PPI in AI-assisted health care by exploring public engagement in the conceptualization, design, development, testing, implementation, use and evaluation of AI technologies for mental health. METHODS: Systematic scoping review drawing on design justice principles, and (i) structured searches of Web of Science (all databases) and Ovid (MEDLINE, PsycINFO, Global Health and Embase); (ii) handsearching (reference and citation tracking); (iii) grey literature; and (iv) inductive thematic analysis, tested at a workshop with health researchers. RESULTS: The review identified 144 articles that met inclusion criteria. Three main themes reflect the challenges and opportunities associated with PPI in AI-assisted mental health care: (a) applications of AI technologies in mental health care; (b) ethics of public engagement in AI-assisted care; and (c) public engagement in the planning, development, implementation, evaluation and diffusion of AI technologies. CONCLUSION: The new data-rich health landscape creates multiple ethical issues and opportunities for the development of PPI in relation to AI technologies. Further research is needed to understand effective modes of public engagement in the context of AI technologies, to examine pressing ethical and safety issues and to develop new methods of PPI at every stage, from concept design to the final review of technology in practice. Principles of design justice can guide this agenda.