Beyond system-level and human-level risks: institutional safeguarding for youth mental health chatbot use

Matthews et al. (2026) provide a timely analysis of large language model (LLM) chatbots and youth mental health.Their distinction between purpose-built mental health chatbots and generic LLMs is clinically important because conversational fluency may conceal marked differences in validation, governance, and crisis-response capacity.Their discussion of the interplay between system-level risks and human-level vulnerabilities offers a valuable conceptual foundation.The article also calls for collaboration among clinicians, public health experts, developers, and people with lived experience.Yet the allocation of responsibility across these actors remains unclear.Institutional arrangements ultimately determine whether emerging harm is recognised, escalated, and connected to accountable human care.This gap becomes important when considering the authors' suggestion that professionals screen for LLM use in selected contexts.Frequency of use alone is a poor indicator of harm.Routine inspection of conversation histories could pathologise ordinary technology use, compromise privacy, and discourage honest disclosure.Assessment should instead examine the purpose of use, emotional dependency, displacement of human relationships or professional care, exposure to unsafe advice, and changes in sleep, functioning, or help-seeking.Safeguarding should preserve adolescent agency and require the least intrusive assessment proportionate to the apparent risk.Clark (2025) reported that, across 10 chatbots, harmful proposals were endorsed in 19 of 60 response opportunities involving simulated adolescent scenarios.Such findings show why automated warnings cannot replace responsive professional judgement.An institutional safeguarding layer could operationalise the responsibilities implied by Matthews et al.Five elements merit consideration: purpose-sensitive assessment, risk-based triage, defined professional responsibility, supervised escalation, and privacy-preserving documentation.Low-risk psychoeducational use may require digital mental health literacy rather than clinical intervention.