Addresses demographic bias in AI predictions for pediatric mental health, suggesting improvements for fairness.
Healthcare Artificial Intelligence (AI) offers transformative potential but often inherits biases from training data, worsening disparities. While bias mitigation has focused on structured data, mental health relies on unstructured clinical notes, where linguistic differences and data sparsity pose challenges. This study aims to detect and reduce non-biological textual bias in AI models supporting pediatric mental health screening. We analyzed ~20,000 pediatric anxiety cases and matched controls (ages 5-15) from Cincinnati Children’s Hospital records, where gender prevalence transitions from male-dominant in early childhood to female-dominant in adolescence. Anxiety prediction models were fine-tuned using a Transformer architecture optimized for computational efficiency. Classification parity across sex subgroups was evaluated, and we also verified that the model relied on clinically relevant words (using the LIME tool). Bias was mitigated through informative term filtering and systematic gender-biased text replacement. Here, we show systematic under-diagnosis of female adolescents, with 4% lower accuracy and 9% higher false-negative rates compared to male patients. Notes for male patients are on average 500 words longer, and linguistic similarity metrics reveal distinct word distributions between sexes. Applying our de-biasing framework reduces diagnostic bias by up to 27%, improving equity in model performance. We develop and evaluate a data-centric de-biasing framework to address gender-based disparities in clinical text arising from non-biological differences, such as reporting practices and documentation styles. Our method selectively de-biases data by neutralizing biased language and normalizing information density while preserving clinically relevant content. Further validation across different models is essential before clinical deployment. Artificial Intelligence (AI) is increasingly used in healthcare, but it can unintentionally reflect biases found in medical records. These biases may lead to unfair predictions, especially in mental health, where information comes from written notes rather than tabular data. Our study looks at anxiety in children and teenagers and explores whether differences in how doctors write notes for boys and girls affect AI predictions. We analyzed thousands of records and found that girls were more likely to be underdiagnosed. To address this, we developed a method that removes biased language and balances information without losing important clinical details. This approach improves fairness in AI predictions, but more testing is needed before it can be used in real-world healthcare. Ive et al. analyze ~20,000 patient records and implement a de-biasing framework to neutralize biased language and information density. Gender-related diagnostic disparities are reduced by up to 27%.
No takes yet. Share an insight, caveat, or question.
Ive et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: