What question did this study set out to answer?

To determine whether language model dialect biases and safety disparities stem from specific linguistic components rather than bundled dialect mixtures.

August 20, 2026Open Access

Bundled Dialect Contrasts Measure a Mixture: A Feature-Isolating Matched-Pair Audit of Safety-Critical Support in Language Models

View Full Paper

Ask AI

Bookmark

To determine whether language model dialect biases and safety disparities stem from specific linguistic components rather than bundled dialect mixtures.
Designed the Dialect-Marked Response Audit (DMRA), an isolated matched-pair protocol holding non-target text attributes fixed while systematically varying individual linguistic features.
Audited Qwen3.5-35B-A3B and a refusal-reduced stress-test variant across violence-domain and crisis-support prompts to evaluate safe de-escalation versus harmful operational guidance.
Varying dialect grammar alone reproduced 3 of 8 unsafe responses in violence-domain pairs on the stress model, whereas varying racial address terms alone produced 0 of 8 unsafe responses.
Whole-dialect comparisons exhibited critical support disparities, such as withholding crisis hotline information from dialect-marked users when operating without a reasoning step.

Discussion

No takes yet. Share an insight, caveat, or question.

Implication

Matched-pair audit reveals dialect grammar drives safety-critical failures in language models, indicating bundled dialect comparisons obscure specific causal features.

Cite This Study

Jeffrey Shorthill (2026) studied this question.

synapsesocial.com/papers/6a86b4cb8a91293e6a1cc531 https://doi.org/10.5281/zenodo.20449546

View Full Paper

Ask AI

Bookmark

Implication

Matched-pair audit reveals dialect grammar drives safety-critical failures in language models, indicating bundled dialect comparisons obscure specific causal features.

Bundled Dialect Contrasts Measure a Mixture: A Feature-Isolating Matched-Pair Audit of Safety-Critical Support in Language Models

Key Points

Discussion

Implication

Cite This Study

Bundled Dialect Contrasts Measure a Mixture: A Feature-Isolating Matched-Pair Audit of Safety-Critical Support in Language Models

Key Points

Discussion

Implication

Cite This Study

Also Consider

Also Consider