Cross-linguistic study investigates geometric encoding and attention in Arabic and Hebrew transformer models, indicating significant findings.
A pre-registered cross-linguistic study of templatic Semitic morphology and letter-value structure in classical-Arabic and classical-Hebrew transformer encoders (CAMeLBERT-ca, AlephBERT). We report that the Arabic morphological pattern (wazn) is encoded as geometrically separable, linearly decodable structure, and that cross-root word pairs with proximate Abjad values receive higher mutual attention than Abjad-distal pairs (partial ρ = −0.0558, n = 2,322,977; 1,000-permutation p = 0.026). A pre-registered Hebrew control satisfies the morphologically-general outcome, and a frequency-matched null locates the Mashriqi-specific component at the level of frequency-tier alignment. Code and locked result artifacts are released at the linked repository.
No takes yet. Share an insight, caveat, or question.
Ahmed Mislati (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: