We investigate the layer-wise relationship between embedding geometry and output preferences across four diverse LLM families: Pythia-6.9B, Llama-3.1-8B, Apertus-8B (multilingual), and Gemma-2B (SFT). Using a pair-level centroid-asymmetry metric computed across 230 statement pairs with 10,000 bootstrap resamples, we find that embedding-output dynamics are phase-structured: the correlation between embedding clustering and output preference changes sign systematically across network depth. Key Findings:• Late-layer inversion is architecturally robust in larger base models (confirmed in 3/4 tested families).• Decision commitment depth is architecture-dependent (e.g., Llama commits early, Pythia commits late).• Chat templates are associated with a distinct processing regime in instruction-tuned models.• Small SFT models (Gemma-2B) represent a boundary condition where phase structure does not reliably emerge. Methodological Note:This study introduces a pair-level bootstrapping framework (n=230) that resolves Simpson's Paradox artifacts observed in previous category-level aggregations. Related Work:This work continues the research line established in D'Elia (2025): Uniformity Asymmetry (DOI: 10.5281/zenodo.18110161). Repository & Data:https://github.com/buk81/uniformity-asymmetry
Davide D'Elia (Sun,) studied this question.