This work hybridizes two monolingual language models, preserving original languages and enabling cross-lingual capabilities.
This work documents the successful hybridization of two monolingual language models without retraining. Each model was trained on a different single language. The method uses zero-padding expansion for 2D tensors and repetition for 1D tensors. RAM is limited to 4GB. The tokenizer formats differ (tokenizer.json vs vocab.json) and require manual alignment before hybridization. Results confirm that both original languages are preserved, no single model dominates, and emergent cross-lingual capabilities are observed. The hybrid model can evolve further through additional hybridizations. Code is available on GitHub: https://github.com/mouad-tarif/Monolingual-Hybridization
No takes yet. Share an insight, caveat, or question.
Mouad Tarif (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: