Answers are grounded in this paper and cite their sources.
Word Sense Disambiguation (WSD) is crucial in computational linguistics, particularly for languages with complex morphology such as Urdu. We introduce KAAN-GNN-BERT, an ensemble model that integrates Knowledge-Aware Attention Networks (KAAN), Graph Neural Networks (GNNs), and BERT transformer architecture within a semi-supervised learning framework. The model is evaluated on two benchmark Urdu datasets: ULS-WSD and UAW-WSD. KAAN-GNN-BERT leverages contextual embeddings from BERT to capture subtle semantic nuances, while GNNs infuse structured knowledge through a tripartite graph connecting pre-contexts, post-contexts, and sense identifiers. This structured representation provides rich relational insights. The KAAN mechanism aligns BERT embeddings with graph-based knowledge, enabling the model to highlight and assimilate the most relevant information. By operating in a semi-supervised manner, KAAN-GNN-BERT draws strength from both labeled and unlabeled data, improving generalizability and mitigating class imbalance issues. Experimental results demonstrate that KAAN-GNN-BERT significantly outperforms traditional supervised methods and current state-of-the-art models. It achieves F1 scores of 81.3% on ULS-WSD and 79.4% on UAW-WSD, reflecting over a 30% improvement compared to baseline models. Furthermore, the GNN component supports community detection, enhancing interpretability and providing insights into sense groupings. These findings underscore the robustness and precision of integrating transformer-based architectures with graph-driven relational knowledge and attention mechanisms. KAAN-GNN-BERT thus emerges as a powerful solution for WSD, offering strong performance even in resource-scarce linguistic contexts and paving the way for future advancements in semantic understanding.
No takes yet. Share an insight, caveat, or question.
Ahmed et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: