Answers are grounded in this paper and cite their sources.
Topic modeling remains essential for uncovering latent structures in large text corpora, yet performance varies across languages, domains, and document lengths. This study compares five models—Latent Dirichlet Allocation (LDA), Collapsed Gibbs Sampling for LDA, LDA2Vec, Top2Vec, and BERTopic—across three datasets: Hausa news, English short texts (20 Newsgroups), and English long-form corpora (PubMed abstracts and legal case summaries). All models were trained using standardized preprocessing and coherence-based topic optimization under fully reproducible settings. Evaluation combined quantitative metrics (Cᵥ coherence and perplexity), expert human assessments (n = 20), and computational profiling. Results show that BERTopic, powered by the multilingual transformer paraphrase-multilingual-MiniLM-L12-v2, achieved the highest coherence (0.67) and interpretability across multilingual and domain-specific corpora but required greater computational resources. LDA with Gibbs Sampling offered a more efficient alternative with competitive coherence on smaller datasets. Overall, the findings reveal a clear trade-off between semantic depth and computational scalability, providing practical guidance for multilingual and domain-specific topic modeling.
No takes yet. Share an insight, caveat, or question.
Ajinaja et al. (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: