PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 21, 2026PLoS ONE1 citationsOpen Access

Adaptive knowledge distillation based structure-text embedding integrating for knowledge graph completion

View Full Paper
QLQingsong LiYLYou LvXWXiaolong Wei

Key Points

  • The research aims to improve knowledge graph completion by facilitating knowledge transfer between structural models and pre-trained language models.
  • Proposed AKD-KGC framework integrates structural and descriptive features at the embedding level.
  • Utilized adaptive knowledge distillation to enhance the learning process of pre-trained language models.
  • Applied the method in both transductive and inductive settings across multiple datasets.
  • Achieved state-of-the-art performance in knowledge graph completion tasks.
  • Demonstrated effective knowledge transfer from structural models to language models.
  • Improved the understanding of entity semantics beyond descriptions.

Abstract

Knowledge graph completion (KGC) is a fundamental task for improving downstream applications like semantic search and question answering. Effective KGC requires integrating structural and description information, allowing them to complement each other’s weaknesses (e.g., long-tail issues or overlooked structural knowledge). Existing work typically integrates structural and description information at the embedding level by feeding structure embeddings into pre-trained language models (PLMs) and coupling them via attention mechanisms, which ensures the complementarity. However, as many KG entities are multi-semantic, exhibiting semantics beyond descriptions in certain triplets and making PLMs struggle to learn them, and current embedding level coupling approaches fail to transfer the entity multi-semantic knowledge learned from the structure model to PLM, the integration effect can be further improved. To alleviate above issue, we propose AKD-KGC , which aims at realizing this knowledge transfer then enhancing the integration effect by adding a teaching-learning procedure based on A daptive K nowledge D istillation during feature integration for KGC task in this work. The AKD-KGC framework integrates two features at the embedding level and use structural models to guide prediction behavior of integration model at the same time, adjusting the weight of PLM through additional supervision and enhancing its learning of entity additional semantics beyond descriptions. AKD-KGC can be applied to both transductive and inductive settings, and has achieved state-of-the-art results on a large number of datasets in both settings, demonstrating the effectiveness of our method. Our code and datasets are available at https://github.com/liqingsong1227/AKD-KGC .

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Li et al. (2026) studied this question.

synapsesocial.com/papers/69be35946e48c4981c673fd4https://doi.org/10.1371/journal.pone.0344363
Ask AI
Helpful
Bookmark
Share
View Full Paper