This is the authors' abstract. We don't add key points for this paper.
Sentence representation is a typical problem in NLP, which is to use a fine vector to encode the sentence, so that the sentence can contain copious semantic. A high-quality sentence representation benefits a wide range of NLP tasks. Although BERT-based pretrained model performs well on many downstream tasks, it’s sentence representation acts poorly on semantic textual similarity (STS) task. In this article, we propose ConBG, a Contrastive Learning Method for Chinese Sentence Representation Based on Bert and GCN, which is to encode the sentence by a model combined with Bert and Graph Convolutional Network which is to incorporate syntactic information. Then we use data augmentation strategies to create samples, and adopt contrastive learning technique to train the model in a unsupervised way. Experiments on Chinese STS datasets demonstrate that ConBG exceeds previous work of over 1% on average.
Answers are grounded in this paper and cite their sources.
No takes yet. Share an insight, caveat, or question.
Junjie Niu (2023) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: