The Short Text Matching Model Enhanced with Knowledge via Contrastive Learning

In recent years, short Text Matching tasks have been widely applied in the fields ofadvertising search and recommendation. The difficulty lies in the lack of semantic information and word ambiguity caused by the short length of the text. Previous works have introduced complement sentences or knowledge bases to provide additional feature information. However, these methods have not fully interacted between the original sentence and the complement sentence, and have not considered the noise issue that may arise from the introduction of external knowledge bases. Therefore, this paper proposes a short Text Matching model that combines contrastive learning and external knowledge. The model uses a generative model to generate corresponding complement sentences and uses the contrastive learning method to guide the model to obtain more semantically meaningful encoding of the original sentence. In addition, to avoid noise, we use keywords as the main semantics of the original sentence to retrieve corresponding knowledge words in the knowledge base, and construct a knowledge graph. The graph encoding model is used to integrate the knowledge base information into the model. Our designed model achieves state-of-the-art performance on two publicly available Chinese Text Matching datasets, demonstrating the effectiveness of our model.Comment: 11 pages,2 figure

Dual Delivery of bFGF- and NGF-Binding Coacervate Confers Neuroprotection by Promoting Neuronal Proliferation

Background/Aims: Basic fibroblast growth factor (bFGF) and nerve growth factor (NGF) are essential for proper development, survival, growth, and maintenance of neurons in the central and peripheral nervous systems. However, because bFGF and NGF have short half-life and rapid diffusion rate, they have limited clinical efficacy. Thus, there is an urgent need to develop an effective delivery system to protect bFGF and NGF from proteolysis while maintaining their normal bioactivities. Methods: To more efficiently deliver bFGF and NGF, we used a coacervate (synthesized with heparin and a biodegradable polycation at mass ratio of 500: 100). The maximal package loads of GFs in coacervate were determined by Western Blotting; release efficiency of bFGF and NGF was measured by ELISA. Additionally, we evaluated the effect of bFGF and NGF on the viability, survival, and proliferation of neurons by MTT assay, BrdU cell proliferation, and calcein staining. Results: Our coacervate incorporated bFGF and NGF and continuously released them for at least three weeks. This enhanced the growth and proliferation of PC12 cells and SH-SY5Y cells. Moreover, co-delivery of bFGF and NGF using coacervate was more neuroprotective than free application of both factors or coacervate delivery of each GF separately. Conclusions: Dual delivery of bFGF and NGF binding coacervate was neuroprotective via stimulating the growth and proliferation of neurons