Deep Short Text Classification with Knowledge Powered Attention

Short text classification is one of important tasks in Natural Language Processing (NLP). Unlike paragraphs or documents, short texts are more ambiguous since they have not enough contextual information, which poses a great challenge for classification. In this paper, we retrieve knowledge from external knowledge source to enhance the semantic representation of short texts. We take conceptual information as a kind of knowledge and incorporate it into deep neural networks. For the purpose of measuring the importance of knowledge, we introduce attention mechanisms and propose deep Short Text Classification with Knowledge powered Attention (STCKA). We utilize Concept towards Short Text (C- ST) attention and Concept towards Concept Set (C-CS) attention to acquire the weight of concepts from two aspects. And we classify a short text with the help of conceptual information. Unlike traditional approaches, our model acts like a human being who has intrinsic ability to make decisions based on observation (i.e., training data for machines) and pays more attention to important knowledge. We also conduct extensive experiments on four public datasets for different tasks. The experimental results and case studies show that our model outperforms the state-of-the-art methods, justifying the effectiveness of knowledge powered attention

Integrated Application and Improvement of Selection Method of Storage Sales Industry

In recent years, in order to adapt to the rapid development of the warehouse-storage sales industry and to solve the problems of location cost and efficiency and optimization of the methods of the new retail store, we have integrated and innovated the barycenter method and grey correlation method, and analyzed the grey correlation method with the weight obtained by the comprehensive analysis. In order to achieve the optimal cost effect, we choose the optimal solution from several alternative address schemes. It is found that using the integrated method as the reference standard for the location calculation of Warehouse Logistics Enterprises under the new retail background is helpful to improve the accuracy rate, and reduce the defects and defects caused by the independent use of the various methods, and adapt to the more practical and concrete conditions of the location selection of warehouse storage enterprises. At the same time, it is also an innovative attempt to cross discrete and continuous boundaries

Always Strengthen Your Strengths: A Drift-Aware Incremental Learning Framework for CTR Prediction

Click-through rate (CTR) prediction is of great importance in recommendation systems and online advertising platforms. When served in industrial scenarios, the user-generated data observed by the CTR model typically arrives as a stream. Streaming data has the characteristic that the underlying distribution drifts over time and may recur. This can lead to catastrophic forgetting if the model simply adapts to new data distribution all the time. Also, it's inefficient to relearn distribution that has been occurred. Due to memory constraints and diversity of data distributions in large-scale industrial applications, conventional strategies for catastrophic forgetting such as replay, parameter isolation, and knowledge distillation are difficult to be deployed. In this work, we design a novel drift-aware incremental learning framework based on ensemble learning to address catastrophic forgetting in CTR prediction. With explicit error-based drift detection on streaming data, the framework further strengthens well-adapted ensembles and freezes ensembles that do not match the input distribution avoiding catastrophic interference. Both evaluations on offline experiments and A/B test shows that our method outperforms all baselines considered.Comment: This work has been accepted by SIGIR2

Filamin B Regulates Chondrocyte Proliferation and Differentiation through Cdk1 Signaling

Humans who harbor loss of function mutations in the actin-associated filamin B (FLNB) gene develop spondylocarpotarsal syndrome (SCT), a disorder characterized by dwarfism (delayed bone formation) and premature fusion of the vertebral, carpal and tarsal bones (premature differentiation). To better understand the cellular and molecular mechanisms governing these seemingly divergent processes, we generated and characterized FlnB knockdown ATDC5 cell lines. We found that FlnB knockdown led to reduced proliferation and enhanced differentiation in chondrocytes. Within the shortened growth plate of postnatal FlnB−/− mice long bone, we observed a similarly progressive decline in the number of rapidly proliferating chondrocytes and premature differentiation characterized by an enlarged prehypertrophic zone, a widened Col2a1+/Col10a1+ overlapping region, but relatively reduced hypertrophic zone length. The reduced chondrocyte proliferation and premature differentiation were, in part, attributable to enhanced G2/M phase progression, where fewer FlnB deficient ATDC5 chondrocytes resided in the G2/M phase of the cell cycle. FlnB loss reduced Cdk1 phosphorylation (an inhibitor of G2/M phase progression) and Cdk1 inhibition in chondrocytes mimicked the null FlnB, premature differentiation phenotype, through a β1-integrin receptor- Pi3k/Akt (a key regulator of chondrocyte differentiation) mediated pathway. In this context, the early prehypertrophic differentiation provides an explanation for the premature differentiation seen in this disorder, whereas the progressive decline in proliferating chondrocytes would ultimately lead to reduced chondrocyte production and shortened bone length. These findings begin to define a role for filamin proteins in directing both cell proliferation and differentiation through indirect regulation of cell cycle associated proteins

Convenient displacement monitoring technique using smartphone

In this paper, a displacement monitoring APP called D-Viewer is proposed and developed. By means of common laser device and projection plate, structural displacement can be monitored dynamically, using the APP. Firstly, the laser spot centroid recognition method was studied. Second, the displacement monitoring APP was developed. Finally, in order to verify the feasibility of the method, a series of static and dynamic experiments using smartphone were conducted. Results show that this method can be used as a convenient, fast, low-cost structural displacement monitoring method

Filamin a regulates neural progenitor proliferation and cortical size through Wee1-dependent Cdk1 phosphorylation

Cytoskeleton-associated proteins play key roles not only in regulating cell morphology and migration but also in proliferation. Mutations in the cytoskeleton-associated gene filamin A (FlnA) cause the human disorder periventricular heterotopia (PH). PH is a disorder of neural stem cell development that is characterized by disruption of progenitors along the ventricular epithelium and subsequent formation of ectopic neuronal nodules. FlnA-dependent regulation of cytoskeletal dynamics is thought to direct neural progenitor migration and proliferation. Here we show that embryonic FlnA null mice exhibited a reduction in brain size, and decline in neural progenitor numbers over time. The drop in the progenitor population was not attributable to cell death or changes in premature differentiation, but to prolonged cell cycle duration. Suppression of FlnA led to prolongation of the entire cell cycle length, principally in M-phase. FlnA loss impaired degradation of cyclin b1-related proteins, thereby delaying the onset and progression through mitosis. We found that the cdk1 kinase Wee1 bound FlnA, demonstrated increased expression levels after loss of FlnA function, and was associated with increased phosphorylation of cdk1. Phosphorylation of cdk1 inhibited activation of the anaphase promoting complex degradation system, which was responsible for cyclin b1 degradation and progression through mitosis. Collectively, our results demonstrate a molecular mechanism whereby FlnA loss impaired G2 to M phase entry, leading to cell cycle prolongation, compromised neural progenitor proliferation, and reduced brain size

Kinetic and modeling studies of the reaction of hydroxyl radicals with tetrachloroethylene

Article on kinetic and modeling studies of the reaction of hydroxyl radicals with tetrachloroethylene