Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks

Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong results on a variety of sequence modeling tasks. The only underlying LSTM structure that has been explored so far is a linear chain. However, natural language exhibits syntactic properties that would naturally combine words to phrases. We introduce the Tree-LSTM, a generalization of LSTMs to tree-structured network topologies. Tree-LSTMs outperform all existing systems and strong LSTM baselines on two tasks: predicting the semantic relatedness of two sentences (SemEval 2014, Task 1) and sentiment classification (Stanford Sentiment Treebank).Comment: Accepted for publication at ACL 201

Learning New Facts From Knowledge Bases With Neural Tensor Networks and Semantic Word Vectors

Knowledge bases provide applications with the benefit of easily accessible, systematic relational knowledge but often suffer in practice from their incompleteness and lack of knowledge of new entities and relations. Much work has focused on building or extending them by finding patterns in large unannotated text corpora. In contrast, here we mainly aim to complete a knowledge base by predicting additional true relationships between entities, based on generalizations that can be discerned in the given knowledgebase. We introduce a neural tensor network (NTN) model which predicts new relationship entries that can be added to the database. This model can be improved by initializing entity representations with word vectors learned in an unsupervised fashion from text, and when doing this, existing relations can even be queried for entities that were not present in the database. Our model generalizes and outperforms existing models for this problem, and can classify unseen relationships in WordNet with an accuracy of 75.8%

Distributed computing system with dual independent communications paths between computers and employing split tokens

This is a distributed computing system providing flexible fault tolerance; ease of software design and concurrency specification; and dynamic balance of the loads. The system comprises a plurality of computers each having a first input/output interface and a second input/output interface for interfacing to communications networks each second input/output interface including a bypass for bypassing the associated computer. A global communications network interconnects the first input/output interfaces for providing each computer the ability to broadcast messages simultaneously to the remainder of the computers. A meshwork communications network interconnects the second input/output interfaces providing each computer with the ability to establish a communications link with another of the computers bypassing the remainder of computers. Each computer is controlled by a resident copy of a common operating system. Communications between respective ones of computers is by means of split tokens each having a moving first portion which is sent from computer to computer and a resident second portion which is disposed in the memory of at least one of computer and wherein the location of the second portion is part of the first portion. The split tokens represent both functions to be executed by the computers and data to be employed in the execution of the functions. The first input/output interfaces each include logic for detecting a collision between messages and for terminating the broadcasting of a message whereby collisions between messages are detected and avoided

Mechanical excitation and marginal triggering during avalanches in sheared amorphous solids

We study plastic strain during individual avalanches in overdamped particle-scale molecular dynamics (MD) and mesoscale elastoplastic models (EPM) for amorphous solids sheared in the athermal quasistatic limit. We show that the spatial correlations in plastic activity exhibit a short length scale that grows as t3/4 in MD and ballistically in EPM, which is generated by mechanical excitation of nearby sites not necessarily close to their stability thresholds, and a longer lengthscale that grows diffusively for both models and is associated with remote marginally stable sites. These similarities in spatial correlations explain why simple EPMs accurately capture the size distribution of avalanches observed in MD, though the temporal profiles and dynamical critical exponents are quite different

Fv antibodies to aflatoxin B1 derived from a pre-immunized antibody phage display library system

The production and characterization of recombinant antibodies to aflatoxin B[SUB1] (AFB[SUB1]), a potent mycotoxin and carcinogen is described. The antibody fragments produced were then applied for use in a surface plasmon resonance-based biosensor (BIAcore), which measures biomolecular interactions in 'real-time'. Single chain Fv (scFv) antibodies were generated to aflatoxin B1 from an established phage display system, which incorporated a range of different plasmids for efficient scFv expression. The scFv's were used in the development of a competitive ELISA, and also for the development of surface plasmon resonance (SPR)-based inhibition immunoassays. They were found to be suitable for the detection of AFB[SUB1], in this format, with the assays being sensitive and reproducible

MDN brain descending neurons coordinately activate backward and inhibit forward locomotion.

Command-like descending neurons can induce many behaviors, such as backward locomotion, escape, feeding, courtship, egg-laying, or grooming (we define 'command-like neuron' as a neuron whose activation elicits or 'commands' a specific behavior). In most animals, it remains unknown how neural circuits switch between antagonistic behaviors: via top-down activation/inhibition of antagonistic circuits or via reciprocal inhibition between antagonistic circuits. Here, we use genetic screens, intersectional genetics, circuit reconstruction by electron microscopy, and functional optogenetics to identify a bilateral pair of Drosophila larval 'mooncrawler descending neurons' (MDNs) with command-like ability to coordinately induce backward locomotion and block forward locomotion; the former by stimulating a backward-active premotor neuron, and the latter by disynaptic inhibition of a forward-specific premotor neuron. In contrast, direct monosynaptic reciprocal inhibition between forward and backward circuits was not observed. Thus, MDNs coordinate a transition between antagonistic larval locomotor behaviors. Interestingly, larval MDNs persist into adulthood, where they can trigger backward walking. Thus, MDNs induce backward locomotion in both limbless and limbed animals