Encoding Sequential Information in Semantic Space Models: Comparing Holographic Reduced Representation and Random Permutation

Circular convolution and random permutation have each been proposed as neurally plausible binding operators capable of encoding sequential information in semantic memory. We perform several controlled comparisons of circular convolution and random permutation as means of encoding paired associates as well as encoding sequential information. Random permutations outperformed convolution with respect to the number of paired associates that can be reliably stored in a single memory trace. Performance was equal on semantic tasks when using a small corpus, but random permutations were ultimately capable of achieving superior performance due to their higher scalability to large corpora. Finally, “noisy” permutations in which units are mapped to other units arbitrarily (no one-to-one mapping) perform nearly as well as true permutations. These findings increase the neurological plausibility of random permutations and highlight their utility in vector space models of semantics

The Emergence of Miller's Magic Number on a Sparse Distributed Memory

Human memory is limited in the number of items held in one's mind—a limit known as “Miller's magic number”. We study the emergence of such limits as a result of the statistics of large bitvectors used to represent items in memory, given two postulates: i) the Sparse Distributed Memory; and ii) chunking through averaging. Potential implications for theoretical neuroscience are discussed

Incremental dimension reduction of tensors with random index

We present an incremental, scalable and efficient dimension reduction technique for tensors that is based on sparse random linear coding. Data is stored in a compactified representation with fixed size, which makes memory requirements low and predictable. Component encoding and decoding are performed on-line without computationally expensive re-analysis of the data set. The range of tensor indices can be extended dynamically without modifying the component representation. This idea originates from a mathematical model of semantic memory and a method known as random indexing in natural language processing. We generalize the random-indexing algorithm to tensors and present signal-to-noise-ratio simulations for representations of vectors and matrices. We present also a mathematical analysis of the approximate orthogonality of high-dimensional ternary vectors, which is a property that underpins this and other similar random-coding approaches to dimension reduction. To further demonstrate the properties of random indexing we present results of a synonym identification task. The method presented here has some similarities with random projection and Tucker decomposition, but it performs well at high dimensionality only (n>10^3). Random indexing is useful for a range of complex practical problems, e.g., in natural language processing, data mining, pattern recognition, event detection, graph searching and search engines. Prototype software is provided. It supports encoding and decoding of tensors of order >= 1 in a unified framework, i.e., vectors, matrices and higher order tensors.Comment: 36 pages, 9 figure

Cognitively-inspired Agent-based Service Composition for Mobile & Pervasive Computing

Automatic service composition in mobile and pervasive computing faces many challenges due to the complex and highly dynamic nature of the environment. Common approaches consider service composition as a decision problem whose solution is usually addressed from optimization perspectives which are not feasible in practice due to the intractability of the problem, limited computational resources of smart devices, service host's mobility, and time constraints to tailor composition plans. Thus, our main contribution is the development of a cognitively-inspired agent-based service composition model focused on bounded rationality rather than optimality, which allows the system to compensate for limited resources by selectively filtering out continuous streams of data. Our approach exhibits features such as distributedness, modularity, emergent global functionality, and robustness, which endow it with capabilities to perform decentralized service composition by orchestrating manifold service providers and conflicting goals from multiple users. The evaluation of our approach shows promising results when compared against state-of-the-art service composition models.Comment: This paper will appear on AIMS'19 (International Conference on Artificial Intelligence and Mobile Services) on June 2

Encoding sequential information in semantic space models: comparing holographic reduced representation and random permutation.

Circular convolution and random permutation have each been proposed as neurally plausible binding operators capable of encoding sequential information in semantic memory. We perform several controlled comparisons of circular convolution and random permutation as means of encoding paired associates as well as encoding sequential information. Random permutations outperformed convolution with respect to the number of paired associates that can be reliably stored in a single memory trace. Performance was equal on semantic tasks when using a small corpus, but random permutations were ultimately capable of achieving superior performance due to their higher scalability to large corpora. Finally, "noisy" permutations in which units are mapped to other units arbitrarily (no one-to-one mapping) perform nearly as well as true permutations. These findings increase the neurological plausibility of random permutations and highlight their utility in vector space models of semantics.Peer Reviewe

Conditionally Replicating Adenovirus Expressing TIMP2 Increases Survival in a Mouse Model of Disseminated Ovarian Cancer

Ovarian cancer remains difficult to treat mainly due to presentation of the disease at an advanced stage. Conditionally-replicating adenoviruses (CRAds) are promising anti-cancer agents that selectively kill the tumor cells. The present study evaluated the efficacy of a novel CRAd (Ad5/3-CXCR4-TIMP2) containing the CXCR4 promoter for selective viral replication in cancer cells together with TIMP2 as a therapeutic transgene, targeting the matrix metalloproteases (MMPs) in a murine orthotopic model of disseminated ovarian cancer. An orthotopic model of ovarian cancer was established in athymic nude mice by intraperitonal injection of the human ovarian cancer cell line, SKOV3-Luc, expressing luciferase. Upon confirmation of peritoneal dissemination of the cells by non-invasive imaging, mice were randomly divided into four treatment groups: PBS, Ad-ΔE1-TIMP2, Ad5/3-CXCR4, and Ad5/3-CXCR4-TIMP2. All mice were imaged weekly to monitor tumor growth and were sacrificed upon reaching any of the predefined endpoints, including high tumor burden and significant weight loss along with clinical evidence of pain and distress. Survival analysis was performed using the Log-rank test. The median survival for the PBS cohort was 33 days; for Ad-ΔE1-TIMP2, 39 days; for Ad5/3-CXCR4, 52.5 days; and for Ad5/3-CXCR4-TIMP2, 63 days. The TIMP2-armed CRAd delayed tumor growth and significantly increased survival when compared to the unarmed CRAd. This therapeutic effect was confirmed to be mediated through inhibition of MMP9. Results of the in vivo study support the translational potential of Ad5/3-CXCR4-TIMP2 for treatment of human patients with advanced ovarian cancer

Eco-physiological responses of copepods and pteropods to ocean warming and acidification

We compare physiological responses of the crustacean copepod Calanus pacificus and pelagic pteropod mollusk Limacina helicina to ocean temperatures and pH by measuring biomarkers of oxidative stress, antioxidant defences, and the activity of the respiratory electron transport system in organisms collected on the 2016 West Coast Ocean Acidification cruise in the California Current System. Copepods and pteropods exhibited strong but divergent responses in the same habitat; copepods had higher oxygen-reactive absorbance capacity, glutathione-S-transferase, and total glutathione content. The ratio between reduced to oxidised glutathione was higher in copepods than in pteropods, indicating lower oxidative stress in copepods. Pteropods showed higher activities of glutathione reductase, catalase, and lipid peroxidation, indicating increased antioxidant defences and oxidative stress. Thus, the antioxidant defence system of the copepods has a greater capacity to respond to oxidative stress, while pteropods already face severe stress and show limited capacity to deal with further changes. The results suggest that copepods have higher adaptive potential, owing to their stronger vertical migration behaviour and efficient glutathione metabolism, whereas pteropods run the risk of oxidative stress and mortality under high CO2 conditions. Our results provide a unique dataset and evidence of stress-inducing mechanisms behind pteropod ocean acidification responses.</p

Transduction of Brain Dopamine Neurons by Adenoviral Vectors Is Modulated by CAR Expression: Rationale for Tropism Modified Vectors in PD Gene Therapy

Gene-based therapy is a new paradigm for the treatment of Parkinson disease (PD) and offers considerable promise for precise targeting and flexibility to impact multiple pathobiological processes for which small molecule agents are not available. Some success has been achieved utilizing adeno-associated virus for this approach, but it is likely that the characteristics of this vector system will ultimately create barriers to progress in clinical therapy. Adenovirus (Ad) vector overcomes limitations in payload size and targeting. The cellular tropism of Ad serotype 5 (Ad5)-based vectors is regulated by the Ad attachment protein binding to its primary cellular receptor, the coxsackie and adenovirus receptor (CAR). Many clinically relevant tissues are refractory to Ad5 infection due to negligible CAR levels but can be targeted by tropism-modified, CAR-independent forms of Ad. Our objective was to evaluate the role of CAR protein in transduction of dopamine (DA) neurons in vivo.Ad5 was delivered to the substantia nigra (SN) in wild type (wt) and CAR transgenic animals. Cellular tropism was assessed by immunohistochemistry (IHC) in the SN and striatal terminals. CAR expression was assessed by western blot and IHC. We found in wt animals, Ad5 results in robust transgene expression in astrocytes and other non-neuronal cells but poor infection of DA neurons. In contrast, in transgenic animals, Ad5 infects SNc neurons resulting in expression of transduced protein in their striatal terminals. Western blot showed low CAR expression in the ventral midbrain of wt animals compared to transgenic animals. Interestingly, hCAR protein localizes with markers of post-synaptic structures, suggesting synapses are the point of entry into dopaminergic neurons in transgenic animals.These findings demonstrate that CAR deficiency limits infection of wild type DA neurons by Ad5 and provide a rationale for the development of tropism-modified, CAR-independent Ad-vectors for use in gene therapy of human PD

Th1 type lymphocyte reactivity to metals in patients with total hip arthroplasty

<p>Abstract</p> <p>Background</p> <p>All prostheses with metallic components release metal debris that can potentially activate the immune system. However, implant-related metal hyper-reactivity has not been well characterized. In this study, we hypothesized that adaptive immunity reaction(s), particularly T-helper type 1 (Th1) responses, will be dominant in any metal-reactivity responses of patients with total joint replacements (TJAs). We tested this hypothesis by evaluating lymphocyte reactivity to metal "ions" in subjects with and without total hip replacements, using proliferation assays and cytokine analysis.</p> <p>Methods</p> <p>Lymphocytes from young healthy individuals without an implant or a history of metal allergy (Group 1: n = 8) were used to assess lymphocyte responses to metal challenge agents. In addition, individuals (Group 2: n = 15) with well functioning total hip arthroplasties (average Harris Hip Score = 91, average time in-situ 158 months) were studied. Age matched controls with no implants were also used for comparison (Group 3, n = 8, 4 male, 4 female average age 70, range 49–80). Group 1 subjects' lymphocyte proliferation response to Aluminum⁺³, Cobalt⁺², Chromium⁺³, Copper⁺², Iron⁺³, Molybdenum⁺⁵, Manganeese⁺², Nickel⁺², Vanadium⁺³and Sodium⁺²chloride solutions at a variety of concentrations (0.0, 0.05, 0.1, 0.5, 1.0 and 10.0 mM) was studied to establish toxicity thresholds. Mononuclear cells from Group 2 and 3 subjects were challenged with 0.1 mM CrCl₃, 0.1 mM NiCl₂, 0.1 mM CoCl₂and approx. 0.001 mM titanium and the reactions measured with proliferation assays and cytokine analysis to determine T-cell subtype prominence.</p> <p>Results</p> <p>Primary lymphocytes from patients with well functioning total hip replacements demonstrated a higher incidence and greater magnitude of reactivity to chromium than young healthy controls (p < 0.03). Of the 15 metal ion-challenged subjects with well functioning total hip arthroplasties, 7 demonstrated a proliferative response to Chromium, Nickel, Cobalt and/or Titanium (as defined by a statistically significant >2 fold stimulation index response, p < 0.05) and were designated as metal-reactive. Metals such as Cobalt, Copper, Manganese, and Vanadium were toxic at concentrations as low as 0.5 mM while other metals, such as Aluminum, Chromium, Iron, Molybdenum, and Nickel, became toxic at much higher concentrations (>10 mM). The differential secretion of signature T-cell subsets' cytokines (Th1 and Th2 lymphocytes releasing IFN-gamma and IL-4, respectively) between those total hip arthroplasty subjects which demonstrated metal-reactivity and those that did not, indicated a Th1 type (IFN-gamma) pro-inflammatory response.</p> <p>Conclusion</p> <p>Elevated proliferation and production of IFN-gamma to metals in hip arthroplasty subjects' lymphocytes indicates that a Th1 (vs. Th2) type response is likely associated with any metal induced reactivity. The involvement of an elevated and specific lymphocyte response suggests an <it>adaptive </it>(macrophage recruiting) immunity response to metallic implant debris rather than an <it>innate </it>(nonspecific) immune response.</p