A Cognitive Architecture Based on a Learning Classifier System with Spiking Classifiers

© 2015, Springer Science+Business Media New York. Learning classifier systems (LCS) are population-based reinforcement learners that were originally designed to model various cognitive phenomena. This paper presents an explicitly cognitive LCS by using spiking neural networks as classifiers, providing each classifier with a measure of temporal dynamism. We employ a constructivist model of growth of both neurons and synaptic connections, which permits a genetic algorithm to automatically evolve sufficiently-complex neural structures. The spiking classifiers are coupled with a temporally-sensitive reinforcement learning algorithm, which allows the system to perform temporal state decomposition by appropriately rewarding “macro-actions”, created by chaining together multiple atomic actions. The combination of temporal reinforcement learning and neural information processing is shown to outperform benchmark neural classifier systems, and successfully solve a robotic navigation task

The diversity of reproductive parasites among arthropods: Wolbachia do not walk alone

<p>Abstract</p> <p>Background</p> <p>Inherited bacteria have come to be recognised as important components of arthropod biology. In addition to mutualistic symbioses, a range of other inherited bacteria are known to act either as reproductive parasites or as secondary symbionts. Whilst the incidence of the α-proteobacterium <it>Wolbachia </it>is relatively well established, the current knowledge of other inherited bacteria is much weaker. Here, we tested 136 arthropod species for a range of inherited bacteria known to demonstrate reproductive parasitism, sampling each species more intensively than in past surveys.</p> <p>Results</p> <p>The inclusion of inherited bacteria other than <it>Wolbachia </it>increased the number of infections recorded in our sample from 33 to 57, and the proportion of species infected from 22.8% to 32.4%. Thus, whilst <it>Wolbachia </it>remained the dominant inherited bacterium, it alone was responsible for around half of all inherited infections of the bacteria sampled, with members of the <it>Cardinium</it>, <it>Arsenophonus </it>and <it>Spiroplasma ixodetis </it>clades each occurring in 4% to 7% of all species. The observation that infection was sometimes rare within host populations, and that there was variation in presence of symbionts between populations indicates that our survey will itself underscore incidence.</p> <p>Conclusion</p> <p>This extensive survey demonstrates that at least a third of arthropod species are infected by a diverse assemblage of maternally inherited bacteria that are likely to strongly influence their hosts' biology, and indicates an urgent need to establish the nature of the interaction between non-<it>Wolbachia </it>bacteria and their hosts.</p

Comparisons of host mitochondrial, nuclear and endosymbiont bacterial genes reveal cryptic fig wasp species and the effects of Wolbachia on host mtDNA evolution and diversity

Background Figs and fig-pollinating wasp species usually display a highly specific one-to-one association. However, more and more studies have revealed that the "one-to-one" rule has been broken. Co-pollinators have been reported, but we do not yet know how they evolve. They may evolve from insect speciation induced or facilitated by Wolbachia which can manipulate host reproduction and induce reproductive isolation. In addition, Wolbachia can affect host mitochondrial DNA evolution, because of the linkage between Wolbachia and associated mitochondrial haplotypes, and thus confound host phylogeny based on mtDNA. Previous research has shown that fig wasps have the highest incidence of Wolbachia infection in all insect taxa, and Wolbachia may have great influence on fig wasp biology. Therefore, we look forward to understanding the influence of Wolbachia on mitochondrial DNA evolution and speciation in fig wasps. Results We surveyed 76 pollinator wasp specimens from nine Ficus microcarpa trees each growing at a different location in Hainan and Fujian Provinces, China. We found that all wasps were morphologically identified as Eupristina verticillata, but diverged into three clades with 4.22-5.28% mtDNA divergence and 2.29-20.72% nuclear gene divergence. We also found very strong concordance between E. verticillata clades and Wolbachia infection status, and the predicted effects of Wolbachia on both mtDNA diversity and evolution by decreasing mitochondrial haplotypes. Conclusions Our study reveals that the pollinating wasp E. verticillata on F. microcarpa has diverged into three cryptic species, and Wolbachia may have a role in this divergence. The results also indicate that Wolbachia strains infecting E. verticillata have likely resulted in selective sweeps on host mitochondrial DNA

Intergenomic Arms Races: Detection of a Nuclear Rescue Gene of Male-Killing in a Ladybird

Many species of arthropod are infected by deleterious inherited micro-organisms. Typically these micro-organisms are inherited maternally. Consequently, some, particularly bacteria of the genus Wolbachia, employ a variety of strategies that favour female over male hosts. These strategies include feminisation, induction of parthenogenesis and male-killing. These strategies result in female biased sex ratios in host populations, which lead to selection for host factors that promote male production. In addition, the intra-genomic conflict produced by the difference in transmission of these cytoplasmic endosymbionts and nuclear factors will impose a pressure favouring nuclear factors that suppress the effects of the symbiont. During investigations of the diversity of male-killing bacteria in ladybirds (Coccinellidae), unexpected patterns of vertical transmission of a newly discovered male-killing taxon were observed in the ladybird Cheilomenes sexmaculata. Initial analysis suggested that the expression of the bacterial male-killing trait varies according to the male(s) a female has mated with. By swapping males between females, a male influence on the expression of the male-killing trait was confirmed. Experiments were then performed to determine the nature of the interaction. These studies showed that a single dominant allele, which rescues male progeny of infected females from the pathological effect of the male-killer, exists in this species. The gene shows typical Mendelian autosomal inheritance and is expressed irrespective of the parent from which it is inherited. Presence of the rescue gene in either parent does not significantly affect the inheritance of the symbiont. We conclude that C. sexmaculata is host to a male-killing γ-proteobacterium. Further, this beetle is polymorphic for a nuclear gene, the dominant allele of which rescues infected males from the pathogenic effects of the male-killing agent. These findings represent the first reported case of a nuclear suppressor of male-killing in a ladybird. They are considered in regard to sex ratio and intra-genomic conflict theories, and models of the evolutionary dynamics and distribution of inherited symbionts

Melarsoprol cyclodextrin inclusion complexes as promising oral candidates for the treatment of human African trypanosomiasis

Human African trypanosomiasis (HAT), or sleeping sickness, results from infection with the protozoan parasites &lt;i&gt;Trypanosoma brucei&lt;/i&gt; (&lt;i&gt;T.b.&lt;/i&gt;) &lt;i&gt;gambiense&lt;/i&gt; or &lt;i&gt;T.b.rhodesiense&lt;/i&gt; and is invariably fatal if untreated. There are 60 million people at risk from the disease throughout sub-Saharan Africa. The infection progresses from the haemolymphatic stage where parasites invade the blood, lymphatics and peripheral organs, to the late encephalitic stage where they enter the central nervous system (CNS) to cause serious neurological disease. The trivalent arsenical drug melarsoprol (Arsobal) is the only currently available treatment for CNS-stage &lt;i&gt;T.b.rhodesiense&lt;/i&gt; infection. However, it must be administered intravenously due to the presence of propylene glycol solvent and is associated with numerous adverse reactions. A severe post-treatment reactive encephalopathy occurs in about 10% of treated patients, half of whom die. Thus melarsoprol kills 5% of all patients receiving it. Cyclodextrins have been used to improve the solubility and reduce the toxicity of a wide variety of drugs. We therefore investigated two melarsoprol cyclodextrin inclusion complexes; melarsoprol hydroxypropyl-&#846;-cyclodextrin and melarsoprol randomly-methylated-&#946;-cyclodextrin. We found that these compounds retain trypanocidal properties &lt;i&gt;in vitro&lt;/i&gt; and cure CNS-stage murine infections when delivered orally, once per day for 7-days, at a dosage of 0.05 mmol/kg. No overt signs of toxicity were detected. Parasite load within the brain was rapidly reduced following treatment onset and magnetic resonance imaging showed restoration of normal blood-brain barrier integrity on completion of chemotherapy. These findings strongly suggest that complexed melarsoprol could be employed as an oral treatment for CNS-stage HAT, delivering considerable improvements over current parenteral chemotherapy

Bidirectional incompatibility among divergent Wolbachia and incompatibility level differences among closely related Wolbachia in Nasonia

Author Posting. © The Author(s), 2007. This is the author's version of the work. It is posted here by permission of Nature Publishing Group for personal use, not for redistribution. The definitive version was published in Heredity 99 (2007): 278–287, doi:10.1038/sj.hdy.6800994.Most insect groups harbor obligate bacterial symbionts from the alphaproteobacterial genus Wolbachia. These bacteria alter insect reproduction in ways that enhance their cytoplasmic transmission. One of the most common alterations is cytoplasmic incompatibility (CI) - a post-fertilization modification of the paternal genome that renders embryos inviable or unable to complete diploid development in crosses between infected males and uninfected females or infected females harboring a different strain. The parasitic wasp species complex Nasonia (N. vitripennis, N. longicornis, and N. giraulti) harbor at least six different Wolbachia that cause cytoplasmic incompatibility. Each species have double infections with a representative from both the A and B Wolbachia subgroups. CI relationships of the A and B Wolbachia of N. longicornis with those of N. giraulti and N. vitripennis are investigated here. We demonstrate that all pairwise crosses between the divergent A strains are bidirectionally incompatible. We were unable to characterize incompatibility between the B Wolbachia, but we establish that the B strain of N. longicornis induces no or very weak CI in comparison to the closely related B strain in N. giraulti that expresses complete CI. Taken together with previous studies, we show that independent acquisition of divergent A Wolbachia has resulted in three mutually incompatible strains, while codivergence of B Wolbachia in N. longicornis and N. giraulti is associated with differences in CI level. Understanding the diversity and evolution of new incompatibility strains will contribute to a fuller understanding of Wolbachia invasion dynamics and Wolbachia-assisted speciation in certain groups of insects.This work was supported by grant EF-0328363 and DEB-9981634 from the National Science Foundation to J.H.W. and an Ernst Caspari Research Fellowship to S.R.B while he was at the University of Rochester. S.R.B. acknowledges support from the NASA Astrobiology Institute (NNA04CC04A)

Pharmacological levels of withaferin A (Withania somnifera) trigger clinically relevant anticancer effects specific to triple negative breast cancer cells

Withaferin A (WA) isolated from Withania somnifera (Ashwagandha) has recently become an attractive phytochemical under investigation in various preclinical studies for treatment of different cancer types. In the present study, a comparative pathway-based transcriptome analysis was applied in epithelial-like MCF-7 and triple negative mesenchymal MDA-MB-231 breast cancer cells exposed to different concentrations of WA which can be detected systemically in in vivo experiments. Whereas WA treatment demonstrated attenuation of multiple cancer hallmarks, the withanolide analogue Withanone (WN) did not exert any of the described effects at comparable concentrations. Pathway enrichment analysis revealed that WA targets specific cancer processes related to cell death, cell cycle and proliferation, which could be functionally validated by flow cytometry and real-time cell proliferation assays. WA also strongly decreased MDA-MB-231 invasion as determined by single-cell collagen invasion assay. This was further supported by decreased gene expression of extracellular matrix-degrading proteases (uPA, PLAT, ADAM8), cell adhesion molecules (integrins, laminins), pro-inflammatory mediators of the metastasis-promoting tumor microenvironment (TNFSF12, IL6, ANGPTL2, CSF1R) and concomitant increased expression of the validated breast cancer metastasis suppressor gene (BRMS1). In line with the transcriptional changes, nanomolar concentrations of WA significantly decreased protein levels and corresponding activity of uPA in MDA-MB-231 cell supernatant, further supporting its anti-metastatic properties. Finally, hierarchical clustering analysis of 84 chromatin writer-reader-eraser enzymes revealed that WA treatment of invasive mesenchymal MDA-MB-231 cells reprogrammed their transcription levels more similarly towards the pattern observed in non-invasive MCF-7 cells. In conclusion, taking into account that sub-cytotoxic concentrations of WA target multiple metastatic effectors in therapy-resistant triple negative breast cancer, WA-based therapeutic strategies targeting the uPA pathway hold promise for further (pre)clinical development to defeat aggressive metastatic breast cancer

Temperature Affects the Tripartite Interactions between Bacteriophage WO, Wolbachia, and Cytoplasmic Incompatibility

Wolbachia infections are a model for understanding intracellular, bacterial symbioses. While the symbiosis is often studied from a binary perspective of host and bacteria, it is increasingly apparent that additional trophic levels can influence the symbiosis. For example, Wolbachia in arthropods harbor a widespread temperate bacteriophage, termed WO, that forms virions and rampantly transfers between coinfections. Here we test the hypothesis that temperatures at the extreme edges of an insect's habitable range alter bacteriophage WO inducibility and in turn, Wolbachia densities and the penetrance of cytoplasmic incompatibility. We report four key findings using the model wasp, Nasonia vitripennis: First, both cold treatment at 18 C and heat treatment at 30 C reduce Wolbachia densities by as much as 74% relative to wasps reared at 25 C. Second, in all cases where Wolbachia densities decline due to temperature changes, phage WO densities increase and inversely associate with Wolbachia densities. Heat has a marked effect on phage WO, yielding phage densities that are 552% higher than the room temperature control. Third, there is a significant affect of insect family on phage WO and endoysmbiont densities. Fourth, at extreme temperatures, there was a temperature-mediated adjustment to the density threshold at which Wolbachia cause complete cytoplasmic incompatibility. Taken together, these results demonstrate that temperature simultaneously affects phage WO densities, endosymbiont densities, and the penetrance of cytoplasmic incompatibility. While temperature shock enhances bacteriophage inducibility and the ensuing bacterial mortality in a wide range of medically and industrially-important bacteria, this is the first investigation of the associations in an obligate intracellular bacteria. Implications to a SOS global sensing feedback mechanism in Wolbachia are discussed

Life and Death of an Influential Passenger: Wolbachia and the Evolution of CI-Modifiers by Their Hosts

Wolbachia are intracellular bacteria widely distributed among arthropods and nematodes. In many insect species these bacteria induce a cytoplasmic incompatibility (CI) between sperm of infected males and eggs of uninfected females. From an evolutionary point of view, CI is puzzling: In order to induce this modification-rescue system, Wolbachia affect sperm of infected males even though Wolbachia are only transmitted maternally. Phylogenetic studies of Wolbachia and hosts show that the bacteria rarely cospeciate with their hosts, indicating that infections are lost in host species. However, the mechanisms leading to Wolbachia loss are not well understood.Using a population genetic model, we investigate the spread of host mutants that enhance or repress Wolbachia action by affecting either bacterial transmission or the level of CI. We show that host mutants that decrease CI-levels in males (e.g. by reducing Wolbachia-density during spermatogenesis) spread, even at cost to mutant males. Increase of these mutants can lead to loss of Wolbachia infections, either as a direct consequence of their increase or in a step-wise manner, and we derive analytically a threshold penetrance above which a mutation's spread leads to extinction of Wolbachia. Selection on host modifiers is sexually antagonistic in that, conversely, host mutants that enhance Wolbachia in females are favoured whereas suppressors are not.Our results indicate that Wolbachia is likely to be lost from host populations on long evolutionary time scales due to reduction of CI levels in males. This can occur either by evolution of single host modifiers with large effects or through accumulation of several modifier alleles with small effects on Wolbachia action, even at cost to mutant males and even if infected hosts do not incur fecundity costs. This possibility is consistent with recent findings and may help to explain the apparent short evolutionary persistence times of Wolbachia in many host systems

A hypothetico-deductive approach to assessing the social function of chemical signalling in a non-territorial solitary carnivore

The function of chemical signalling in non-territorial solitary carnivores is still relatively unclear. Studies on territorial solitary and social carnivores have highlighted odour capability and utility, however the social function of chemical signalling in wild carnivore populations operating dominance hierarchy social systems has received little attention. We monitored scent marking and investigatory behaviour of wild brown bears Ursus arctos, to test multiple hypotheses relating to the social function of chemical signalling. Camera traps were stationed facing bear ‘marking trees’ to document behaviour by different age sex classes in different seasons. We found evidence to support the hypothesis that adult males utilise chemical signalling to communicate dominance to other males throughout the non-denning period. Adult females did not appear to utilise marking trees to advertise oestrous state during the breeding season. The function of marking by subadult bears is somewhat unclear, but may be related to the behaviour of adult males. Subadults investigated trees more often than they scent marked during the breeding season, which could be a result of an increased risk from adult males. Females with young showed an increase in marking and investigation of trees outside of the breeding season. We propose the hypothesis that females engage their dependent young with marking trees from a young age, at a relatively ‘safe’ time of year. Memory, experience, and learning at a young age, may all contribute towards odour capabilities in adult bears