Deep Neural Networks - A Brief History

Introduction to deep neural networks and their history.Comment: 14 pages, 14 figure

Sampled Weighted Min-Hashing for Large-Scale Topic Mining

We present Sampled Weighted Min-Hashing (SWMH), a randomized approach to automatically mine topics from large-scale corpora. SWMH generates multiple random partitions of the corpus vocabulary based on term co-occurrence and agglomerates highly overlapping inter-partition cells to produce the mined topics. While other approaches define a topic as a probabilistic distribution over a vocabulary, SWMH topics are ordered subsets of such vocabulary. Interestingly, the topics mined by SWMH underlie themes from the corpus at different levels of granularity. We extensively evaluate the meaningfulness of the mined topics both qualitatively and quantitatively on the NIPS (1.7 K documents), 20 Newsgroups (20 K), Reuters (800 K) and Wikipedia (4 M) corpora. Additionally, we compare the quality of SWMH with Online LDA topics for document representation in classification.Comment: 10 pages, Proceedings of the Mexican Conference on Pattern Recognition 201

Basic tasks of sentiment analysis

Subjectivity detection is the task of identifying objective and subjective sentences. Objective sentences are those which do not exhibit any sentiment. So, it is desired for a sentiment analysis engine to find and separate the objective sentences for further analysis, e.g., polarity detection. In subjective sentences, opinions can often be expressed on one or multiple topics. Aspect extraction is a subtask of sentiment analysis that consists in identifying opinion targets in opinionated text, i.e., in detecting the specific aspects of a product or service the opinion holder is either praising or complaining about

Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

Evolutionary connectionism: algorithmic principles underlying the evolution of biological organisation in evo-devo, evo-eco and evolutionary transitions

The mechanisms of variation, selection and inheritance, on which evolution by natural selection depends, are not fixed over evolutionary time. Current evolutionary biology is increasingly focussed on understanding how the evolution of developmental organisations modifies the distribution of phenotypic variation, the evolution of ecological relationships modifies the selective environment, and the evolution of reproductive relationships modifies the heritability of the evolutionary unit. The major transitions in evolution, in particular, involve radical changes in developmental, ecological and reproductive organisations that instantiate variation, selection and inheritance at a higher level of biological organisation. However, current evolutionary theory is poorly equipped to describe how these organisations change over evolutionary time and especially how that results in adaptive complexes at successive scales of organisation (the key problem is that evolution is self-referential, i.e. the products of evolution change the parameters of the evolutionary process). Here we first reinterpret the central open questions in these domains from a perspective that emphasises the common underlying themes. We then synthesise the findings from a developing body of work that is building a new theoretical approach to these questions by converting well-understood theory and results from models of cognitive learning. Specifically, connectionist models of memory and learning demonstrate how simple incremental mechanisms, adjusting the relationships between individually-simple components, can produce organisations that exhibit complex system-level behaviours and improve the adaptive capabilities of the system. We use the term “evolutionary connectionism” to recognise that, by functionally equivalent processes, natural selection acting on the relationships within and between evolutionary entities can result in organisations that produce complex system-level behaviours in evolutionary systems and modify the adaptive capabilities of natural selection over time. We review the evidence supporting the functional equivalences between the domains of learning and of evolution, and discuss the potential for this to resolve conceptual problems in our understanding of the evolution of developmental, ecological and reproductive organisations and, in particular, the major evolutionary transitions

Transthoracic echocardiography reference values in juvenile and adult 129/Sv mice

Background In the recent years, the use of Doppler-echocardiography has become a standard non-invasive technique in the analysis of cardiac malformations in genetically modified mice. Therefore, normal values have to be established for the most commonly used inbred strains in whose genetic background those mutations are generated. Here we provide reference values for transthoracic echocardiography measurements in juvenile (3 weeks) and adult (8 weeks) 129/Sv mice. Methods Echocardiographic measurements were performed using B-mode, M-mode and Doppler-mode in 15 juvenile (3 weeks) and 15 adult (8 weeks) mice, during isoflurane anesthesia. M-mode measurements variability of left ventricle (LV) was determined. Results Several echocardiographic measurements significantly differ between juvenile and adult mice. Most of these measurements are related with cardiac dimensions. All B-mode measurements were different between juveniles and adults (higher in the adults), except for fractional area change (FAC). Ejection fraction (EF) and fractional shortening (FS), calculated from M-mode parameters, do not differ between juvenile and adult mice. Stroke volume (SV) and cardiac output (CO) were significantly different between juvenile and adult mice. SV was 31.93 ± 8.67 μl in juveniles vs 70.61 ± 24.66 μl in adults, ρ < 0.001. CO was 12.06 ± 4.05 ml/min in juveniles vs 29.71 ± 10.13 ml/min in adults, ρ < 0.001. No difference was found in mitral valve (MV) and tricuspid valve (TV) related parameters between juvenile and adult mice. It was demonstrated that variability of M-mode measurements of LV is minimal. Conclusions This study suggests that differences in cardiac dimensions, as wells as in pulmonary and aorta outflow parameters, were found between juvenile and adult mice. However, mitral and tricuspid inflow parameters seem to be similar between 3 weeks and 8 weeks mice. The reference values established in this study would contribute as a basis to future studies in post-natal cardiovascular development and diagnosing cardiovascular disorders in genetically modified mouse mutant lines.Peer Reviewe

Functional similarities between pigeon \u27milk\u27 and mammalian milk : induction of immune gene expression and modification of the microbiota

Pigeon &lsquo;milk&rsquo; and mammalian milk have functional similarities in terms of nutritional benefit and delivery of immunoglobulins to the young. Mammalian milk has been clearly shown to aid in the development of the immune system and microbiota of the young, but similar effects have not yet been attributed to pigeon &lsquo;milk&rsquo;. Therefore, using a chicken model, we investigated the effect of pigeon &lsquo;milk&rsquo; on immune gene expression in the Gut Associated Lymphoid Tissue (GALT) and on the composition of the caecal microbiota. Chickens fed pigeon &lsquo;milk&rsquo; had a faster rate of growth and a better feed conversion ratio than control chickens. There was significantly enhanced expression of immune-related gene pathways and interferon-stimulated genes in the GALT of pigeon &lsquo;milk&rsquo;-fed chickens. These pathways include the innate immune response, regulation of cytokine production and regulation of B cell activation and proliferation. The caecal microbiota of pigeon &lsquo;milk&rsquo;-fed chickens was significantly more diverse than control chickens, and appears to be affected by prebiotics in pigeon &lsquo;milk&rsquo;, as well as being directly seeded by bacteria present in pigeon &lsquo;milk&rsquo;. Our results demonstrate that pigeon &lsquo;milk&rsquo; has further modes of action which make it functionally similar to mammalian milk. We hypothesise that pigeon &lsquo;lactation&rsquo; and mammalian lactation evolved independently but resulted in similarly functional products

Cycles of Police Reform in Latin America.

yesOver the last quarter century post-conflict and post-authoritarian transitions in Latin America have been accompanied by a surge in social violence, acquisitive crime, and insecurity. These phenomena have been driven by an expanding international narcotics trade, by the long-term effects of civil war and counter-insurgency (resulting in, inter alia, an increased availability of small arms and a pervasive grammar of violence), and by structural stresses on society (unemployment, hyper-inflation, widening income inequality). Local police forces proved to be generally ineffective in preventing, resolving, or detecting such crime and forms of “new violence”3 due to corruption, frequent complicity in criminal networks, poor training and low pay, and the routine use of excessive force without due sanction. Why, then, have governments been slow to prioritize police reform and why have reform efforts borne largely “limited or nonexistent” long-term results? This chapter highlights a number of lessons suggested by various efforts to reform the police in Latin America over the period 1995-2010 . It focuses on two clusters of countries in Latin America. One is Brazil and the Southern Cone countries (Chile, Argentina, and Uruguay), which made the transition to democracy from prolonged military authoritarian rule in the mid- to late 1980s. The other is Central America and the Andean region (principally El Salvador, Guatemala, Honduras, Peru, and Colombia), which emerged/have been emerging from armed conflict since the mid- 1990s. The chapter examines first the long history of international involvement in police and security sector reform in order to identify long-run tropes and path dependencies. It then focuses on a number of recurring themes: cycles of de- and re-militarization of the policing function; the “security gap” and “democratization dilemmas” involved in structural reforms; the opportunities offered by decentralization for more community-oriented police; and police capacity to resist reform and undermine accountability mechanisms

Cerebral activations during viewing of food stimuli in adult patients with acquired structural hypothalamic damage: A functional neuroimaging study

BACKGROUND/OBJECTIVES: Obesity is common following hypothalamic damage due to tumours. Homeostatic and non-homeostatic brain centres control appetite and energy balance but their interaction in the presence of hypothalamic damage remains unknown. We hypothesized that abnormal appetite in obese patients with hypothalamic damage results from aberrant brain processing of food stimuli. We sought to establish differences in activation of brain food motivation and reward neurocircuitry in patients with hypothalamic obesity (HO) compared with patients with hypothalamic damage whose weight had remained stable. SUBJECTS/METHODS: In a cross-sectional study at a University Clinical Research Centre, we studied 9 patients with HO, 10 age-matched obese controls, 7 patients who remained weight-stable following hypothalamic insult (HWS) and 10 non-obese controls. Functional magnetic resonance imaging was performed in the fasted state, 1 h and 3 h after a test meal, while subjects were presented with images of high-calorie foods, low-calorie foods and non-food objects. Insulin, glucagon-like peptide-1, Peptide YY and ghrelin were measured throughout the experiment, and appetite ratings were recorded. RESULTS: Mean neural activation in the posterior insula and lingual gyrus (brain areas linked to food motivation and reward value of food) in HWS were significantly lower than in the other three groups (P=0.001). A significant negative correlation was found between insulin levels and posterior insula activation (P=0.002). CONCLUSIONS: Neural pathways associated with food motivation and reward-related behaviour, and the influence of insulin on their activation may be involved in the pathophysiology of HO.International Journal of Obesity advance online publicatio

Adrenaline modulates the global transcriptional profile of Salmonella revealing a role in the antimicrobial peptide and oxidative stress resistance responses

<p>Abstract</p> <p>Background</p> <p>The successful interaction of bacterial pathogens with host tissues requires the sensing of specific chemical and physical cues. The human gut contains a huge number of neurons involved in the secretion and sensing of a class of neuroendocrine hormones called catecholamines. Recently, in <it>Escherichia coli </it>O157:H7, the catecholamines adrenaline and noradrenaline were shown to act synergistically with a bacterial quorum sensing molecule, autoinducer 3 (AI-3), to affect bacterial virulence and motility. We wished to investigate the impact of adrenaline on the biology of <it>Salmonella </it>spp.</p> <p>Results</p> <p>We have determined the effect of adrenaline on the transcriptome of the gut pathogen <it>Salmonella enterica </it>serovar Typhimurium. Addition of adrenaline led to an induction of key metal transport systems within 30 minutes of treatment. The oxidative stress responses employing manganese internalisation were also elicited. Cells lacking the key oxidative stress regulator OxyR showed reduced survival in the presence of adrenaline and complete restoration of growth upon addition of manganese. A significant reduction in the expression of the <it>pmrHFIJKLM </it>antimicrobial peptide resistance operon reduced the ability of <it>Salmonella </it>to survive polymyxin B following addition of adrenaline. Notably, both phenotypes were reversed by the addition of the β-adrenergic blocker propranolol. Our data suggest that the BasSR two component signal transduction system is the likely adrenaline sensor mediating the antimicrobial peptide response.</p> <p>Conclusion</p> <p><it>Salmonella </it>are able to sense adrenaline and downregulate the antimicrobial peptide resistance <it>pmr </it>locus through the BasSR two component signalling system. Through iron transport, adrenaline may affect the oxidative stress balance of the cell requiring OxyR for normal growth. Both adrenaline effects can be inhibited by the addition of the β-adrenergic blocker propranolol. Adrenaline sensing may provide an environmental cue for the induction of the <it>Salmonella </it>stress response in anticipation of imminent host-derived oxidative stress. However, adrenaline may also serve in favour of the host defences by lowering antimicrobial peptide resistance and hence documenting for the first time such a function for a hormone.</p