Using Regular Languages to Explore the Representational Capacity of Recurrent Neural Architectures

The presence of Long Distance Dependencies (LDDs) in sequential data poses significant challenges for computational models. Various recurrent neural architectures have been designed to mitigate this issue. In order to test these state-of-the-art architectures, there is growing need for rich benchmarking datasets. However, one of the drawbacks of existing datasets is the lack of experimental control with regards to the presence and/or degree of LDDs. This lack of control limits the analysis of model performance in relation to the specific challenge posed by LDDs. One way to address this is to use synthetic data having the properties of subregular languages. The degree of LDDs within the generated data can be controlled through the k parameter, length of the generated strings, and by choosing appropriate forbidden strings. In this paper, we explore the capacity of different RNN extensions to model LDDs, by evaluating these models on a sequence of SPk synthesized datasets, where each subsequent dataset exhibits a longer degree of LDD. Even though SPk are simple languages, the presence of LDDs does have significant impact on the performance of recurrent neural architectures, thus making them prime candidate in benchmarking tasks.Comment: International Conference of Artificial Neural Networks (ICANN) 201

A skin abscess model for teaching incision and drainage procedures

<p>Abstract</p> <p>Background</p> <p>Skin and soft tissue infections are increasingly prevalent clinical problems, and it is important for health care practitioners to be well trained in how to treat skin abscesses. A realistic model of abscess incision and drainage will allow trainees to learn and practice this basic physician procedure.</p> <p>Methods</p> <p>We developed a realistic model of skin abscess formation to demonstrate the technique of incision and drainage for educational purposes. The creation of this model is described in detail in this report.</p> <p>Results</p> <p>This model has been successfully used to develop and disseminate a multimedia video production for teaching this medical procedure. Clinical faculty and resident physicians find this model to be a realistic method for demonstrating abscess incision and drainage.</p> <p>Conclusion</p> <p>This manuscript provides a detailed description of our model of abscess incision and drainage for medical education. Clinical educators can incorporate this model into skills labs or demonstrations for teaching this basic procedure.</p

An avalanche-photodiode-based photon-number-resolving detector

Avalanche photodiodes are widely used as practical detectors of single photons.1 Although conventional devices respond to one or more photons, they cannot resolve the number in the incident pulse or short time interval. However, such photon number resolving detectors are urgently needed for applications in quantum computing,2-4 communications5 and interferometry,6 as well as for extending the applicability of quantum detection generally. Here we show that, contrary to current belief,3,4 avalanche photodiodes are capable of detecting photon number, using a technique to measure very weak avalanches at the early stage of their development. Under such conditions the output signal from the avalanche photodiode is proportional to the number of photons in the incident pulse. As a compact, mass-manufactured device, operating without cryogens and at telecom wavelengths, it offers a practical solution for photon number detection.Comment: 12 pages, 4 figure

Low Frequency Groans Indicate Larger and More Dominant Fallow Deer (Dama dama) Males

Background: Models of honest advertisement predict that sexually selected calls should signal male quality. In most vertebrates, high quality males have larger body sizes that determine higher social status and in turn higher reproductive success. Previous research has emphasised the importance of vocal tract resonances or formant frequencies of calls as cues to body size in mammals. However, the role of the acoustic features of vocalisations as cues to other quality-related phenotypic characteristics of callers has rarely been investigated. Methodology/Principal Findings: We examined whether the acoustic structure of fallow deer groans provides reliable information on the quality of the caller, by exploring the relationships between male quality (body size, dominance rank, and mating success) and the frequency components of calls (fundamental frequency, formant frequencies, and formant dispersion). We found that body size was not related to the fundamental frequency of groans, whereas larger males produced groans with lower formant frequencies and lower formant dispersion. Groans of high-ranking males were characterised by lower minimum fundamental frequencies and to a lesser extent, by lower formant dispersions. Dominance rank was the factor most strongly related to mating success, with higher-ranking males having higher mating success. The minimum fundamental frequency and the minimum formant dispersion were indirectly related to male mating success (through dominance rank). Conclusion/Significance: Our study is the first to show that sexually selected vocalisations can signal social dominance in mammals other than primates, and reveals that independent acoustic components encode accurate information on different phenotypic aspects of male quality

Time-Warp–Invariant Neuronal Processing

A biophysical mechanism acting in auditory neurons allows the brain to process the high variability of speaking rates in natural speech in a time-warp-invariant manner

Conversion events in gene clusters

<p>Abstract</p> <p>Background</p> <p>Gene clusters containing multiple similar genomic regions in close proximity are of great interest for biomedical studies because of their associations with inherited diseases. However, such regions are difficult to analyze due to their structural complexity and their complicated evolutionary histories, reflecting a variety of large-scale mutational events. In particular, conversion events can mislead inferences about the relationships among these regions, as traced by traditional methods such as construction of phylogenetic trees or multi-species alignments.</p> <p>Results</p> <p>To correct the distorted information generated by such methods, we have developed an automated pipeline called CHAP (Cluster History Analysis Package) for detecting conversion events. We used this pipeline to analyze the conversion events that affected two well-studied gene clusters (α-globin and β-globin) and three gene clusters for which comparative sequence data were generated from seven primate species: CCL (chemokine ligand), IFN (interferon), and CYP2abf (part of cytochrome P450 family 2). CHAP is freely available at <url>http://www.bx.psu.edu/miller_lab</url>.</p> <p>Conclusions</p> <p>These studies reveal the value of characterizing conversion events in the context of studying gene clusters in complex genomes.</p

Life-History Evolution on Tropidurinae Lizards: Influence of Lineage, Body Size and Climate

The study of life history variation is central to the evolutionary theory. In many ectothermic lineages, including lizards, life history traits are plastic and relate to several sources of variation including body size, which is both a factor and a life history trait likely to modulate reproductive parameters. Larger species within a lineage, for example tend to be more fecund and have larger clutch size, but clutch size may also be influenced by climate, independently of body size. Thus, the study of climatic effects on lizard fecundity is mandatory on the current scenario of global climatic change. We asked how body and clutch size have responded to climate through time in a group of tropical lizards, the Tropidurinae, and how these two variables relate to each other. We used both traditional and phylogenetic comparative methods. Body and clutch size are variable within Tropidurinae, and both traits are influenced by phylogenetic position. Across the lineage, species which evolved larger size produce more eggs and neither trait is influenced by temperature components. A climatic component of precipitation, however, relates to larger female body size, and therefore seems to exert an indirect relationship on clutch size. This effect of precipitation on body size is likely a correlate of primary production. A decrease in fecundity is expected for Tropidurinae species on continental landmasses, which are predicted to undergo a decrease in summer rainfall

Ancestral bias in the Hras1 gene and distal Chromosome 7 among inbred mice

Inbred strains of mice vary in their frequency of liver tumors initiated by a mutation in the Hras1 (H-ras) proto-oncogene. We sequenced 4.5 kb of the Hras1 gene on distal Chr 7 in a diverse set of 12 commonly used laboratory inbred strains of mice and detected no sequence variation to account for strain-specific differences in Hras1 mutation prevalence. Furthermore, the Hras1 sequence is essentially monoallelic for an ancestral gene derived from the M. m. domesticus species. To determine if the monoallelism and associated low rate of polymorphism are unique to Hras1 or representative of the general chromosomal locale, we extended the sequence analysis to 12 genes in the final 8 Mb of distal Chr 7. A region of at least 2.5 Mb that encompasses several genes, including Hras1 and the H19/Igf2 loci, demonstrates virtually no sequence variation. The 12 inbred strains share one dominant haplotype derived from the M. m. domesticus allele. Chromosomal regions flanking the monoallelic segment exhibit a significantly higher rate of variation and multiple haplotypes, a majority of which are attributed to M. m. domesticus or M. m. musculus ancestry

Precursors to Natural Grammar Learning: Preliminary Evidence from 4-Month-Old Infants

When learning a new language, grammar—although difficult—is very important, as grammatical rules determine the relations between the words in a sentence. There is evidence that very young infants can detect rules determining the relation between neighbouring syllables in short syllable sequences. A critical feature of all natural languages, however, is that many grammatical rules concern the dependency relation between non-neighbouring words or elements in a sentence i.e. between an auxiliary and verb inflection as in is singing. Thus, the issue of when and how children begin to recognize such non-adjacent dependencies is fundamental to our understanding of language acquisition. Here, we use brain potential measures to demonstrate that the ability to recognize dependencies between non-adjacent elements in a novel natural language is observable by the age of 4 months. Brain responses indicate that 4-month-old German infants discriminate between grammatical and ungrammatical dependencies in auditorily presented Italian sentences after only brief exposure to correct sentences of the same type. As the grammatical dependencies are realized by phonologically distinct syllables the present data most likely reflect phonologically based implicit learning mechanisms which can serve as a precursor to later grammar learning