Using Regular Languages to Explore the Representational Capacity of Recurrent Neural Architectures

The presence of Long Distance Dependencies (LDDs) in sequential data poses significant challenges for computational models. Various recurrent neural architectures have been designed to mitigate this issue. In order to test these state-of-the-art architectures, there is growing need for rich benchmarking datasets. However, one of the drawbacks of existing datasets is the lack of experimental control with regards to the presence and/or degree of LDDs. This lack of control limits the analysis of model performance in relation to the specific challenge posed by LDDs. One way to address this is to use synthetic data having the properties of subregular languages. The degree of LDDs within the generated data can be controlled through the k parameter, length of the generated strings, and by choosing appropriate forbidden strings. In this paper, we explore the capacity of different RNN extensions to model LDDs, by evaluating these models on a sequence of SPk synthesized datasets, where each subsequent dataset exhibits a longer degree of LDD. Even though SPk are simple languages, the presence of LDDs does have significant impact on the performance of recurrent neural architectures, thus making them prime candidate in benchmarking tasks.Comment: International Conference of Artificial Neural Networks (ICANN) 201

Visualizing sound emission of elephant vocalizations: evidence for two rumble production types

Recent comparative data reveal that formant frequencies are cues to body size in animals, due to a close relationship between formant frequency spacing, vocal tract length and overall body size. Accordingly, intriguing morphological adaptations to elongate the vocal tract in order to lower formants occur in several species, with the size exaggeration hypothesis being proposed to justify most of these observations. While the elephant trunk is strongly implicated to account for the low formants of elephant rumbles, it is unknown whether elephants emit these vocalizations exclusively through the trunk, or whether the mouth is also involved in rumble production. In this study we used a sound visualization method (an acoustic camera) to record rumbles of five captive African elephants during spatial separation and subsequent bonding situations. Our results showed that the female elephants in our analysis produced two distinct types of rumble vocalizations based on vocal path differences: a nasally- and an orally-emitted rumble. Interestingly, nasal rumbles predominated during contact calling, whereas oral rumbles were mainly produced in bonding situations. In addition, nasal and oral rumbles varied considerably in their acoustic structure. In particular, the values of the first two formants reflected the estimated lengths of the vocal paths, corresponding to a vocal tract length of around 2 meters for nasal, and around 0.7 meters for oral rumbles. These results suggest that African elephants may be switching vocal paths to actively vary vocal tract length (with considerable variation in formants) according to context, and call for further research investigating the function of formant modulation in elephant vocalizations. Furthermore, by confirming the use of the elephant trunk in long distance rumble production, our findings provide an explanation for the extremely low formants in these calls, and may also indicate that formant lowering functions to increase call propagation distances in this species'

Composition and distribution of the peracarid crustacean fauna along a latitudinal transect off Victoria Land (Ross Sea, Antarctica) with special emphasis on the Cumacea

The following study was the first to describe composition and structure of the peracarid fauna systematically along a latitudinal transect off Victoria Land (Ross Sea, Antarctica). During the 19th Antarctic expedition of the Italian research vessel “Italica” in February 2004, macrobenthic samples were collected by means of a Rauschert dredge with a mesh size of 500 m at depths between 85 and 515 m. The composition of peracarid crustaceans, especially Cumacea was investigated. Peracarida contributed 63% to the total abundance of the fauna. The peracarid samples were dominated by amphipods (66%), whereas cumaceans were represented with 7%. Previously, only 13 cumacean species were known, now the number of species recorded from the Ross Sea increased to 34. Thus, the cumacean fauna of the Ross Sea, which was regarded as the poorest in terms of species richness, has to be considered as equivalent to that of other high Antarctic areas. Most important cumacean families concerning abundance and species richness were Leuconidae, Nannastacidae, and Diastylidae. Cumacean diversity was lowest at the northernmost area (Cape Adare). At the area off Coulman Island, which is characterized by muddy sediment, diversity was highest. Diversity and species number were higher at the deeper stations and abundance increased with latitude. A review of the bathymetric distribution of the Cumacea from the Ross Sea reveals that most species distribute across the Antarctic continental shelf and slope. So far, only few deep-sea records justify the assumption of a shallow-water–deep-sea relationship in some species of Ross Sea Cumacea, which is discussed from an evolutionary point of view

A record of carbonyl sulfide from Antarctic ice over the last 1000 years

Carbonyl sulfide (COS) is a trace gas, present in the troposphere, and also in the stratosphere, where it contributes to the stratospheric sulfate aerosol layer. It has both natural and anthropogenic sources. Natural processes include uptake by plants, while oceans, wetlands, volcanism and biomass burning all contribute to natural COS emissions. We have measured COS in Antarctic ice cores from Dronning Maud Land, drilled in 1998, the DE08 core drilled at Law Dome in 1987, and the DSS0506 core drilled in 2006. Ice samples with COS gas ages between about 1050 AD and the early 20th centrury have been examined. A large volume ice crusher at the CSIRO Marine and Atmospheric Research laboratory was used to extract air from bubbles occluded in the ice cores. These air samples were analysed for CO2, CH4, CO and 13CO2 at CSIRO, and then for COS and several halocarbons at the University of East Anglia on a high sensitivity gas chromatograph/tri-sector mass spectrometer system. Initial results indicate that good sample integrity can be achieved. Measurements from the DML samples indicate low and uniform abundances across the last few hundred years, and at concentrations significantly below those in the modernday atmosphere. Measurements in more recent ice from DE08 show the start of increasing concentrations in the early 1900s, confirming earlier evidence that the global atmospheric abundance of COS has increased as a result of industrial activity during the 20th century

Category label and response location shifts in category learning

The category shift literature suggests that rule-based classification, an important form of explicit learning, is mediated by two separate learned associations: a stimulus-to-label association that associates stimuli and category labels, and a label-to-response association that associates category labels and responses. Three experiments investigate whether information–integration classification, an important form of implicit learning, is also mediated by two separate learned associations. Participants were trained on a rule-based or an information–integration categorization task and then the association between stimulus and category label, or between category label and response location was altered. For rule-based categories, and in line with previous research, breaking the association between stimulus and category label caused more interference than breaking the association between category label and response location. However, no differences in recovery rate emerged. For information–integration categories, breaking the association between stimulus and category label caused more interference and led to greater recovery than breaking the association between category label and response location. These results provide evidence that information–integration category learning is mediated by separate stimulus-to-label and label-to-response associations. Implications for the neurobiological basis of these two learned associations are discussed

Atmospheric CO2 and d13C-CO2 reconstruction of the little ice age from antarctic ice cores

The decrease of atmospheric CO2 concentration recorded in Antarctic ice around 1600 AD is one of the most significant atmospheric changes to have occurred during the last millennia, before the onset of the industrial period.Together with the temperature decrease, the CO2 drop has been used to derive the sensitivity of carbon stores to climate. However, the cause of it is still under debate because models are not yet able to reproduce either its magnitude, or its timing. Here we present new measurements of the CO2 concentration decrease recorded in an ice core from a medium accumulation rate site in Antarctica (DML). We show that the new record is compatible(differences <2 ppm) with the CO2 record from the high accumulation rate DSS site on Law Dome (East Antarctica), when the different age distributions are taken into account. We have also measured the d13C-CO2 change in DML ice, filling a gap around 1600 AD in the DSS d13C record. We use a double deconvolution of the CO2 and d13C records together to provide quantitative evidence that the CO2 decrease was caused by a change in the net flux to the terrestrial biosphere. Finally, we provide a new interpretation of a published record showing increasing atmospheric carbonyl sulphide during the CO2 decrease, suggesting that cooler LIA climate affected terrestrial biospheric fluxes. Altogether our findings support the hypothesis that reduced soil heterotrophic respiration is likely to have given the most significant contribution to the LIA CO2 decrease implying a positive CO2-climate feedback. © 2015, Authors

Natural and anthropogenic changes in atmospheric greenhouse gases over the past 2 millennia

Millennial changes in atmospheric trace gas composition are best determined from air enclosed in ice sheets. Air extracted from the open pores in firn and the bubbles in ice is measured to derive the past concentrations and isotopic ratios of the long lived trace gases. The significant increases observed in CO2, CH4 and N2O since about 1750 and the more recent appearance of synthetic gases such as the CFCs in the atmosphere are a key feature of the anthropocene. The millennia preceding the anthropocene, the Late Pre-Industrial Holocene (LPIH), show evidence of natural changes in trace gases that can be used to constrain models and improve their ability to predict future changes under scenarios of anthropogenic emissions and climate change. Precise measurements and ice core air samples that are accurately dated and highly resolved in time are required to record the small and rapid trace gas signals of this period. The atmospheric composition records produced by CSIRO and collaborators using the Law Dome, Antarctica ice cores are widely used in models of climate, atmospheric chemistry and the carbon cycle over the anthropocene and the LPIH. Results from these studies have been influential in informing global policies, including the Montreal and Kyoto Protocols. We will present the recently revised trace gas records from Law Dome and new measurements of tracers from these and other ice sites that reveal the causes of atmospheric changes over the anthropocene and the LPIH

Quantifying Drug-Induced Bone Marrow Toxicity Using a Novel Haematopoiesis Systems Pharmacology Model.

Haematological toxicity associated with cancer therapeutics is monitored by changes in blood cell count, and their primary effect is on proliferative progenitors in the bone marrow. Using observations in rat bone marrow and blood, we characterize a mathematical model that comprises cell proliferation and differentiation of the full haematopoietic phylogeny, with interacting feedback loops between lineages in homeostasis as well as following carboplatin exposure. We accurately predicted the temporal dynamics of several mature cell types related to carboplatin-induced bone marrow toxicity and identified novel insights into haematopoiesis. Our model confirms a significant degree of plasticity within bone marrow cells, with the number and type of both early progenitors and circulating cells affecting cell balance, via feedback mechanisms, through fate decisions of the multipotent progenitors. We also demonstrated cross-species translation of our predictions to patients, applying the same core model structure and considering differences in drug-dependent and physiology-dependent parameters

Muscle fiber conduction velocity is more affected after eccentric than concentric exercise

It has been shown that mean muscle fiber conduction velocity (CV) can be acutely impaired after eccentric exercise. However, it is not known whether this applies to other exercise modes. Therefore, the purpose of this experiment was to compare the effects of eccentric and concentric exercises on CV, and amplitude and frequency content of surface electromyography (sEMG) signals up to 24 h post-exercise. Multichannel sEMG signals were recorded from biceps brachii muscle of the exercised arm during isometric maximal voluntary contraction (MVC) and electrically evoked contractions induced by motor-point stimulation before, immediately after and 2 h after maximal eccentric (ECC group, N = 12) and concentric (CON group, N = 12) elbow flexor exercises. Isometric MVC decreased in CON by 21.7 ± 12.0% (± SD, p < 0.01) and by 30.0 ± 17.7% (p < 0.001) in ECC immediately post-exercise when compared to baseline. At 2 h post-exercise, ECC showed a reduction in isometric MVC by 24.7 ± 13.7% (p < 0.01) when compared to baseline, while no significant reduction (by 8.0 ± 17.0%, ns) was observed in CON. Similarly, reduction in CV was observed only in ECC both during the isometric MVC (from baseline of 4.16 ± 0.3 to 3.43 ± 0.4 m/s, p < 0.001) and the electrically evoked contractions (from baseline of 4.33 ± 0.4 to 3.82 ± 0.3 m/s, p < 0.001). In conclusion, eccentric exercise can induce a greater and more prolonged reduction in muscle force production capability and CV than concentric exercis

Using geographically weighted regression to explore the spatially heterogeneous spread of bovine tuberculosis in England and Wales

An understanding of the factors that affect the spread of endemic bovine tuberculosis (bTB) is critical for the development of measures to stop and reverse this spread. Analyses of spatial data need to account for the inherent spatial heterogeneity within the data, or else spatial autocorrelation can lead to an overestimate of the significance of variables. This study used three methods of analysis—least-squares linear regression with a spatial autocorrelation term, geographically weighted regression (GWR) and boosted regression tree (BRT) analysis—to identify the factors that influence the spread of endemic bTB at a local level in England and Wales. The linear regression and GWR methods demonstrated the importance of accounting for spatial differences in risk factors for bTB, and showed some consistency in the identification of certain factors related to flooding, disease history and the presence of multiple genotypes of bTB. This is the first attempt to explore the factors associated with the spread of endemic bTB in England and Wales using GWR. This technique improves on least-squares linear regression approaches by identifying regional differences in the factors associated with bTB spread. However, interpretation of these complex regional differences is difficult and the approach does not lend itself to predictive models which are likely to be of more value to policy makers. Methods such as BRT may be more suited to such a task. Here we have demonstrated that GWR and BRT can produce comparable outputs