Multilingual and Unsupervised Subword Modelingfor Zero-Resource Languages

Subword modeling for zero-resource languages aims to learn low-level representations of speech audio without using transcriptions or other resources from the target language (such as text corpora or pronunciation dictionaries). A good representation should capture phonetic content and abstract away from other types of variability, such as speaker differences and channel noise. Previous work in this area has primarily focused unsupervised learning from target language data only, and has been evaluated only intrinsically. Here we directly compare multiple methods, including some that use only target language speech data and some that use transcribed speech from other (non-target) languages, and we evaluate using two intrinsic measures as well as on a downstream unsupervised word segmentation and clustering task. We find that combining two existing target-language-only methods yields better features than either method alone. Nevertheless, even better results are obtained by extracting target language bottleneck features using a model trained on other languages. Cross-lingual training using just one other language is enough to provide this benefit, but multilingual training helps even more. In addition to these results, which hold across both intrinsic measures and the extrinsic task, we discuss the qualitative differences between the different types of learned features.Comment: 17 pages, 6 figures, 7 tables. Accepted for publication in Computer Speech and Language. arXiv admin note: text overlap with arXiv:1803.0886

Averaged Differential Expression for the Discovery of Biomarkers in the Blood of Patients with Prostate Cancer

<div><h3>Background</h3><p>The identification of a blood-based diagnostic marker is a goal in many areas of medicine, including the early diagnosis of prostate cancer. We describe the use of averaged differential display as an efficient mechanism for biomarker discovery in whole blood RNA. The process of averaging reduces the problem of clinical heterogeneity while simultaneously minimizing sample handling.</p> <h3>Methodology/Principal Findings</h3><p>RNA was isolated from the blood of prostate cancer patients and healthy controls. Samples were pooled and subjected to the averaged differential display process. Transcripts present at different levels between patients and controls were purified and sequenced for identification. Transcript levels in the blood of prostate cancer patients and controls were verified by quantitative RT-PCR. Means were compared using a t-test and a receiver-operating curve was generated. The Ring finger protein 19A (RNF19A) transcript was identified as having higher levels in prostate cancer patients compared to healthy men through the averaged differential display process. Quantitative RT-PCR analysis confirmed a more than 2-fold higher level of RNF19A mRNA levels in the blood of patients with prostate cancer than in healthy controls (p = 0.0066). The accuracy of distinguishing cancer patients from healthy men using RNF19A mRNA levels in blood as determined by the area under the receiving operator curve was 0.727.</p> <h3>Conclusions/Significance</h3><p>Averaged differential display offers a simplified approach for the comprehensive screening of body fluids, such as blood, to identify biomarkers in patients with prostate cancer. Furthermore, this proof-of-concept study warrants further analysis of RNF19A as a clinically relevant biomarker for prostate cancer detection.</p> </div

Human Gamma Oscillations during Slow Wave Sleep

Neocortical local field potentials have shown that gamma oscillations occur spontaneously during slow-wave sleep (SWS). At the macroscopic EEG level in the human brain, no evidences were reported so far. In this study, by using simultaneous scalp and intracranial EEG recordings in 20 epileptic subjects, we examined gamma oscillations in cerebral cortex during SWS. We report that gamma oscillations in low (30–50 Hz) and high (60–120 Hz) frequency bands recurrently emerged in all investigated regions and their amplitudes coincided with specific phases of the cortical slow wave. In most of the cases, multiple oscillatory bursts in different frequency bands from 30 to 120 Hz were correlated with positive peaks of scalp slow waves (“IN-phase” pattern), confirming previous animal findings. In addition, we report another gamma pattern that appears preferentially during the negative phase of the slow wave (“ANTI-phase” pattern). This new pattern presented dominant peaks in the high gamma range and was preferentially expressed in the temporal cortex. Finally, we found that the spatial coherence between cortical sites exhibiting gamma activities was local and fell off quickly when computed between distant sites. Overall, these results provide the first human evidences that gamma oscillations can be observed in macroscopic EEG recordings during sleep. They support the concept that these high-frequency activities might be associated with phasic increases of neural activity during slow oscillations. Such patterned activity in the sleeping brain could play a role in off-line processing of cortical networks

Adaptation of pineal expressed teleost exo-rod opsin to non-image forming photoreception through enhanced Meta II decay

Photoreception by vertebrates enables both image-forming vision and non-image-forming responses such as circadian photoentrainment. Over the recent years, distinct non-rod non-cone photopigments have been found to support circadian photoreception in diverse species. By allowing specialization to this sensory task a selective advantage is implied, but the nature of that specialization remains elusive. We have used the presence of distinct rod opsin genes specialized to either image-forming (retinal rod opsin) or non-image-forming (pineal exo-rod opsin) photoreception in ray-finned fish (Actinopterygii) to gain a unique insight into this problem. A comparison of biochemical features for these paralogous opsins in two model teleosts, Fugu pufferfish (Takifugu rubripes) and zebrafish (Danio rerio), reveals striking differences. While spectral sensitivity is largely unaltered by specialization to the pineal environment, in other aspects exo-rod opsins exhibit a behavior that is quite distinct from the cardinal features of the rod opsin family. While they display a similar thermal stability, they show a greater than tenfold reduction in the lifetime of the signaling active Meta II photoproduct. We show that these features reflect structural changes in retinal association domains of helices 3 and 5 but, interestingly, not at either of the two residues known to define these characteristics in cone opsins. Our findings suggest that the requirements of non-image-forming photoreception have lead exo-rod opsin to adopt a characteristic that seemingly favors efficient bleach recovery but not at the expense of absolute sensitivity

Validating layer-specific VASO across species

Cerebral blood volume (CBV) has been shown to be a robust and important physiological parameter for quantitative interpretation of functional (f)MRI, capable of delivering highly localized mapping of neural activity. Indeed, with recent advances in ultra-high-field (≥7T) MRI hardware and associated sequence libraries, it has become possible to capture non-invasive CBV weighted fMRI signals across cortical layers. One of the most widely used approaches to achieve this (in humans) is through vascular-space-occupancy (VASO) fMRI. Unfortunately, the exact contrast mechanisms of layer-dependent VASO fMRI have not been validated for human fMRI and thus interpretation of such data is confounded. Here we validate the signal source of layer-dependent SS-SI VASO fMRI using multi-modal imaging in a rat model in response to neuronal activation (somatosensory cortex) and respiratory challenge (hypercapnia). In particular VASO derived CBV measures are directly compared to concurrent measures of total haemoglobin changes from high resolution intrinsic optical imaging spectroscopy (OIS). Quantified cortical layer profiling is demonstrated to be in agreement between VASO and contrast enhanced fMRI (using monocrystalline iron oxide nanoparticles, MION). Responses show high spatial localisation to layers of cortical processing independent of confounding large draining veins which can hamper BOLD fMRI studies, (depending on slice positioning). Thus, a cross species comparison is enabled using VASO as a common measure. We find increased VASO based CBV reactivity (3.1 ± 1.2 fold increase) in humans compared to rats. Together, our findings confirm that the VASO contrast is indeed a reliable estimate of layer-specific CBV changes. This validation study increases the neuronal interpretability of human layer-dependent VASO fMRI as an appropriate method in neuroscience application studies, in which the presence of large draining intracortical and pial veins limits neuroscientific inference with BOLD fMRI

Functional outcomes in symptomatic versus asymptomatic patients undergoing incisional hernia repair: Replacing one problem with another? A prospective cohort study in 1312 patients

Background: Incisional hernias can be associated with pain or discomfort. Surgical repair especially mesh reinforcement, may likewise induce pain. The primary objective was to assess the incidence of pain after hernia repair in patients with and without pre-operative pain or discomfort. The secondary objectives were to determine the preferred mesh type, mesh location and surgical technique in minimizing postoperative pain or discomfort. Materials and methods: A registry-based prospective cohort study was performed, including patients undergoing incisional hernia repair between September 2011 and May 2019. Patients with a minimum follow-up of 3–6 months were included. The incidence of hernia related pain and discomfort was recorded perioperatively. Results: A total of 1312 patients were included. Pre-operatively, 1091 (83%) patients reported pain or discomfort. After hernia repair, 961 (73%) patients did not report pain or discomfort (mean follow-up = 11.1 months). Of the pre-operative asymptomatic patients (n = 221), 44 (20%, moderate or severe pain: n = 14, 32%) reported pain or discomfort after mean follow-up of 10.5 months. Of those patients initially reporting pain or discomfort (n = 1091), 307 (28%, moderate or severe pain: n = 80, 26%) still reported pain or discomfort after a mean follow-up of 11.3 months postoperatively. Conclusion: In symptomatic incisional hernia patients, hernia related complaints may be resolved in the majority of cases undergoing surgical repair. In asymptomatic incisional hernia patients, pain or discomfort may be induced in a considerable number of patients due to surgical repair and one should be aware if this postoperative complication

Changes to the Fossil Record of Insects through Fifteen Years of Discovery

The first and last occurrences of hexapod families in the fossil record are compiled from publications up to end-2009. The major features of these data are compared with those of previous datasets (1993 and 1994). About a third of families (>400) are new to the fossil record since 1994, over half of the earlier, existing families have experienced changes in their known stratigraphic range and only about ten percent have unchanged ranges. Despite these significant additions to knowledge, the broad pattern of described richness through time remains similar, with described richness increasing steadily through geological history and a shift in dominant taxa, from Palaeoptera and Polyneoptera to Paraneoptera and Holometabola, after the Palaeozoic. However, after detrending, described richness is not well correlated with the earlier datasets, indicating significant changes in shorter-term patterns. There is reduced Palaeozoic richness, peaking at a different time, and a less pronounced Permian decline. A pronounced Triassic peak and decline is shown, and the plateau from the mid Early Cretaceous to the end of the period remains, albeit at substantially higher richness compared to earlier datasets. Origination and extinction rates are broadly similar to before, with a broad decline in both through time but episodic peaks, including end-Permian turnover. Origination more consistently exceeds extinction compared to previous datasets and exceptions are mainly in the Palaeozoic. These changes suggest that some inferences about causal mechanisms in insect macroevolution are likely to differ as well