Estimating the reliability of MDP policies: A confidence interval approach

Past approaches for using reinforcement learning to derive dialog control policies have assumed that there was enough collected data to derive a reliable policy. In this paper we present a methodology for numerically constructing confidence intervals for the expected cumulative reward for a learned policy. These intervals are used to (1) better assess the reliability of the expected cumulative reward, and (2) perform a refined comparison between policies derived from different Markov Decision Processes (MDP) models. We applied this methodology to a prior experiment where the goal was to select the best features to include in the MDP statespace. Our results show that while some of the policies developed in the prior work exhibited very large confidence intervals, the policy developed from the best feature set had a much smaller confidence interval and thus showed very high reliability. © 2007 Association for Computational Linguistics

Identifying thesis and conclusion statements in student essays to scaffold peer review

Peer-reviewing is a recommended instructional technique to encourage good writing. Peer reviewers, however, may fail to identify key elements of an essay, such as thesis and conclusion statements, especially in high school writing. Our system identifies thesis and conclusion statements, or their absence, in students' essays in order to scaffold reviewer reflection. We showed that computational linguistics and interactive machine learning have the potential to facilitate peer-review processes. © 2014 Springer International Publishing Switzerland

Using system and user performance features to improve emotion detection in spoken tutoring dialogs

In this study, we incorporate automatically obtained system/user performance features into machine learning experiments to detect student emotion in computer tutoring dialogs. Our results show a relative improvement of 2.7% on classification accuracy and 8.08% on Kappa over using standard lexical, prosodie, sequential, and identification features. This level of improvement is comparable to the performance improvement shown in previous studies by applying dialog acts or lexical/prosodic-/discourse- level contextual features

Absence of truncating BRIP1 mutations in chromosome 17q-linked hereditary prostate cancer families

Background:In a genome-wide scan (GWS) of 175 multiplex prostate cancer (PCa) families from the University of Michigan Prostate Cancer Genetics Project (PCGP), linkage was observed to markers on chromosome 17q21–24, a region that includes two breast cancer susceptibility genes, BRCA1 and BRIP1. BRIP1 is a Fanconi anaemia gene (FANCJ) that interacts with the BRCT domain of BRCA1 and has a role in DNA damage repair. Protein truncating mutations in BRIP1 have been identified in hereditary breast and ovarian cancer families, and a recent report suggested that a recurrent truncating mutation (R798X) may have a role in PCa susceptibility.Methods:We examined the role of BRIP1 mutations in hereditary PCa through sequence analysis of 94 individuals from PCGP families showing linkage to 17q.Results:A total of 24 single-nucleotide polymorphisms, including 7 missense variants but no protein truncating mutations, were observed.Conclusion:The data presented here suggest that BRIP1 truncating mutations are uncommon in PCa cases and do not account for the linkage to chromosome 17q observed in our GWS. Additional investigation is needed to determine the significance, if any, of the observed BRIP1 missense variants in hereditary PCa

An AFM study of solid-phase bilayers of unsaturated PC lipids and the lateral distribution of the transmembrane model peptide WALP23 in these bilayers

An altered lipid packing can have a large influence on the properties of the membrane and the lateral distribution of proteins and/or peptides that are associated with the bilayer. Here, it is shown by contact-mode atomic force microscopy that the surface topography of solid-phase bilayers of PC lipids with an unsaturated cis bond in their acyl chains shows surfaces with a large number of line-type packing defects, in contrast to the much smoother surfaces observed for saturated PC lipids. Di-n:1-PC (n = 20, 22, 24) and (16:0,18:1)-PC (POPC) were used. Next, the influence of an altered lipid environment on the lateral distribution of the single α-helical model peptide WALP23 was studied by incorporating the peptide in the bilayers of di-n:1-PC (n = 20, 22, 24) and (16:0,18:1)-PC unsaturated lipids. The presence of WALP23 leads to an increase in the number of packing defects but does not lead to the formation of the striated domains that were previously observed in bilayers of saturated PC lipids and WALP. This is ascribed to the less efficient lateral lipid packing of the unsaturated lipids, while the increase in packing defects is probably an indirect effect of the peptide. Finally, the fact that an altered lipid packing affects the distribution of WALP23 is also confirmed in an additional experiment where the solvent TFE (2,2,2-trifluorethanol) is added to bilayers of di-16:0-PC/WALP23. At 3.5 vol% TFE, the previous striated ordering of the peptide is abolished and replaced by loose lines

Targeting the histone methyltransferase G9a activates imprinted genes and improves survival of a mouse model of Prader–Willi syndrome

Prader–Willi syndrome (PWS) is an imprinting disorder caused by a deficiency of paternally expressed gene(s) in the 15q11–q13 chromosomal region. The regulation of imprinted gene expression in this region is coordinated by an imprinting center (PWS-IC). In individuals with PWS, genes responsible for PWS on the maternal chromosome are present, but repressed epigenetically, which provides an opportunity for the use of epigenetic therapy to restore expression from the maternal copies of PWS-associated genes. Through a high-content screen (HCS) of >9,000 small molecules, we discovered that UNC0638 and UNC0642—two selective inhibitors of euchromatic histone lysine N-methyltransferase-2 (EHMT2, also known as G9a)—activated the maternal (m) copy of candidate genes underlying PWS, including the SnoRNA cluster SNORD116, in cells from humans with PWS and also from a mouse model of PWS carrying a paternal (p) deletion from small nuclear ribonucleoprotein N (Snrpn (S)) to ubiquitin protein ligase E3A (Ube3a (U)) (mouse model referred to hereafter as m+/pΔS−U). Both UNC0642 and UNC0638 caused a selective reduction of the dimethylation of histone H3 lysine 9 (H3K9me2) at PWS-IC, without changing DNA methylation, when analyzed by bisulfite genomic sequencing. This indicates that histone modification is essential for the imprinting of candidate genes underlying PWS. UNC0642 displayed therapeutic effects in the PWS mouse model by improving the survival and the growth of m+/pΔS−U newborn pups. This study provides the first proof of principle for an epigenetics-based therapy for PWS

Are all ‘research fields’ equal? Rethinking practice for the use of data from crowd-sourcing market places

New technologies like large-scale social media sides (e.g., Facebook and Twitter) and crowdsourcing services (e.g., Amazon Mechanical Turk, Crowdflower, Clickworker) impact social science research and provide many new and interesting avenues for research. The use of these new technologies for research has not been without challenges and a recently published psychological study on Facebook led to a widespread discussion on the ethics of conducting large-scale experiments online. Surprisingly little has been said about the ethics of conducting research using commercial crowdsourcing market places. In this paper, I want to focus on the question of which ethical questions are raised by data collection with crowdsourcing tools. I briefly draw on implications of internet research more generally and then focus on the specific challenges that research with crowdsourcing tools faces. I identify fair-pay and related issues of respect for autonomy as well as problems with power dynamics between researcher and participant, which has implications for ‘withdrawal-withoutprejudice’, as the major ethical challenges with crowdsourced data. Further, I will to draw attention on how we can develop a ‘best practice’ for researchers using crowdsourcing tools

Functional Comparison of Innate Immune Signaling Pathways in Primates

Humans respond differently than other primates to a large number of infections. Differences in susceptibility to infectious agents between humans and other primates are probably due to inter-species differences in immune response to infection. Consistent with that notion, genes involved in immunity-related processes are strongly enriched among recent targets of positive selection in primates, suggesting that immune responses evolve rapidly, yet providing only indirect evidence for possible inter-species functional differences. To directly compare immune responses among primates, we stimulated primary monocytes from humans, chimpanzees, and rhesus macaques with lipopolysaccharide (LPS) and studied the ensuing time-course regulatory responses. We find that, while the universal Toll-like receptor response is mostly conserved across primates, the regulatory response associated with viral infections is often lineage-specific, probably reflecting rapid host–virus mutual adaptation cycles. Additionally, human-specific immune responses are enriched for genes involved in apoptosis, as well as for genes associated with cancer and with susceptibility to infectious diseases or immune-related disorders. Finally, we find that chimpanzee-specific immune signaling pathways are enriched for HIV–interacting genes. Put together, our observations lend strong support to the notion that lineage-specific immune responses may help explain known inter-species differences in susceptibility to infectious diseases

EVOLUTION OF ANTIGEN BINDING RECEPTORS

This review addresses issues related to the evolution of the complex multigene families of antigen binding receptors that function in adaptive immunity. Advances in molecular genetic technology now permit the study of immunoglobulin (Ig) and T cell receptor (TCR) genes in many species that are not commonly studied yet represent critical branch points in vertebrate phylogeny. Both Ig and TCR genes have been defined in most of the major lineages of jawed vertebrates, including the cartilaginous fishes, which represent the most phylogenetically divergent jawed vertebrate group relative to the mammals. Ig genes in cartilaginous fish are encoded by multiple individual loci that each contain rearranging segmental elements and constant regions. In some loci, segmental elements are joined in the germline, i.e. they do not undergo genetic rearrangement. Other major differences in Ig gene organization and the mechanisms of somatic diversification have occurred throughout vertebrate evolution. However, relating these changes to adaptive immune function in lower vertebrates is challenging. TCR genes exhibit greater sequence diversity in individual segmental elements than is found in Ig genes but have undergone fewer changes in gene organization, isotype diversity, and mechanisms of diversification. As of yet, homologous forms of antigen binding receptors have not been identified in jawless vertebrates; however, acquisition of large amounts of structural data for the antigen binding receptors that are found in a variety of jawed vertebrates has defined shared characteristics that provide unique insight into the distant origins of the rearranging gene systems and their relationships to both adaptive and innate recognition processes

The CogBIAS longitudinal study protocol: cognitive and genetic factors influencing psychological functioning in adolescence.

BACKGROUND: Optimal psychological development is dependent upon a complex interplay between individual and situational factors. Investigating the development of these factors in adolescence will help to improve understanding of emotional vulnerability and resilience. The CogBIAS longitudinal study (CogBIAS-L-S) aims to combine cognitive and genetic approaches to investigate risk and protective factors associated with the development of mood and impulsivity-related outcomes in an adolescent sample. METHODS: CogBIAS-L-S is a three-wave longitudinal study of typically developing adolescents conducted over 4 years, with data collection at age 12, 14 and 16. At each wave participants will undergo multiple assessments including a range of selective cognitive processing tasks (e.g. attention bias, interpretation bias, memory bias) and psychological self-report measures (e.g. anxiety, depression, resilience). Saliva samples will also be collected at the baseline assessment for genetic analyses. Multilevel statistical analyses will be performed to investigate the developmental trajectory of cognitive biases on psychological functioning, as well as the influence of genetic moderation on these relationships. DISCUSSION: CogBIAS-L-S represents the first longitudinal study to assess multiple cognitive biases across adolescent development and the largest study of its kind to collect genetic data. It therefore provides a unique opportunity to understand how genes and the environment influence the development and maintenance of cognitive biases and provide insight into risk and protective factors that may be key targets for intervention.This work was supported by the European Research Council (ERC) under the European Union’s Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no: [324176]