Estimating the reliability of MDP policies: A confidence interval approach

Past approaches for using reinforcement learning to derive dialog control policies have assumed that there was enough collected data to derive a reliable policy. In this paper we present a methodology for numerically constructing confidence intervals for the expected cumulative reward for a learned policy. These intervals are used to (1) better assess the reliability of the expected cumulative reward, and (2) perform a refined comparison between policies derived from different Markov Decision Processes (MDP) models. We applied this methodology to a prior experiment where the goal was to select the best features to include in the MDP statespace. Our results show that while some of the policies developed in the prior work exhibited very large confidence intervals, the policy developed from the best feature set had a much smaller confidence interval and thus showed very high reliability. © 2007 Association for Computational Linguistics

Defining authorship in user-generated content : copyright struggles in The Game of Thrones

The notion of authorship is a core element in antipiracy campaigns accompanying an emerging copyright regime, worldwide. These campaigns are built on discourses that aim to ‘problematize’ the issues of ‘legality’ of content downloading practices, ‘protection’ for content creators and the alleged damage caused to creators’ livelihood by piracy. Under these tensions, fandom both subverts such discourses, through sharing and production practices, and legitimizes industry’s mythology of an ‘original’ author. However, how is the notion of authorship constructed in the cooperative spaces of fandom? The article explores the most popular fandom sites of A Song of Ice and Fire, the book series that inspires the TV-show Game of Thrones and argues that the notion of authorship is not one-dimensional, but rather consists of attributes that develop across three processes: community building, the creative and the industrial/production process. Here, fandom constructs a figure of the ‘author’ which, although more complex than the one presented by the industry in its copyright/anti-piracy campaigns, maintains the status quo of regulatory frameworks based on the idea of a ‘primary’ creator

Cigarette smoke induces genetic instability in airway epithelial cells by suppressing FANCD2 expression

Chromosomal abnormalities are commonly found in bronchogenic carcinoma cells, but the molecular causes of chromosomal instability (CIN) and their relationship to cigarette smoke has not been defined. Because the Fanconi anaemia (FA)/BRCA pathway is essential for maintenance of chromosomal stability, we tested the hypothesis that cigarette smoke suppresses that activity of this pathway. Here, we show that cigarette smoke condensate (CSC) inhibited translation of FANCD2 mRNA (but not FANCC or FANCG) in normal airway epithelial cells and that this suppression of FANCD2 expression was sufficient to induce both genetic instability and programmed cell death in the exposed cell population. Cigarette smoke condensate also suppressed FANCD2 function and induced CIN in bronchogenic carcinoma cells, but these cells were resistant to CSC-induced apoptosis relative to normal airway epithelial cells. We, therefore, suggest that CSC exerts pressure on airway epithelial cells that results in selection and emergence of genetically unstable somatic mutant clones that may have lost the capacity to effectively execute an apoptotic programme. Carcinogen-mediated suppression of FANCD2 gene expression provides a plausible molecular mechanism for CIN in bronchogenic carcinogenesis

Genetic Variations and Haplotype Diversity of the UGT1 Gene Cluster in the Chinese Population

Vertebrates require tremendous molecular diversity to defend against numerous small hydrophobic chemicals. UDP-glucuronosyltransferases (UGTs) are a large family of detoxification enzymes that glucuronidate xenobiotics and endobiotics, facilitating their excretion from the body. The UGT1 gene cluster contains a tandem array of variable first exons, each preceded by a specific promoter, and a common set of downstream constant exons, similar to the genomic organization of the protocadherin (Pcdh), immunoglobulin, and T-cell receptor gene clusters. To assist pharmacogenomics studies in Chinese, we sequenced nine first exons, promoter and intronic regions, and five common exons of the UGT1 gene cluster in a population sample of 253 unrelated Chinese individuals. We identified 101 polymorphisms and found 15 novel SNPs. We then computed allele frequencies for each polymorphism and reconstructed their linkage disequilibrium (LD) map. The UGT1 cluster can be divided into five linkage blocks: Block 9 (UGT1A9), Block 9/7/6 (UGT1A9, UGT1A7, and UGT1A6), Block 5 (UGT1A5), Block 4/3 (UGT1A4 and UGT1A3), and Block 3′ UTR. Furthermore, we inferred haplotypes and selected their tagSNPs. Finally, comparing our data with those of three other populations of the HapMap project revealed ethnic specificity of the UGT1 genetic diversity in Chinese. These findings have important implications for future molecular genetic studies of the UGT1 gene cluster as well as for personalized medical therapies in Chinese

Nucleosomes Containing Methylated DNA Stabilize DNA Methyltransferases 3A/3B and Ensure Faithful Epigenetic Inheritance

How epigenetic information is propagated during somatic cell divisions is still unclear but is absolutely critical for preserving gene expression patterns and cellular identity. Here we show an unanticipated mechanism for inheritance of DNA methylation patterns where the epigenetic mark not only recruits the catalyzing enzyme but also regulates the protein level, i.e. the enzymatic product (5-methylcytosine) determines the level of the methylase, thus forming a novel homeostatic inheritance system. Nucleosomes containing methylated DNA stabilize de novo DNA methyltransferases, DNMT3A/3B, allowing little free DNMT3A/3B enzymes to exist in the nucleus. Stabilization of DNMT3A/3B on nucleosomes in methylated regions further promotes propagation of DNA methylation. However, reduction of cellular DNA methylation levels creating more potential CpG substrates counter-intuitively results in a dramatic decrease of DNMT3A/3B proteins due to diminished nucleosome binding and subsequent degradation of the unstable free proteins. These data show an unexpected self-regulatory inheritance mechanism that not only ensures somatic propagation of methylated states by DNMT1 and DNMT3A/3B enzymes but also prevents aberrant de novo methylation by causing degradation of free DNMT3A/3B enzymes

Paired opposing leukocyte receptors recognizing rapidly evolving ligands are subject to homogenization of their ligand binding domains

Some leukocyte receptors come in groups of two or more where the partners share ligand(s) but transmit opposite signals. Some of the ligands, such as MHC class I, are fast evolving, raising the problem of how paired opposing receptors manage to change in step with respect to ligand binding properties and at the same time conserve opposite signaling functions. An example is the KLRC (NKG2) family, where opposing variants have been conserved in both rodents and primates. Phylogenetic analyses of the KLRC receptors within and between the two orders show that the opposing partners have been subject to post-speciation gene homogenization restricted mainly to the parts of the genes that encode the ligand binding domains. Concerted evolution similarly restricted is demonstrated also for the KLRI, KLRB (NKR-P1), KLRA (Ly49), and PIR receptor families. We propose the term merohomogenization for this phenomenon and discuss its significance for the evolution of immune receptors

Temporal, seasonal and weather effects on cycle volume: an ecological study

<p>Abstract</p> <p>Background</p> <p>Cycling has the potential to provide health, environmental and economic benefits but the level of cycling is very low in New Zealand and many other countries. Adverse weather is often cited as a reason why people do not cycle. This study investigated temporal and seasonal variability in cycle volume and its association with weather in Auckland, New Zealand's largest city.</p> <p>Methods</p> <p>Two datasets were used: automated cycle count data collected on Tamaki Drive in Auckland by using ZELT Inductive Loop Eco-counters and weather data (gust speed, rain, temperature, sunshine duration) available online from the National Climate Database. Analyses were undertaken using data collected over one year (1 January to 31 December 2009). Normalised cycle volumes were used in correlation and regression analyses to accommodate differences by hour of the day and day of the week and holiday.</p> <p>Results</p> <p>In 2009, 220,043 bicycles were recorded at the site. There were significant differences in mean hourly cycle volumes by hour of the day, day type and month of the year (<it>p </it>< 0.0001). All weather variables significantly influenced hourly and daily cycle volumes (<it>p </it>< 0.0001). The cycle volume increased by 3.2% (hourly) and 2.6% (daily) for 1°C increase in temperature but decreased by 10.6% (hourly) and 1.5% (daily) for 1 mm increase in rainfall and by 1.4% (hourly) and 0.9% (daily) for 1 km/h increase in gust speed. The volume was 26.2% higher in an hour with sunshine compared with no sunshine, and increased by 2.5% for one hour increase in sunshine each day.</p> <p>Conclusions</p> <p>There are temporal and seasonal variations in cycle volume in Auckland and weather significantly influences hour-to-hour and day-to-day variations in cycle volume. Our findings will help inform future cycling promotion activities in Auckland.</p

Functional Comparison of Innate Immune Signaling Pathways in Primates

Humans respond differently than other primates to a large number of infections. Differences in susceptibility to infectious agents between humans and other primates are probably due to inter-species differences in immune response to infection. Consistent with that notion, genes involved in immunity-related processes are strongly enriched among recent targets of positive selection in primates, suggesting that immune responses evolve rapidly, yet providing only indirect evidence for possible inter-species functional differences. To directly compare immune responses among primates, we stimulated primary monocytes from humans, chimpanzees, and rhesus macaques with lipopolysaccharide (LPS) and studied the ensuing time-course regulatory responses. We find that, while the universal Toll-like receptor response is mostly conserved across primates, the regulatory response associated with viral infections is often lineage-specific, probably reflecting rapid host–virus mutual adaptation cycles. Additionally, human-specific immune responses are enriched for genes involved in apoptosis, as well as for genes associated with cancer and with susceptibility to infectious diseases or immune-related disorders. Finally, we find that chimpanzee-specific immune signaling pathways are enriched for HIV–interacting genes. Put together, our observations lend strong support to the notion that lineage-specific immune responses may help explain known inter-species differences in susceptibility to infectious diseases

Functional Evidence of Multidrug Resistance Transporters (MDR) in Rodent Olfactory Epithelium

Background: P-glycoprotein (Pgp) and multidrug resistance-associated protein (MRP1) are membrane transporter proteins which function as efflux pumps at cell membranes and are considered to exert a protective function against the entry of xenobiotics. While evidence for Pgp and MRP transporter activity is reported for olfactory tissue, their possible interaction and participation in the olfactory response has not been investigated. Principal Findings: Functional activity of putative MDR transporters was assessed by means of the fluorometric calcein acetoxymethyl ester (calcein-AM) accumulation assay on acute rat and mouse olfactory tissue slices. Calcein-AM uptake was measured as fluorescence intensity changes in the presence of Pgp or MRP specific inhibitors. Epifluorescence microscopy measured time course analysis in the olfactory epithelium revealed significant inhibitor-dependent calcein uptake in the presence of each of the selected inhibitors. Furthermore, intracellular calcein accumulation in olfactory receptor neurons was also significantly increased in the presence of either one of the Pgp or MRP inhibitors. The presence of Pgp or MRP1 encoding genes in the olfactory mucosa of rat and mouse was confirmed by RT-PCR with appropriate pairs of speciesspecific primers. Both transporters were expressed in both newborn and adult olfactory mucosa of both species. To assess a possible involvement of MDR transporters in the olfactory response, we examined the electrophysiological response to odorants in the presence of the selected MDR inhibitors by recording electroolfactograms (EOG). In both animal species