Preference-Based Monte Carlo Tree Search

Monte Carlo tree search (MCTS) is a popular choice for solving sequential anytime problems. However, it depends on a numeric feedback signal, which can be difficult to define. Real-time MCTS is a variant which may only rarely encounter states with an explicit, extrinsic reward. To deal with such cases, the experimenter has to supply an additional numeric feedback signal in the form of a heuristic, which intrinsically guides the agent. Recent work has shown evidence that in different areas the underlying structure is ordinal and not numerical. Hence erroneous and biased heuristics are inevitable, especially in such domains. In this paper, we propose a MCTS variant which only depends on qualitative feedback, and therefore opens up new applications for MCTS. We also find indications that translating absolute into ordinal feedback may be beneficial. Using a puzzle domain, we show that our preference-based MCTS variant, wich only receives qualitative feedback, is able to reach a performance level comparable to a regular MCTS baseline, which obtains quantitative feedback.Comment: To be publishe

Mathematical Evaluation of Community Level Impact of Combining Bed Nets and Indoor Residual Spraying upon Malaria Transmission in Areas where the main Vectors are Anopheles Arabiensis Mosquitoes.

Indoor residual insecticide spraying (IRS) and long-lasting insecticide treated nets (LLINs) are commonly used together even though evidence that such combinations confer greater protection against malaria than either method alone is inconsistent. A deterministic model of mosquito life cycle processes was adapted to allow parameterization with results from experimental hut trials of various combinations of untreated nets or LLINs (Olyset, PermaNet 2.0, Icon Life nets) with IRS (pirimiphos methyl, lambda cyhalothrin, DDT), in a setting where vector populations are dominated by Anopheles arabiensis, so that community level impact upon malaria transmission at high coverage could be predicted. Intact untreated nets alone provide equivalent personal protection to all three LLINs. Relative to IRS plus untreated nets, community level protection is slightly higher when Olyset or PermaNet 2.0 nets are added onto IRS with pirimiphos methyl or lambda cyhalothrin but not DDT, and when Icon Life nets supplement any of the IRS insecticides. Adding IRS onto any net modestly enhances communal protection when pirimiphos methyl is sprayed, while spraying lambda cyhalothrin enhances protection for untreated nets but not LLINs. Addition of DDT reduces communal protection when added to LLINs. Where transmission is mediated primarily by An. arabiensis, adding IRS to high LLIN coverage provides only modest incremental benefit (e.g. when an organophosphate like pirimiphos methyl is used), but can be redundant (e.g. when a pyrethroid like lambda cyhalothin is used) or even regressive (e.g. when DDT is used for the IRS). Relative to IRS plus untreated nets, supplementing IRS with LLINs will only modestly improve community protection. Beyond the physical protection that intact nets provide, additional protection against transmission by An. arabiensis conferred by insecticides will be remarkably small, regardless of whether they are delivered as LLINs or IRS. The insecticidal action of LLINs and IRS probably already approaches their absolute limit of potential impact upon this persistent vector so personal protection of nets should be enhanced by improving the physical integrity and durability. Combining LLINs and non-pyrethroid IRS in residual transmission systems may nevertheless be justified as a means to manage insecticide resistance and prevent potential rebound of not only An. arabiensis, but also more potent, vulnerable and historically important species such as Anopheles gambiae and Anopheles funestus

"I am your mother and your father!": In vitro derived gametes and the ethics of solo reproduction

In this paper, we will discuss the prospect of human reproduction achieved with gametes originating from only one person. According to statements by a minority of scientists working on the generation of gametes in vitro, it may become possible to create eggs from men’s non-reproductive cells and sperm from women’s. This would enable, at least in principle, the creation of an embryo from cells obtained from only one individual: ‘solo reproduction’. We will consider what might motivate people to reproduce in this way, and the implications that solo reproduction might have for ethics and policy. We suggest that such an innovation is unlikely to revolutionise reproduction and parenting. Indeed, in some respects it is less revolutionary than in vitro fertilisation as a whole. Furthermore, we show that solo reproduction with in vitro created gametes is not necessarily any more ethically problematic than gamete donation—and probably less so. Where appropriate, we draw parallels with the debate surrounding reproductive cloning. We note that solo reproduction may serve to perpetuate reductive geneticised accounts of reproduction, and that this may indeed be ethically questionable. However, in this it is not unique among other technologies of assisted reproduction, many of which focus on genetic transmission. It is for this reason that a ban on solo reproduction might be inconsistent with continuing to permit other kinds of reproduction that also bear the potential to strengthen attachment to a geneticised account of reproduction. Our claim is that there are at least as good reasons to pursue research towards enabling solo reproduction, and eventually to introduce solo reproduction as an option for fertility treatment, as there are to do so for other infertility related purposes

Relationships between students' conceptions of constructivist learning and their regulation and processing strategies

The present study investigated relationships between students' conceptions of constructivist learning on the one hand, and their regulation and processing strategies on the other hand. Students in a constructivist, problem-based learning curriculum were questioned about their conceptions of knowledge construction and self-regulated learning, as well as their beliefs regarding their own (in)ability to learn and motivation to learn. Two hypothesized models were tested within 98 psychology students, using a structural equation modelling approach: The first model implemented regulation and processing variables of the Inventory of Learning Styles [ILS, Vermunt (Learning styles and regulation of learning in higher education - towards process-oriented instruction in autonomous thinking, 1992)], the second model of the Motivated Strategies for Learning Questionnaire [MSLQ, Pintrich and de Groot (Journal of Educational Psychology, 82, 33-40, 1990)]. Results showed that structural relations exist between conceptions of constructivist learning and regulation and processing strategies. Furthermore, students who express doubt with regard to their own learning capacities are at risk for adopting an inadequate regulation strategy. A three-tiered structure of conceptual, controlling, and operational level appeared valid for the MSLQ variables, but not entirely for those of the ILS

C–O–H–S fluids and granitic magma : how S partitions and modifies CO2 concentrations of fluid-saturated felsic melt at 200 MPa

Author Posting. © The Author(s), 2011. This is the author's version of the work. It is posted here by permission of Springer for personal use, not for redistribution. The definitive version was published in Contributions to Mineralogy and Petrology 162 (2011): 849-865, doi:10.1007/s00410-011-0628-1.Hydrothermal volatile-solubility and partitioning experiments were conducted with fluid-saturated haplogranitic melt, H2O, CO2, and S in an internally heated pressure vessel at 900°C and 200 MPa; three additional experiments were conducted with iron-bearing melt. The run-product glasses were analyzed by electron microprobe, FTIR, and SIMS; and they contain ≤ 0.12 wt% S, ≤ 0.097 wt.% CO2, and ≤ 6.4 wt.% H2O. Apparent values of log ƒO2 for the experiments at run conditions were computed from the [(S6+)/(S6++S2-)] ratio of the glasses, and they range from NNO-0.4 to NNO+1.4. The C-O-H-S fluid compositions at run conditions were computed by mass balance, and they contained 22-99 mol% H2O, 0-78 mol% CO2, 0-12 mol% S, and < 3 wt% alkalis. Eight S-free experiments were conducted to determine the H2O and CO2 concentrations of melt and fluid compositions and to compare them with prior experimental results for C-O-H fluid-saturated rhyolite melt, and the agreement is excellent. Sulfur partitions very strongly in favor of fluid in all experiments, and the presence of S modifies the fluid compositions, and hence, the CO2 solubilities in coexisting felsic melt. The square of the mole fraction of H2O in melt increases in a linear fashion, from 0.05-0.25, with the H2O concentration of the fluid. The mole fraction of CO2 in melt increases linearly, from 0.0003-0.0045, with the CO2 concentration of C-O-H-S fluids. Interestingly, the CO2 concentration in melts, involving relatively reduced runs (log ƒO2 ≤ NNO+0.3) that contain 2.5-7 mol% S in the fluid, decreases significantly with increasing S in the system. This response to the changing fluid composition causes the H2O and CO2 solubility curve for C-O-H-S fluid-saturated haplogranitic melts at 200 MPa to shift to values near that modeled for C-O-H fluid-saturated, S-free rhyolite melt at 150 MPa. The concentration of S in haplogranitic melt increases in a linear fashion with increasing S in C-O-H-S fluids, but these data show significant dispersion that likely reflects the strong influence of ƒO2 on S speciation in melt and fluid. Importantly, the partitioning of S between fluid and melt does not vary with the (H2O/H2O+CO2) ratio of the fluid. The fluid-melt partition coefficients for H2O, CO2, and S and the atomic (C/S) ratios of the run-product fluids are virtually identical to thermodynamic constraints on volatile partitioning and the H, S, and C contents of pre-eruptive magmatic fluids and volcanic gases for subduction-related magmatic systems thus confirming our experiments are relevant to natural eruptive systems.This research was supported in part by National Science Foundation awards EAR 0308866 and EAR-0836741 to J.D.W

The clinical features of the piriformis syndrome: a systematic review

Piriformis syndrome, sciatica caused by compression of the sciatic nerve by the piriformis muscle, has been described for over 70 years; yet, it remains controversial. The literature consists mainly of case series and narrative reviews. The objectives of the study were: first, to make the best use of existing evidence to estimate the frequencies of clinical features in patients reported to have PS; second, to identify future research questions. A systematic review was conducted of any study type that reported extractable data relevant to diagnosis. The search included all studies up to 1 March 2008 in four databases: AMED, CINAHL, Embase and Medline. Screening, data extraction and analysis were all performed independently by two reviewers. A total of 55 studies were included: 51 individual and 3 aggregated data studies, and 1 combined study. The most common features found were: buttock pain, external tenderness over the greater sciatic notch, aggravation of the pain through sitting and augmentation of the pain with manoeuvres that increase piriformis muscle tension. Future research could start with comparing the frequencies of these features in sciatica patients with and without disc herniation or spinal stenosis

Moral Dilemmas for Artificial Intelligence: a position paper on an application of Compositional Quantum Cognition

Traditionally, the way one evaluates the performance of an Artificial Intelligence (AI) system is via a comparison to human performance in specific tasks, treating humans as a reference for high-level cognition. However, these comparisons leave out important features of human intelligence: the capability to transfer knowledge and make complex decisions based on emotional and rational reasoning. These decisions are influenced by current inferences as well as prior experiences, making the decision process strongly subjective and apparently biased. In this context, a definition of compositional intelligence is necessary to incorporate these features in future AI tests. Here, a concrete implementation of this will be suggested, using recent developments in quantum cognition, natural language and compositional meaning of sentences, thanks to categorical compositional models of meaning.Comment: 15 pages, 3 figures, Conference paper at Quantum Interaction 2018, Nice, France. Published in Lecture Notes in Computer Science, vol 11690, Springer, Cham. Online ISBN 978-3-030-35895-

Retrotransposon vectors for gene delivery in plants

<p>Abstract</p> <p>Background</p> <p>Retrotransposons are abundant components of plant genomes, and although some plant retrotransposons have been used as insertional mutagens, these mobile genetic elements have not been widely exploited for plant genome manipulation. In vertebrates and yeast, retrotransposons and retroviruses are routinely altered to carry additional genes that are copied into complementary (c)DNA through reverse transcription. Integration of cDNA results in gene delivery; recombination of cDNA with homologous chromosomal sequences can create targeted gene modifications. Plant retrotransposon-based vectors, therefore, may provide new opportunities for plant genome engineering.</p> <p>Results</p> <p>A retrotransposon vector system was developed for gene delivery in plants based on the Tnt1 element from <it>Nicotiana tabacum</it>. Mini-Tnt1 transfer vectors were constructed that lack coding sequences yet retain the 5' and 3' long terminal repeats (LTRs) and adjacent <it>cis </it>sequences required for reverse transcription. The internal coding region of Tnt1 was replaced with a neomycin phosphotransferase gene to monitor replication by reverse transcription. Two different mini-Tnt1 s were developed: one with the native 5' LTR and the other with a chimeric 5' LTR that had the first 233 bp replaced by the CaMV 35 S promoter. After transfer into tobacco protoplasts, both vectors undergo retrotransposition using GAG and POL proteins provided in <it>trans </it>by endogenous Tnt1 elements. The transposition frequencies of mini-Tnt1 vectors are comparable with native Tnt1 elements, and like the native elements, insertion sites are within or near coding sequences. In this paper, we provide evidence that template switching occurs during mini-Tnt1 reverse transcription, indicating that multiple copies of Tnt1 mRNA are packaged into virus-like particles.</p> <p>Conclusions</p> <p>Our data demonstrate that mini-Tnt1 vectors can replicate efficiently in tobacco cells using GAG and POL proteins provided in <it>trans </it>by native Tnt1 elements. This suggests that helper Tnt1 constructs can be developed to enable a Tnt1-based two-component vector system that could be used in other plant species. Such a vector system may prove useful for gene delivery or the production of cDNA that can serve as a donor molecule for gene modification through homologous recombination.</p