Quantum-enhanced reinforcement learning for finite-episode games with discrete state spaces

Quantum annealing algorithms belong to the class of metaheuristic tools, applicable for solving binary optimization problems. Hardware implementations of quantum annealing, such as the quantum annealing machines produced by D-Wave Systems, have been subject to multiple analyses in research, with the aim of characterizing the technology's usefulness for optimization and sampling tasks. Here, we present a way to partially embed both Monte Carlo policy iteration for finding an optimal policy on random observations, as well as how to embed (n) sub-optimal state-value functions for approximating an improved state-value function given a policy for finite horizon games with discrete state spaces on a D-Wave 2000Q quantum processing unit (QPU). We explain how both problems can be expressed as a quadratic unconstrained binary optimization (QUBO) problem, and show that quantum-enhanced Monte Carlo policy evaluation allows for finding equivalent or better state-value functions for a given policy with the same number episodes compared to a purely classical Monte Carlo algorithm. Additionally, we describe a quantum-classical policy learning algorithm. Our first and foremost aim is to explain how to represent and solve parts of these problems with the help of the QPU, and not to prove supremacy over every existing classical policy evaluation algorithm.Comment: 17 pages, 7 figure

Exon Array Analysis using re-defined probe sets results in reliable identification of alternatively spliced genes in non-small cell lung cancer

<p>Abstract</p> <p>Background</p> <p>Treatment of non-small cell lung cancer with novel targeted therapies is a major unmet clinical need. Alternative splicing is a mechanism which generates diverse protein products and is of functional relevance in cancer.</p> <p>Results</p> <p>In this study, a genome-wide analysis of the alteration of splicing patterns between lung cancer and normal lung tissue was performed. We generated an exon array data set derived from matched pairs of lung cancer and normal lung tissue including both the adenocarcinoma and the squamous cell carcinoma subtypes. An enhanced workflow was developed to reliably detect differential splicing in an exon array data set. In total, 330 genes were found to be differentially spliced in non-small cell lung cancer compared to normal lung tissue. Microarray findings were validated with independent laboratory methods for <it>CLSTN1</it>, <it>FN1</it>, <it>KIAA1217</it>, <it>MYO18A</it>, <it>NCOR2</it>, <it>NUMB</it>, <it>SLK</it>, <it>SYNE2</it>, <it>TPM1</it>, (in total, 10 events) and <it>ADD3</it>, which was analysed in depth. We achieved a high validation rate of 69%. Evidence was found that the activity of FOX2, the splicing factor shown to cause cancer-specific splicing patterns in breast and ovarian cancer, is not altered at the transcript level in several cancer types including lung cancer.</p> <p>Conclusions</p> <p>This study demonstrates how alternatively spliced genes can reliably be identified in a cancer data set. Our findings underline that key processes of cancer progression in NSCLC are affected by alternative splicing, which can be exploited in the search for novel targeted therapies.</p

ProfilPASS für junge Menschen: Einsatz in der Schule

ProfilPASS for young adults is a scientifically supported tool for determining and documenting personal competences. The students can effectively utilise the competences determined with the ProfilPASS for young adults for choosing a profession, provided the system has been integrated in the scholastic counselling and guidance concept and is sufficiently supported by qualified ProfilPASS advisory personnel. ProfilPASS has to date been implemented at schools in the Saarland region and as part of a model project across the Federal Republic in support of vocational orientation. The practical handbook contains theoretical and conceptional basics for working with ProfilPASS at schools. Successful implementation examples demonstrate the concept. Specific recommendations for action aimed at teachers for vocational orientation at secondary schools.Der ProfilPASS für junge Menschen ist ein wissenschaftlich begleitetes Instrument zur Kompetenzermittlung und -dokumentation. Die Schülerinnen und Schüler können die Kompetenzermittlung mit dem ProfilPASS für junge Menschen effektiv für ihre Berufswahl nutzen, wenn das System in das schulische Berufsorientierungskonzept eingebettet ist und durch qualifiziertes ProfilPASS-Beratungspersonal begleitet wird. Der ProfilPASS wird bereits an den Schulen im Saarland und bundesweit in Modellprojekten bei der Berufsorientierung eingesetzt. Das Praxisbuch enthält die theoretischen und konzeptionellen Grundlagen für die Arbeit mit dem ProfilPASS an Schulen. Erprobte Umsetzungsbeispiele veranschaulichen das Konzept. Konkrete Handlungsempfehlungen für den Einsatz richten sich an Lehrerinnen und Lehrer für Berufsvorbereitung an allgemeinbildenden Schulen

Exposure assessment of process-related contaminants in food by biomarker monitoring

Exposure assessment is a fundamental part of the risk assessment paradigm, but can often present a number of challenges and uncertainties. This is especially the case for process contaminants formed during the processing, e.g. heating of food, since they are in part highly reactive and/or volatile, thus making exposure assessment by analysing contents in food unreliable. New approaches are therefore required to accurately assess consumer exposure and thus better inform the risk assessment. Such novel approaches may include the use of biomarkers, physiologically based kinetic (PBK) modelling-facilitated reverse dosimetry, and/or duplicate diet studies. This review focuses on the state of the art with respect to the use of biomarkers of exposure for the process contaminants acrylamide, 3-MCPD esters, glycidyl esters, furan and acrolein. From the overview presented, it becomes clear that the field of assessing human exposure to process-related contaminants in food by biomarker monitoring is promising and strongly developing. The current state of the art as well as the existing data gaps and challenges for the future were defined. They include (1) using PBK modelling and duplicate diet studies to establish, preferably in humans, correlations between external exposure and biomarkers; (2) elucidation of the possible endogenous formation of the process-related contaminants and the resulting biomarker levels; (3) the influence of inter-individual variations and how to include that in the biomarker-based exposure predictions; (4) the correction for confounding factors; (5) the value of the different biomarkers in relation to exposure scenario’s and risk assessment, and (6) the possibilities of novel methodologies. In spite of these challenges it can be concluded that biomarker-based exposure assessment provides a unique opportunity to more accurately assess consumer exposure to process-related contaminants in food and thus to better inform risk assessment

Resposta do trigo e soja após a aplicação de doses de gesso agrícola

A aplicação de gesso agrícola confere melhores condições na camada subsuperficial do solo, atuando como condicionador, proporcionando benefícios ao desenvolvimento radicular e produtividade de grãos das culturas. Nesse sentido, o objetivo do presente trabalho foi avaliar o efeito de doses de gesso agrícola sobre os parâmetros produtivos das culturas do trigo e da soja em sistema de plantio direto. O experimento foi implantado em 2018, na Estação Experimental da Copagril, pertencente a Cooperativa Agroindustrial Copagril, no município de Marechal Cândido Rondon – PR, em Latossolo Vermelho Eutroférrico de boa fertilidade natural. O delineamento experimental utilizado foi o de blocos casualizados, os tratamentos foram constituídos por seis doses de gesso (0, 600, 1200, 2400, 4800, 9600 kg ha-1), com quatro repetições. Em maio de 2018 foi semeada a cultura do trigo e avaliadas as características agronômicas (número de perfilhos, altura, comprimento de espiga, número de espiguetas e de grãos por espiga, massa de 1000 grãos e produtividade) e em setembro, foi implantada a cultura da soja, e avaliada as características agronômicas (estande de plantas, altura, número de vagens por planta, número de grãos por vagem, diâmetro do caule, massa de 1000 grãos e produtividade). Para o trigo a dose de 4800 kg ha-1 produziu 6,42% e na soja a dose de 2400 kg ha-1 de gesso produziu 6,66% a mais ambas em relação a testemunha, contudo sem diferenças significativas entre os tratamentos, em condição de solos sem limitações químicas (teores altos de Ca e baixos teores de Al na camada subsuperfial)

Challenges in quantifying changes in the global water cycle

Human influences have likely already impacted the large-scale water cycle but natural variability and observational uncertainty are substantial. It is essential to maintain and improve observational capabilities to better characterize changes. Understanding observed changes to the global water cycle is key to predicting future climate changes and their impacts. While many datasets document crucial variables such as precipitation, ocean salinity, runoff, and humidity, most are uncertain for determining long-term changes. In situ networks provide long time-series over land but are sparse in many regions, particularly the tropics. Satellite and reanalysis datasets provide global coverage, but their long-term stability is lacking. However, comparisons of changes among related variables can give insights into the robustness of observed changes. For example, ocean salinity, interpreted with an understanding of ocean processes, can help cross-validate precipitation. Observational evidence for human influences on the water cycle is emerging, but uncertainties resulting from internal variability and observational errors are too large to determine whether the observed and simulated changes are consistent. Improvements to the in situ and satellite observing networks that monitor the changing water cycle are required, yet continued data coverage is threatened by funding reductions. Uncertainty both in the role of anthropogenic aerosols, and due to large climate variability presently limits confidence in attribution of observed changes

The federal government commissioner for patient issues in Germany: initial analysis of the user inquiries

BACKGROUND: The political objective in many countries worldwide is to give better consideration to the interests of patients within the health system. The establishment of a federal government commissioner for the issues of patients in the health system in Germany in 2004 is part of these endeavours. The structure and field of activities of this institution has been unique so far. This study investigates for the first time the inquiries the commissioner receives from the public. METHODS: A 33% sampling (n = 850) of the written inquiries (correspondence and e-mails) addressed to the commissioner in the first six months of the year 2005 (n = 2580) was investigated. In a procedure comprising combined qualitative and quantitative levels, the material was thematically encoded and the inquiries allocated to the resulting categories (multiple nominations). The results are presented in descriptive form and investigated especially with respect to sex and age-specific differences. The interdependences between the categorized criteria are analysed. RESULTS: The inquirers are equally spread out amongst the sexes (49% women, 51% men). Older persons outweigh the younger (69% over 60 years). In most cases the issues take the form of claims (72%, n = 609). In every fifth inquiry (n = 168) the personal financial burden for health services is considered as being too high; about equally high (n = 159) is the proportion of persons who criticize the communication with health professionals, especially hospitals and doctors' surgeries. Every third who mentions a medical practice uses terms such as "uncertainty" and "anxiety". It is conspicuous that men more often than women write that they feel unfairly treated in the health system (62% vs. 38%, p < 0.05). CONCLUSION: Predominantly older persons seek the assistance of the federal government commissioner for patient issues. Considerable uncertainty and anxiety with respect to services and charges within the system of the German health insurances become evident. It is not possible from the data to draw conclusions concerning the impact of the commissioner's work on the health system. Nor do we gain any knowledge about the usefulness of the service for the individual. Therefore, evaluation of the political impact and the user satisfaction should follow

Causes of Robust Seasonal Land Precipitation Changes

Historical simulations from phase 5 of the Coupled Model Intercomparison Project (CMIP5) archive are used to calculate the zonal-mean change in seasonal land precipitation for the second half of the twentieth century in response to a range of external forcings, including anthropogenic and natural forcings combined (ALL), greenhouse gas forcing, anthropogenic aerosol forcing, anthropogenic forcings combined, and natural forcing. These simulated patterns of change are used as fingerprints in a detection and attribution study applied to four different gridded observational datasets of global land precipitation from 1951 to 2005. There are large differences in the spatial and temporal coverage in the observational datasets. Yet despite these differences, the zonal-mean patterns of change are mostly consistent except at latitudes where spatial coverage is limited. The results show some differences between datasets, but the influence of external forcings is robustly detected in March-May, December-February, and for annual changes for the three datasets more suitable for studying changes. For June-August and September-November, external forcing is only detected for the dataset that includes only long-term stations. Fingerprints for combinations of forcings that include the effect of greenhouse gases are similarly detectable to those for ALL forcings, suggesting that greenhouse gas influence drives the detectable features of the ALL forcing fingerprint. Fingerprints of only natural or only anthropogenic aerosol forcing are not detected. This, together with two-fingerprint results, suggests that at least some of the detected change in zonal land precipitation can be attributed to human influences

US Cosmic Visions: New Ideas in Dark Matter 2017: Community Report

This white paper summarizes the workshop "U.S. Cosmic Visions: New Ideas in Dark Matter" held at University of Maryland on March 23-25, 2017.Comment: 102 pages + reference

First narrow-band search for continuous gravitational waves from known pulsars in advanced detector data

Spinning neutron stars asymmetric with respect to their rotation axis are potential sources of continuous gravitational waves for ground-based interferometric detectors. In the case of known pulsars a fully coherent search, based on matched filtering, which uses the position and rotational parameters obtained from electromagnetic observations, can be carried out. Matched filtering maximizes the signalto- noise (SNR) ratio, but a large sensitivity loss is expected in case of even a very small mismatch between the assumed and the true signal parameters. For this reason, narrow-band analysis methods have been developed, allowing a fully coherent search for gravitational waves from known pulsars over a fraction of a hertz and several spin-down values. In this paper we describe a narrow-band search of 11 pulsars using data from Advanced LIGO’s first observing run. Although we have found several initial outliers, further studies show no significant evidence for the presence of a gravitational wave signal. Finally, we have placed upper limits on the signal strain amplitude lower than the spin-down limit for 5 of the 11 targets over the bands searched; in the case of J1813-1749 the spin-down limit has been beaten for the first time. For an additional 3 targets, the median upper limit across the search bands is below the spin-down limit. This is the most sensitive narrow-band search for continuous gravitational waves carried out so far