Tableaux for Policy Synthesis for MDPs with PCTL* Constraints

Markov decision processes (MDPs) are the standard formalism for modelling sequential decision making in stochastic environments. Policy synthesis addresses the problem of how to control or limit the decisions an agent makes so that a given specification is met. In this paper we consider PCTL*, the probabilistic counterpart of CTL*, as the specification language. Because in general the policy synthesis problem for PCTL* is undecidable, we restrict to policies whose execution history memory is finitely bounded a priori. Surprisingly, no algorithm for policy synthesis for this natural and expressive framework has been developed so far. We close this gap and describe a tableau-based algorithm that, given an MDP and a PCTL* specification, derives in a non-deterministic way a system of (possibly nonlinear) equalities and inequalities. The solutions of this system, if any, describe the desired (stochastic) policies. Our main result in this paper is the correctness of our method, i.e., soundness, completeness and termination.Comment: This is a long version of a conference paper published at TABLEAUX 2017. It contains proofs of the main results and fixes a bug. See the footnote on page 1 for detail

On the origin of surface ozone and reactive nitrogen observed at a remote mountain site in the northeastern Qinghai-Tibetan Plateau, western China

Author name used in this publication: Wang, T.Author name used in this publication: Ding, A.Version of RecordPublishe

Molecular assays for antimalarial drug resistance surveillance: A target product profile.

Antimalarial drug resistance is a major constraint for malaria control and elimination efforts. Artemisinin-based combination therapy is now the mainstay for malaria treatment. However, delayed parasite clearance following treatment with artemisinin derivatives has now spread in the Greater Mekong Sub region and may emerge or spread to other malaria endemic regions. This spread is of great concern for malaria control programmes, as no alternatives to artemisinin-based combination therapies are expected to be available in the near future. There is a need to strengthen surveillance systems for early detection and response to the antimalarial drug resistance threat. Current surveillance is mainly done through therapeutic efficacy studies; however these studies are complex and both time- and resource-intensive. For multiple common antimalarials, parasite drug resistance has been correlated with specific genetic mutations, and the molecular markers associated with antimalarial drug resistance offer a simple and powerful tool to monitor the emergence and spread of resistant parasites. Different techniques to analyse molecular markers associated with antimalarial drug resistance are available, each with advantages and disadvantages. However, procedures are not adequately harmonized to facilitate comparisons between sites. Here we describe the target product profiles for tests to analyse molecular markers associated with antimalarial drug resistance, discuss how use of current techniques can be standardised, and identify the requirements for an ideal product that would allow malaria endemic countries to provide useful spatial and temporal information on the spread of resistance

Electronic Origin of High Temperature Superconductivity in Single-Layer FeSe Superconductor

The latest discovery of high temperature superconductivity signature in single-layer FeSe is significant because it is possible to break the superconducting critical temperature ceiling (maximum Tc~55 K) that has been stagnant since the discovery of Fe-based superconductivity in 2008. It also blows the superconductivity community by surprise because such a high Tc is unexpected in FeSe system with the bulk FeSe exhibiting a Tc at only 8 K at ambient pressure which can be enhanced to 38 K under high pressure. The Tc is still unusually high even considering the newly-discovered intercalated FeSe system A_xFe_{2-y}Se_2 (A=K, Cs, Rb and Tl) with a Tc at 32 K at ambient pressure and possible Tc near 48 K under high pressure. Particularly interesting is that such a high temperature superconductivity occurs in a single-layer FeSe system that is considered as a key building block of the Fe-based superconductors. Understanding the origin of high temperature superconductivity in such a strictly two-dimensional FeSe system is crucial to understanding the superconductivity mechanism in Fe-based superconductors in particular, and providing key insights on how to achieve high temperature superconductivity in general. Here we report distinct electronic structure associated with the single-layer FeSe superconductor. Its Fermi surface topology is different from other Fe-based superconductors; it consists only of electron pockets near the zone corner without indication of any Fermi surface around the zone center. Our observation of large and nearly isotropic superconducting gap in this strictly two-dimensional system rules out existence of node in the superconducting gap. These results have provided an unambiguous case that such a unique electronic structure is favorable for realizing high temperature superconductivity

Source of surface ozone and reactive nitrogen speciation at Mount Waliguan in western China : new insights from the 2006 summer study

Author name used in this publication: Xue, L. K.Author name used in this publication: Wang, T.2010-2011 > Academic research: refereed > Publication in refereed journalVersion of RecordPublishe

Semantic Labelling and Learning for Parity Game Solving in LTL Synthesis

We propose "semantic labelling" as a novel ingredient for solving games in the context of LTL synthesis. It exploits recent advances in the automata-based approach, yielding more information for each state of the generated parity game than the game graph can capture. We utilize this extra information to improve standard approaches as follows. (i) Compared to strategy improvement (SI) with random initial strategy, a more informed initialization often yields a winning strategy directly without any computation. (ii) This initialization makes SI also yield smaller solutions. (iii) While Q-learning on the game graph turns out not too efficient, Q-learning with the semantic information becomes competitive to SI. Since already the simplest heuristics achieve significant improvements the experimental results demonstrate the utility of semantic labelling. This extra information opens the door to more advanced learning approaches both for initialization and improvement of strategies

Observation of CR Anisotropy with ARGO-YBJ

The measurement of the anisotropies of cosmic ray arrival direction provides important informations on the propagation mechanisms and on the identification of their sources. In this paper we report the observation of anisotropy regions at different angular scales. In particular, the observation of a possible anisotropy on scales between $\sim$ 10 $^{\circ}$ and $\sim$ 30 $^{\circ}$ suggests the presence of unknown features of the magnetic fields the charged cosmic rays propagate through, as well as potential contributions of nearby sources to the total flux of cosmic rays. Evidence of new weaker few-degree excesses throughout the sky region $195^{\circ}\leq$ R.A. $\leq 315^{\circ}$ is reported for the first time.Comment: Talk given at 12th TAUP Conference 2011, 5-9 September 2011, Munich, German

Anti-plasmodial polyvalent interactions in Artemisia annua L. aqueous extract – possible synergistic and resistance mechanisms

Artemisia annua hot water infusion (tea) has been used in in vitro experiments against P. falciparum malaria parasites to test potency relative to equivalent pure artemisinin. High performance liquid chromatography (HPLC) and mass spectrometric analyses were employed to determine the metabolite profile of tea including the concentrations of artemisinin (47.5±0.8 mg L-1), dihydroartemisinic acid (70.0±0.3 mg L-1), arteannuin B (1.3±0.0 mg L-1), isovitexin (105.0±7.2 mg L-1) and a range of polyphenolic acids. The tea extract, purified compounds from the extract, and the combination of artemisinin with the purified compounds were tested against chloroquine sensitive and chloroquine resistant strains of P. falciparum using the DNA-intercalative SYBR Green I assay. The results of these in vitro tests and of isobologram analyses of combination effects showed mild to strong antagonistic interactions between artemisinin and the compounds (9-epi-artemisinin and artemisitene) extracted from A. annua with significant (IC50 <1 μM) anti-plasmodial activities for the combination range evaluated. Mono-caffeoylquinic acids, tri-caffeoylquinic acid, artemisinic acid and arteannuin B showed additive interaction while rosmarinic acid showed synergistic interaction with artemisinin in the chloroquine sensitive strain at a combination ratio of 1:3 (artemisinin to purified compound). In the chloroquine resistant parasite, using the same ratio, these compounds strongly antagonised artemisinin anti-plasmodial activity with the exception of arteannuin B, which was synergistic. This result would suggest a mechanism targeting parasite resistance defenses for arteannuin B’s potentiation of artemisinin