Applying Semantic Web Services to Bioinformatics Experiences Gained, lessons learnt

We have seen an increasing amount of interest in the application of Semantic Web technologies to Web services. The aim is to support automated discovery and composition of the services allowing seamless and transparent interoperability. In this paper we discuss three projects that are applying such technologies to bioinformatics: MOBY-Services and Semantic-MOBY. Through an examination of the di#erences and similarities between the solutions produced, we highlight some of the practical di#culties in developing Semantic Web services and suggest that the experiences with these projects have implications for the development of Semantic Web services as a whole

Online regret bounds for Markov decision processes with deterministic transitions

Abstract. We consider an upper confidence bound algorithm for Markov decision processes (MDPs) with deterministic transitions. For this algorithm we derive upper bounds on the online regret (with respect to an (ε-)optimal policy) that are logarithmic in the number of steps taken. These bounds also match known asymptotic bounds for the general MDP setting. We also present corresponding lower bounds. As an application, multi-armed bandits with switching cost are considered.