Representation Discovery for Kernel-Based Reinforcement Learning

Recent years have seen increased interest in non-parametric reinforcement learning. There are now practical kernel-based algorithms for approximating value functions; however, kernel regression requires that the underlying function being approximated be smooth on its domain. Few problems of interest satisfy this requirement in their natural representation. In this paper we define Value-Consistent Pseudometric (VCPM), the distance function corresponding to a transformation of the domain into a space where the target function is maximally smooth and thus well-approximated by kernel regression. We then present DKBRL, an iterative batch RL algorithm interleaving steps of Kernel-Based Reinforcement Learning and distance metric adjustment. We evaluate its performance on Acrobot and PinBall, continuous-space reinforcement learning domains with discontinuous value functions

LIMS: Livestock Information Management System - Introductory guide

This introductory guide has been written to facilitate the use of the LIMS (Livestock Information Management System) package, details of which are given in the system documentation manual. The LIMS system was based on the experience gained from IDEAS (ILCA's Data Entry and Analysis System) a software package designed for the management of animal performance data. This guide takes the reader through the entire features of the LIMS software using sample data sets. The user is most likely to gain if the manual is read while performing the suggested tasks

Computer simulations of hard pear-shaped particles

We report results obtained from Monte Carlo simulations investi- gating mesophase formation in two model systems of hard pear-shaped particles. The first model considered is a hard variant of the trun- cated Stone-Expansion model previously shown to form nematic and smectic mesophases when embedded within a 12-6 Gay-Berne-like po- tential [1]. When stripped of its attractive interactions, however, this system is found to lose its liquid crystalline phases. For particles of length to breadth ratio k = 3, glassy behaviour is seen at high pressures, whereas for k = 5 several bi-layer-like domains are seen, with high intradomain order but little interdomain orientational correlation. For the second model, which uses a parametric shape parameter based on the generalised Gay-Berne formalism, results are presented for particles with elongation k = 3; 4 and 5. Here, the systems with k = 3 and 4 fail to display orientationally ordered phases, but that with k = 5 shows isotropic, nematic and, unusually for a hard-particle model, interdigitated smectic A2 phases.</p

Association between rectal gonorrhoea and HIV incidence in men who have sex with men: a meta-analysis

Background: Incidence of rectal gonorrhoea (GC) has been hypothesised as a correlate of HIV exposure in prevention trials of men who have sex with men (MSM). High rectal GC incidence in MSM trials of new biomedical prevention drugs may provide supportive evidence for ongoing HIV risk. Empirical evidence of correlation between rectal GC and HIV incidence is needed to assess whether high rectal GC rates reliably correlate with high risk of HIV. // Methods: Rectal GC and HIV are routinely tested in sexual health clinics (SHCs) throughout England. Through routine surveillance data collected at visits to SHCs, we assessed HIV incidence and new rectal GC diagnoses in repeat visits by HIV-negative MSM between 2011 and 2018, predating widespread roll-out of pre-exposure prophylaxis. Meta-analysis regression assessed population-level association between HIV and rectal GC incidence over time. // Findings: Between 2011 and 2018, HIV and rectal GC incidence was assessed in 541 056 HIV-negative MSM attending SHCs in England. HIV incidence among MSM attending SHCs fell from 1.26/100 person-years (PYs) in 2011 to 0.28/100 PYs in 2018. Rectal GC rates increased from 3.5/100 PYs to 11.1/100 PYs over the same period. The rate of HIV incidence decreased by 22.3% for each percent increase in rectal GC (95% CI –30.8 to –14.7, p<0.001). // Interpretation: Among the population of MSM attending SHCs in England, rectal GC rates increased substantially while HIV incidence rates decreased between 2011 and 2018. HIV incidence likely decreased through expanded HIV testing, prompt antiretroviral treatment (ART) initiation and increased viral suppression in persons living with HIV, interventions that did not decrease rectal GC. Rectal GC may not be an ideal proxy for HIV incidence in trials, as HIV exposure risk is complex and context dependent, given effective HIV prevention interventions in MSM

Topological transition in a two-dimensional model of liquid crystal

Simulations of nematic-isotropic transition of liquid crystals in two dimensions are performed using an O(2) vector model characterised by non linear nearest neighbour spin interaction governed by the fourth Legendre polynomial $P\_4$. The system is studied through standard Finite-Size Scaling and conformal rescaling of density profiles of correlation functions. A topological transition between a paramagnetic phase at high temperature and a critical phase at low temperature is observed. The low temperature limit is discussed in the spin wave approximation and confirms the numerical results

Application of Hansch’s Model to Capsaicinoids and Capsinoids: A Study Using the Quantitative Structure−Activity Relationship. A Novel Method for the Synthesis of Capsinoids

We describe a synthetic approach for two families of compounds, the capsaicinoids and capsinoids, as part of a study of the quantitative relationship between structure and activity

IoT monitoring of water consumption for irrigation systems using SEMMA methodology

The efficient use of water is an issue that has captured the attention of scientists, technicians, and the community at large. The sustainability of water resources has been threatened by the current imbalance between water supply and demand. Intelligent consumption of water would contribute to the balance and reduce the waste in applications such as the agriculture. This paper shows the design of a water consumption monitoring system based on the Internet of Things (IoT). With the implementation of this system could be known in real time the consumption of water in a crop. In addition, the user of the system may take corrective actions that optimize their water consumption; this is achieved by applying the SEMMA methodology to evaluate the data obtained by the system using two cluster algorithms, Simple K-means and GenClus++. With the application of SEMMA it was possible to determine periods of water consumption that were considered as waste in the irrigation of crops, applying data analysis with both algorithms

Accuracy of optical spectroscopy for the detection of cervical intraepithelial neoplasia without colposcopic tissue information; a step toward automation for low resource settings

Optical spectroscopy has been proposed as an accurate and low-cost alternative for detection of cervical intraepithelial neoplasia. We previously published an algorithm using optical spectroscopy as an adjunct to colposcopy and found good accuracy (sensitivity ¼ 1.00 [95% confidence interval ðCIÞ ¼ 0.92 to 1.00], specificity ¼ 0.71 [95% CI ¼ 0.62 to 0.79]). Those results used measurements taken by expert colposcopists as well as the colposcopy diagnosis. In this study, we trained and tested an algorithm for the detection of cervical intraepithelial neoplasia (i.e., identifying those patients who had histology reading CIN 2 or worse) that did not include the colposcopic diagnosis. Furthermore, we explored the interaction between spectroscopy and colposcopy, examining the importance of probe placement expertise. The colposcopic diagnosis-independent spectroscopy algorithm had a sensitivity of 0.98 (95% CI ¼ 0.89 to 1.00) and a specificity of 0.62 (95% CI ¼ 0.52 to 0.71). The difference in the partial area under the ROC curves between spectroscopy with and without the colposcopic diagnosis was statistically significant at the patient level (p ¼ 0.05) but not the site level (p ¼ 0.13). The results suggest that the device has high accuracy over a wide range of provider accuracy and hence could plausibly be implemented by providers with limited training

Iron deficiency anemia is not a rare problem among women of reproductive ages in Ethiopia: a community based cross sectional study

<p>Abstract</p> <p>Background</p> <p>In Ethiopia, the existence of iron deficiency anemia is controversial despite the fact that Ethiopia is one of the least developed in Africa with a high burden of nutrient deficiencies.</p> <p>Methods</p> <p>The first large nutrition study of a representative sample of women in Ethiopia was conducted from June to July 2005 and a systematically selected sub-sample of 970 of these subjects, 15 to 49 years old, were used in this analysis of nutritional anemia. Hemoglobin was measured from capillary blood using a portable HemoCue photometer. For serum ferritin, venous blood from antecubital veins was measured by an automated Elecsys 1020 using commercial kits. Diets were assessed via simplified food frequency questionnaire. The association of anemia to demographic and health variables was tested by chi-square and a stepwise backward logistic regression model was applied to test the significant associations observed in chi square tests.</p> <p>Results</p> <p>Mean hemoglobin ± SD was 11.5 ± 2.1 g/dL with a 29.4% prevalence of anemia. Mean serum ferritin was 58 ± 41.1 ug/L with a 32.1% prevalence of iron deficiency. The overall prevalence rate of iron deficiency anemia was 18.0%. Prevalence of anemia, iron deficiency, and iron deficiency anemia was highest among those 31-49 years old (p < 0.05). Intake of vegetables less than once a day and meat less than once a week was common and was associated with increased anemia (p = 0.001). Although the prevalence of anemia was slightly higher among women with parasitic infestation the difference was not significant (p = 0.9). Nonetheless, anemia was significantly higher in women with history of illness and the association was retained even when the variable was adjusted for its confounding effect in the logistic regression models (AOR = 0.3; 95%CI = 0.17 to 0.5) signifying that the most probable causes of anemia is nutrition related and to some extent chronic illnesses.</p> <p>Conclusion</p> <p>Moderate nutritional anemia in the form of iron deficiency anemia is a problem in Ethiopia and therefore, the need for improved supplementation to vulnerable groups is warranted to achieve the United Nation's Millennium Development Goals. Chronic illnesses are another important cause of anemia.</p