Multi-agent Hierarchical Reinforcement Learning with Dynamic Termination

In a multi-agent system, an agent's optimal policy will typically depend on the policies chosen by others. Therefore, a key issue in multi-agent systems research is that of predicting the behaviours of others, and responding promptly to changes in such behaviours. One obvious possibility is for each agent to broadcast their current intention, for example, the currently executed option in a hierarchical reinforcement learning framework. However, this approach results in inflexibility of agents if options have an extended duration and are dynamic. While adjusting the executed option at each step improves flexibility from a single-agent perspective, frequent changes in options can induce inconsistency between an agent's actual behaviour and its broadcast intention. In order to balance flexibility and predictability, we propose a dynamic termination Bellman equation that allows the agents to flexibly terminate their options. We evaluate our model empirically on a set of multi-agent pursuit and taxi tasks, and show that our agents learn to adapt flexibly across scenarios that require different termination behaviours.Comment: PRICAI 201

Floral temperature and optimal foraging: is heat a feasible floral reward for pollinators?

As well as nutritional rewards, some plants also reward ectothermic pollinators with warmth. Bumble bees have some control over their temperature, but have been shown to forage at warmer flowers when given a choice, suggesting that there is some advantage to them of foraging at warm flowers (such as reducing the energy required to raise their body to flight temperature before leaving the flower). We describe a model that considers how a heat reward affects the foraging behaviour in a thermogenic central-place forager (such as a bumble bee). We show that although the pollinator should spend a longer time on individual flowers if they are warm, the increase in total visit time is likely to be small. The pollinator's net rate of energy gain will be increased by landing on warmer flowers. Therefore, if a plant provides a heat reward, it could reduce the amount of nectar it produces, whilst still providing its pollinator with the same net rate of gain. We suggest how heat rewards may link with plant life history strategies

Effect of oral fluconazole 1200 mg/day on QT interval in African adults with HIV-associated cryptococcal meningitis.

We assessed the effect of fluconazole 1200 mg/day on the QT interval in cryptococcal meningitis patients. Mean corrected QT (QTc) change from baseline to day 7 was 10.1 ms (IQR: -28 to 46 ms) in the fluconazole treatment group and -12.6 ms (IQR: -39 to 13.5 ms) in those not taking fluconazole (P = 0.04). No significant increase in QTc measurements over 500 ms was observed with fluconazole. Nevertheless, it remains important to correct any electrolyte imbalance and avoid concomitant drugs that may increase QTc

Relationship Between Serum NMDA Receptor Antibodies and Response to Antipsychotic Treatment in First-Episode Psychosis

Background: When psychosis develops in NMDA receptor (NMDAR) antibody encephalitis, it usually has an acute or subacute onset, and antipsychotic treatment may be ineffective and associated with adverse effects. Serum NMDAR antibodies have been reported in a minority of patients with first-episode psychosis (FEP), but their role in psychosis onset and response to antipsychotic treatment is unclear. Methods: Sera from 387 patients with FEP (duration of psychosis <2 years, minimally or never treated with antipsychotics) undergoing initial treatment with amisulpride as part of the OPTiMiSE (Optimization of Treatment and Management of Schizophrenia in Europe) trial (ClinicalTrials.gov number NCT01248195) were tested for NMDAR IgG antibodies using a live cell–based assay. Symptom severity was assessed using the Positive and Negative Syndrome Scale and the Clinical Global Impressions Scale at baseline and again after 4 weeks of treatment with amisulpride. Results: At baseline, 15 patients were seropositive for NMDAR antibodies and 372 were seronegative. The seropositive patients had similar symptom profiles and demographic features to seronegative patients but a shorter duration of psychosis (median 1.5 vs. 4.0 months; p =.031). Eleven seropositive and 284 seronegative patients completed 4 weeks of amisulpride treatment: after treatment, there was no between-groups difference in improvement in Positive and Negative Syndrome Scale scores or in the frequency of adverse medication effects. Conclusions: These data suggest that in FEP, NMDAR antibody seropositivity alone is not an indication for using immunotherapy instead of antipsychotic medications. Further studies are required to establish what proportion of patients with FEP who are NMDAR antibody seropositive have coexisting cerebrospinal fluid inflammatory changes or other paraclinical evidence suggestive of a likely benefit from immunotherapy

Understanding childhood asthma in focus groups: perspectives from mothers of different ethnic backgrounds

BACKGROUND: Diagnosing childhood asthma is dependent upon parental symptom reporting but there are problems in the use of words and terms. The purpose of this study was to describe and compare understandings of childhood 'asthma' by mothers from three different ethnic backgrounds who have no personal experience of diagnosing asthma. A better understanding of parents' perceptions of an illness by clinicians should improve communication and management of the illness. METHOD: Sixty-six mothers living in east London describing their ethnic backgrounds as Bangladeshi, white English and black Caribbean were recruited to 9 focus groups. Discussion was semi-structured. Three sessions were conducted with each ethnic group. Mothers were shown a video clip of a boy with audible wheeze and cough and then addressed 6 questions. Sessions were recorded and transcribed verbatim. Responses were compared within and between ethnic groups. RESULTS: Each session, and ethnic group overall, developed a particular orientation to the discussion. Some mothers described the problem using single signs, while others imitated the sound or made comparisons to other illnesses. Hereditary factors were recognised by some, although all groups were concerned with environmental triggers. Responses about what to do included 'normal illness' strategies, use of health services and calls for complementary treatment. All groups were concerned about using medication every day. Expectations about the quality of life were varied, with recognition that restrictions may be based on parental beliefs about asthma, rather than asthma itself. CONCLUSION: Information from these focus groups suggests mothers know a great deal about childhood asthma even though they have no personal experience of it. Knowledge of how mothers from these ethnic backgrounds perceive asthma may facilitate doctor – patient communication with parents of children experiencing breathing difficulties

Effects of an Alpha-4 Integrin Inhibitor on Restenosis in a New Porcine Model Combining Endothelial Denudation and Stent Placement

Restenosis remains the main complication of balloon angioplasty and/or stent implantation. Preclinical testing of new pharmacologic agents preventing restenosis largely rely on porcine models, where restenosis is assessed after endothelial abrasion of the arterial wall or stent implantation. We combined endothelial cell denudation and implantation of stents to develop a new clinically relevant porcine model of restenosis, and used this model to determine the effects of an α4 integrin inhibitor, ELN 457946, on restenosis. Balloon-angioplasty endothelial cell denudation and subsequent implantation of bare metal stents in the left anterior descending coronary, iliac, and left common carotid arteries was performed in domestic pigs, treated with vehicle or ELN 457946, once weekly via subcutaneous injections, for four weeks. After 1 month, histopathology and morphometric analyses of the arteries showed complete healing and robust, consistent restenotic response in stented arteries. Treatment with ELN 457946 resulted in a reduction in the neointimal response, with decreases in area percent stenosis between 12% in coronary arteries and 30% in peripheral vessels. This is the first description of a successful pig model combining endothelial cell denudation and bare metal stent implantation. This new double injury model may prove particularly useful to assess pharmacological effects of drug candidates on restenosis, in coronary and/or peripheral arteries. Furthermore, the ELN 457946 α4 integrin inhibitor, administered subcutaneously, reduced inflammation and restenosis in stented coronary and peripheral arteries in pigs, therefore representing a promising systemic therapeutic approach in reducing restenosis in patients undergoing angioplasty and/or stent implantation

The impact of low erythrocyte density in human blood on the fitness and energetic reserves of the African malaria vector Anopheles gambiae

Background Anaemia is a common health problem in the developing world. This condition is characterized by a reduction in erythrocyte density, primarily from malnutrition and/or infectious diseases such as malaria. As red blood cells are the primary source of protein for haematophagous mosquitoes, any reduction could impede the ability of mosquito vectors to transmit malaria by influencing their fitness or that of the parasites they transmit. The aim of this study was to determine the impact of differences in the density of red blood cells in human blood on malaria vector (Anopheles gambiae sensu stricto) fitness. The hypotheses tested are that mosquito vector energetic reserves and fitness are negatively influenced by reductions in the red cell density of host human blood meals commensurate with those expected from severe anaemia. Methods Mosquitoes (An. gambiae s.s.) were offered blood meals of different packed cell volume(PCV) of human blood consistent with those arising from severe anaemia (15%) and normalPCV (50%). Associations between mosquito energetic reserves (lipid, glucose and glycogen)and fitness measures (reproduction and survival) and blood meal PCV were investigated. Results The amount of protein that malaria vectors acquired from blood feeding (indexed by haematin excretion) was significantly reduced at low blood PCV. However, mosquitoes feeding on blood of low PCV had the same oviposition rates as those feeding on blood of normal PCV, and showed an increase in egg production of around 15%. The long-term survival of An. gambiae s.s was reduced after feeding on low PCV blood, but PCV had no significant impact on the proportion of mosquitoes surviving through the minimal period required to develop and transmit malaria parasites (estimated as 14 days post-blood feeding). The impact of blood PCV on the energetic reserves of mosquitoes was relatively minor. Conclusions These results suggest that feeding on human hosts whose PCV has been depleted due to severe anaemia does not significantly reduce the fitness or transmission potential of malaria vectors, and indicates that mosquitoes may be able exploit resources for reproduction more efficiently from blood of low rather than normal PCV

The effect of prior statin use on 30-day mortality for patients hospitalized with community-acquired pneumonia

BACKGROUND: Recent studies suggest that HMG-CoA reductase inhibitors ("statins") may have beneficial effects for patients at risk for some types of infections. We examined the effect of prior outpatient use of statins on mortality for patients hospitalized with community-acquired pneumonia. METHODS: A retrospective cohort study conducted at two tertiary teaching hospitals. Eligible subjects were admitted with a diagnosis of, had a chest x-ray consistent with, and had a discharge ICD-9 diagnosis of pneumonia. Subjects were excluded if they were "comfort measures only" or transferred from another acute care hospital. Subjects were considered to be on a medication if they were taking it at the time of presentation. RESULTS: Data was abstracted on 787 subjects at the two hospitals. Mortality was 9.2% at 30-days and 13.6% at 90-days. At presentation 52% of subjects were low risk, 34% were moderate risk, and 14% were high risk based on the pneumonia severity index. In the multivariable regression analysis, after adjusting for potential confounders including a propensity score, the use of statins at presentation (odds ratio 0.36, 95% confidence interval 0.14–0.92) was associated with decreased 30-day mortality. DISCUSSION: Prior outpatient statin use was associated with decreased mortality in patients hospitalized with community-acquired pneumonia despite their use being associated with comorbid illnesses likely to contribute to increased mortality. Confirmatory studies are needed, as well as research to determine the mechanism(s) of this protective effect