RLBOA: A modular reinforcement learning framework for autonomous negotiating agents

Negotiation is a complex problem, in which the variety of settings and opponents that may be encountered prohibits the use of a single predefined negotiation strategy. Hence the agent should be able to learn such a strategy autonomously. To this end we propose RLBOA, a modular framework that facilitates the creation of autonomous negotiation agents using reinforcement learning. The framework allows for the creation of agents that are capable of negotiating effectively in many different scenarios. To be able to cope with the large size of the state and action spaces and diversity of settings, we leverage the modular BOA-framework. This decouples the negotiation strategy into a Bidding strategy, an Opponent model and an Acceptance condition. Furthermore, we map the multidimensional contract space onto the utility axis which enables a compact and generic state and action description. We demonstrate the value of the RLBOA framework by implementing an agent that uses tabular Q-learning on the compressed state and action space to learn a bidding strategy.We show that the resulting agent is able to learn well-performing bidding strategies in a range of negotiation settings and is able to generalize across opponents and domains

Inequities in treatments and outcomes among patients hospitalized with hypertrophic cardiomyopathy in the United States

Background Hypertrophic cardiomyopathy (HCM) is the most common heritable cardiac disease. In small studies, sociodemographic factors have been associated with disparities in septal reduction therapy, but little is known about the association of sociodemographic factors with HCM treatments and outcomes more broadly. Methods and Results Using the National Inpatient Survey from 2012 to 2018, HCM diagnoses and procedures were identified b

Osteoconductive protamine-based polyelectrolyte multilayer functionalized surfaces

The integration of orthopedic implants with host bone presents a major challenge in joint arthroplasty, spinal fusion and tumor reconstruction. The cellular microenvironment can be programmed via implant surface functionalization allowing direct modulation of osteoblast adhesion, proliferation, and differentiation at the implant–bone interface. The development of layer-by-layer assembled polyelectrolyte multilayer (PEM) architectures has greatly expanded our ability to fabricate intricate nanometer to micron scale thin film coatings that conform to complex implant geometries. The in vivo therapeutic efficacy of thin PEM implant coatings for numerous biomedical applications has previously been reported. We have fabricated protamine-based PEM thin films that support the long-term proliferation and differentiation of pre-osteoblast cells on non-cross-linked film-coated surfaces. These hydrophilic PEM functionalized surfaces with nanometer-scale roughness facilitated increased deposition of calcified matrix by osteoblasts in vitro, and thus offer the potential to enhance implant integration with host bone. The coatings can make an immediate impact in the osteogenic culture of stem cells and assessment of the osteogenic potential of new therapeutic factors.National Institutes of Health (U.S.) (National Institute on Aging Grant 5R01AG029601)National Science Foundation (U.S.). Graduate Research Fellowshi

Chalcophile element processing beneath a continental arc stratovolcano

The chalcophile elements are important both in terms of their economic value and as potential tracers of magmatic processes at convergent margins. However, because of analytical difficulties, comprehensive datasets of chalcophile element concentrations for volcanic rocks are rare. Here, we present analyses of a near complete suite of chalcophile elements (S, Cu, Ag, Se, As, Sb, Sn, W, Mo, Pb, Bi, Tl, Zn, Ga, Co) for volcanic rock samples collected from a typical continental arc stratovolcano in southern Chile (Antuco). Enrichment in Pb, Bi, W, Tl, Sb and As relative to Parental-MORB indicates that these elements have been mobilised from the subducting slab into the sub-arc mantle wedge, in contrast to Cu and Ag. Very low Se concentrations suggest that Se, like S, was lost during co-eruptive degassing of the Antuco magmas. Previous studies on oceanic arcs have demonstrated that as higher fO2 subduction-related magmas ascend through the overlying lithosphere, magnetite fractionation may trigger sulfide fractionation during crystallisation. If such a process is extensive and has a sharp onset, this would result in a plummet in the Cu, Se and Ag contents of the residual melt. At Antuco, although a decrease in the Fe2O3(T) and TiO2 concentrations at ∼55 wt.% SiO2 (∼3 wt.% MgO) indicates magnetite fractionation, this is not associated with a corresponding drop in Cu contents. Instead, we observe a general decrease in Cu and a decrease in Cu/Ag with increasing SiO2 and decreasing MgO. Furthermore, Cu/Ag in the most primitive Antuco rocks are lower than the global MORB array, indicating that the melts were sulfide saturated at an early stage in their crustal evolution. Through modelling fractional crystallisation, we show that only a minor volume (0.5–0.6 vol.%) of fractionating sulfide is needed to produce divergent trends in Cu and Ag, as observed in the Antuco samples. Our results show that sulfide fractionation occurred from an early stage during the crustal evolution of Antuco's magmas. We infer that this was promoted by stalling in the lower crust, which for oxidised magmas at depths >20 km is within the sulfide stability field. However, elevated DyN/YbN of the Antuco magmas compared to oceanic island arc magmas provides an additional, or alternate mechanism to inducing sulfide fractionation in the lower crust prior to ascent, through initial garnet fractionation. Fractional crystallisation within this depth range meant that later magnetite fractionation had only a minor impact on the partitioning behaviour of the chalcophile elements. In contrast, arc magmas transiting thinner crust may not experience sulfide saturation until a later stage in their evolution, induced by magnetite fractionation. Our results imply that convergent margin crustal thickness, and therefore the depth range of magmatic differentiation, determines the dominant control on initial magmatic sulfide saturation and therefore the primary distribution of chalcophile elements. This implies that secondary processes are required to explain the transport and concentration of sulfides and chalcophile elements at shallower crustal levels

Confirmation and Keplerian motion of the gap-carving protoplanet HD 169142 b

We present the re-detection of a compact source in the face-on protoplanetary disc surrounding HD 169142, using VLT/SPHERE data in YJH bands. The source is found at a separation of 0.''319 ($\sim$37 au) from the star. Three lines of evidence argue in favour of the signal tracing a protoplanet: (i) it is found in the annular gap separating the two bright rings of the disc, as predicted by theory; (ii) it is moving at the expected Keplerian velocity for an object at $\sim$37 au in the 2015, 2017 and 2019 datasets; (iii) we also detect a spiral-shaped signal whose morphology is consistent with the expected outer spiral wake triggered by a planet in the gap, based on dedicated hydrodynamical simulations of the system. The YJH colours we extracted for the object are consistent with tracing scattered starlight, suggesting that the protoplanet is enshrouded in a significant amount of dust, as expected for a circumplanetary disc or envelope surrounding a gap-clearing Jovian-mass protoplanet.Comment: Accepted for publication in MNRAS Letters. 5 pages, 5 figure

Characterization of herpes simplex virus clinical isolate Y3369 as a glycoprotein G variant and its bearing on virus typing

<p>Abstract</p> <p>Background</p> <p>Herpes simplex viruses exist as two major serotypes, type 1 (HSV-1) and type 2 (HSV-2). Determination of type, either HSV-1 or HSV-2, is important in accurate diagnosis and clinical control of transmission. Several tests are available for typing HSV, including a monoclonal antibody specific for glycoprotein G and several PCR assays.</p> <p>Findings</p> <p>A clinical isolate was identified as herpes simplex virus, but tested negative for both HSV-1 and HSV-2 antigens using type-specific monoclonal antibody assays. The isolate was determined to be HSV-1 by PCR analysis. A mutation which likely caused the monoclonal antibody non-reactivity was found in glycoprotein G. Phylogenetic analysis revealed two groups of HSV, one with the mutation and one without. Three population studies examining mutations in HSV-1 glycoprotein G were analyzed by chi-squared test. To this point, the epitope which the monoclonal antibody recognizes was only found in HSV-1 isolates from human European populations (<it>p </it>< 0.0001).</p> <p>Conclusions</p> <p>These findings suggest that the PCR-based methods for HSV typing may be more useful than the standard monoclonal antibody test in areas of the world where the variant in glycoprotein G is more prevalent.</p

A plug-and-play ratiometric pH-sensing nanoprobe for high-throughput investigation of endosomal escape

An important aspect in the design of nanomaterials for delivery is an understanding of its uptake and ultimate release to the cytosol of target cells. Real-time chemical sensing using a nanoparticle-based platform affords exquisite insight into the trafficking of materials and their cargo into cells. This versatile and tunable technology provides a powerful tool to probe the mechanism of cellular entry and cytosolic delivery of a variety of materials, allowing for a simple and convenient means to screen materials towards efficient delivery of therapeutics such as nucleic acids

Localised heating and intensive magmatic conditions prior to the 22–23 April 2015 Calbuco volcano eruption (Southern Chile)

Calbuco volcano is a Late Pleistocene composite stratovolcano and member of the Southern Volcanic Zone of the Chilean Andes (41°19′S, 72°36′W). It lies ~ 20 km west of the Liquiñe–Ofqui Fault Zone, but is not located directly upon any major regional structures. During April 2015, a sub-Plinian eruption occurred, with a bulk erupted volume of ~ 0.3–0.6 km3 (~ 0.1–0.2 km3 DRE). The eruption was a rapid-onset event that produced highly crystalline products (from 40 to 60 vol.%) including the mineral phases: plagioclase, clinopyroxene, orthopyroxene, amphibole, olivine, apatite, ilmenite, titanomagnetite and chalcopyrite. An upper-crustal reservoir is inferred using available geophysical data combined with amphibole geobarometry. Consideration of textural features, including high crystallinity, complex mineral zonation, crystal clots and interstitial glass between crystals from clots, suggests the presence of a mush zone within this reservoir. From the nine collected samples, whole-rock chemistry and an array of geothermometers (amphibole, amphibole-plagioclase, two-pyroxenes and Fe–Ti oxides) gave similar results for all samples possessing ~ 40 vol.% of crystals, with the exception of the sample Cal-160 (~ 60 vol.% crystallinity), which is slightly more evolved and yields lower temperatures for all geothermometers. By comparing temperatures calculated in sample Cal-160 using pairs of ilmenite-titanomagnetite core compositions with those calculated using rim compositions, we observe a late-stage temperature increase of between 70 and 200 °C. We suggest that this local-scale heating event was at least partly responsible for triggering the eruption. Our data suggest that the bulk of the erupted magma was derived from a relatively uniform (970–1000 °C), crystal-rich magma mass. Sample Cal-160 was derived from a cooler environment (910–970 °C), where it was subjected to pre-eruptive heating to temperatures considerably higher than those observed in associated, erupted magmas (up to 1070 °C). This requires the involvement of a hot, presumably mafic magma injection at the base of a shallow, crystal-rich reservoir, though the mafic magma was not itself erupted. The localised nature of interaction and rapidity of eruption onset have implications for potential future hazards at Calbuco volcano

The relationship between alcohol consumption and dry eye

Purpose: To assess the association between dry eye disease (DED) and alcohol consumption using a large population-based cohort. Methods: 77,145 participants (19-94 years, 59% female) from the Dutch Lifelines cohort were cross-sectionally assessed for DED using the Women's Health Study (WHS) dry eye questionnaire. Alcohol intake was assessed using self-reported food frequency questionnaires. The relationship between DED and alcohol use was analyzed using logistic regression, corrected for age, sex, BMI, smoking status, education, income, and 55 potentially confounding comorbidities. Results: Overall, 30.0% of participants had symptomatic dry eye. Alcohol use significantly increased the risk of symptomatic dry eye in females (odds ratio [OR] 1.095, 95%CI 1.045-1.148), but not in males (OR 0.988, 95%CI 0.900-1.084). Contrarily, in male drinkers, increasing alcohol intake (in 10 g/day) had a protective effect on symptomatic dry eye (OR 0.962, 95%CI 0.934-0.992), which was not seen in females (OR 0.986, 95%CI 0.950-1.023). Alcohol use and intake had a sex-specific effect on all outcomes of DED assessed: symptomatic dry eye, highly symptomatic dry eye, clinical diagnosis, and WHS definition dry eye. Conclusions: This large population-based study found alcohol use to have a clear sex-specific effect on DED, presenting as a risk-factor only in females. This adds to the evidence of sex-specific pathophysiological mechanisms of dry eye and illustrates the importance of sex stratification in studies investigating DED. The mild protective effect of increased alcohol intake in male drinkers is advised to be interpreted with caution, as alcohol's other health effects might be of greater clinical significance