Controlling Level of Unconsciousness by Titrating Propofol with Deep Reinforcement Learning

Reinforcement Learning (RL) can be used to fit a mapping from patient state to a medication regimen. Prior studies have used deterministic and value-based tabular learning to learn a propofol dose from an observed anesthetic state. Deep RL replaces the table with a deep neural network and has been used to learn medication regimens from registry databases. Here we perform the first application of deep RL to closed-loop control of anesthetic dosing in a simulated environment. We use the cross-entropy method to train a deep neural network to map an observed anesthetic state to a probability of infusing a fixed propofol dosage. During testing, we implement a deterministic policy that transforms the probability of infusion to a continuous infusion rate. The model is trained and tested on simulated pharmacokinetic/pharmacodynamic models with randomized parameters to ensure robustness to patient variability. The deep RL agent significantly outperformed a proportional-integral-derivative controller (median absolute performance error 1.7% +/- 0.6 and 3.4% +/- 1.2). Modeling continuous input variables instead of a table affords more robust pattern recognition and utilizes our prior domain knowledge. Deep RL learned a smooth policy with a natural interpretation to data scientists and anesthesia care providers alike.Comment: International Conference on Artificial Intelligence in Medicine 202

Stellar Population Diagnostics of Elliptical Galaxy Formation

Major progress has been achieved in recent years in mapping the properties of passively-evolving, early-type galaxies (ETG) from the local universe all the way to redshift ~2. Here, age and metallicity estimates for local cluster and field ETGs are reviewed as based on color-magnitude, color-sigma, and fundamental plane relations, as well as on spectral-line indices diagnostics. The results of applying the same tools at high redshifts are then discussed, and their consistency with the low-redshift results is assessed. Most low- as well as high-redshift (z~1) observations consistently indicate 1) a formation redshift z>~3 for the bulk of stars in cluster ETGs, with their counterparts in low-density environments being on average ~1-2 Gyr younger, i.e., formed at z>~1.5-2, 2) the duration of the major star formation phase anticorrelates with galaxy mass, and the oldest stellar populations are found in the most massive galaxies. With increasing redshift there is evidence for a decrease in the number density of ETGs, especially of the less massive ones, whereas existing data appear to suggest that most of the most-massive ETGs were already fully assembled at z~1. Beyond this redshift, the space density of ETGs starts dropping significantly, and as ETGs disappear, a population of massive, strongly clustered, starburst galaxies progressively becomes more and more prominent, which makes them the likely progenitors to ETGs.Comment: To appear on Annual Review of Astronomy & Astrophysics, Vol. 44 (2006). 46 pages with 16 figures. Replaced version includes updated references, few typos less, and replaces Fig. 11 and Fig. 16 which had been skrewed u

CD69 is a TGF-β/1α,25-dihydroxyvitamin D3 target gene in monocytes

CD69 is a transmembrane lectin that can be expressed on most hematopoietic cells. In monocytes, it has been functionally linked to the 5-lipoxygenase pathway in which the leukotrienes, a class of highly potent inflammatory mediators, are produced. However, regarding CD69 gene expression and its regulatory mechanisms in monocytes, only scarce data are available. Here, we report that CD69 mRNA expression, analogous to that of 5-lipoxygenase, is induced by the physiologic stimuli transforming growth factor-β (TGF-β) and 1α,25-dihydroxyvitamin D3 (1α,25(OH)2D3) in monocytic cells. Comparison with T- and B-cell lines showed that the effect was specific for monocytes. CD69 expression levels were increased in a concentration-dependent manner, and kinetic analysis revealed a rapid onset of mRNA expression, indicating that CD69 is a primary TGF-β/1α,25(OH)2D3 target gene. PCR analysis of different regions of the CD69 mRNA revealed that de novo transcription was initiated and proximal and distal parts were induced concomitantly. In common with 5-lipoxygenase, no activation of 0.7 kb or ~2.3 kb promoter fragments by TGF-β and 1α,25(OH)2D3 could be observed in transient reporter assays for CD69. Analysis of mRNA stability using a transcription inhibitor and a 3′UTR reporter construct showed that TGF-β and 1α,25(OH)2D3 do not influence CD69 mRNA stability. Functional knockdown of Smad3 clearly demonstrated that upregulation of CD69 mRNA, in contrast to 5-LO, depends on Smad3. Comparative studies with different inhibitors for mitogen activated protein kinases (MAPKs) revealed that MAPK signalling is involved in CD69 gene regulation, whereas 5-lipoxygenase gene expression was only partly affected. Mechanistically, we found evidence that CD69 gene upregulation depends on TAK1-mediated p38 activation. In summary, our data indicate that CD69 gene expression, conforming with 5-lipoxygenase, is regulated monocyte-specifically by the physiologic stimuli TGF-β and 1α,25(OH)2D3 on mRNA level, although different mechanisms account for the upregulation of each gene

The fitness of African malaria vectors in the presence and limitation of host behaviour

<p>Background Host responses are important sources of selection upon the host species range of ectoparasites and phytophagous insects. However little is known about the role of host responses in defining the host species range of malaria vectors. This study aimed to estimate the relative importance of host behaviour to the feeding success and fitness of African malaria vectors, and assess its ability to predict their known host species preferences in nature.</p> <p>Methods Paired evaluations of the feeding success and fitness of African vectors Anopheles arabiensis and Anopheles gambiae s.s in the presence and limitation of host behaviour were conducted in a semi-field system (SFS) at Ifakara Health Institute, Tanzania. In one set of trials, mosquitoes were released within the SFS and allowed to forage overnight on a host that was free to exhibit natural behaviour in response to insect biting. In the other, mosquitoes were allowed to feed directly on from the skin surface of immobile hosts. The feeding success and subsequent fitness of vectors under these conditions were investigated on 6 host types (humans, calves, chickens, cows, dogs and goats) to assess whether physical movements of preferred host species (cattle for An. arabiensis, humans for An. gambiae s.s.) were less effective at preventing mosquito bites than those of common alternatives.</p> <p>Results Anopheles arabiensis generally had greater feeding success when applied directly to host skin than when foraging on unrestricted hosts (in five of six host species). However, An. gambiae s.s obtained blood meals from free and restrained hosts with similar success from most host types (four out of six). Overall, the blood meal size, oviposition rate, fecundity and post-feeding survival of mosquito vectors were significantly higher after feeding on hosts free to exhibit behaviour, than those who were immobilized during feeding trials.</p> <p>Conclusions Allowing hosts to move freely during exposure to mosquitoes was associated with moderate reductions in mosquito feeding success, but no detrimental impact to the subsequent fitness of mosquitoes that were able to feed upon them. This suggests that physical defensive behaviours exhibited by common host species including humans do not impose substantial fitness costs on African malaria vectors.</p&gt

Detection of Gamma-Ray Emission from the Starburst Galaxies M82 and NGC 253 with the Large Area Telescope on Fermi

We report the detection of high-energy gamma-ray emission from two starburst galaxies using data obtained with the Large Area Telescope on board the Fermi Gamma-ray Space Telescope. Steady point-like emission above 200 MeV has been detected at significance levels of 6.8 sigma and 4.8 sigma respectively, from sources positionally coincident with locations of the starburst galaxies M82 and NGC 253. The total fluxes of the sources are consistent with gamma-ray emission originating from the interaction of cosmic rays with local interstellar gas and radiation fields and constitute evidence for a link between massive star formation and gamma-ray emission in star-forming galaxies.Comment: Submitted to ApJ Letter

Fermi Large Area Telescope observations of PSR J1836+5925

The discovery of the gamma-ray pulsar PSR J1836+5925, powering the formerly unidentified EGRET source 3EG J1835+5918, was one of the early accomplishments of the Fermi Large Area Telescope (LAT). Sitting 25 degrees off the Galactic plane, PSR J1836+5925 is a 173 ms pulsar with a characteristic age of 1.8 million years, a spindown luminosity of 1.1$\times10^{34}$ erg s$^{-1}$, and a large off-peak emission component, making it quite unusual among the known gamma-ray pulsar population. We present an analysis of one year of LAT data, including an updated timing solution, detailed spectral results and a long-term light curve showing no indication of variability. No evidence for a surrounding pulsar wind nebula is seen and the spectral characteristics of the off-peak emission indicate it is likely magnetospheric. Analysis of recent XMM observations of the X-ray counterpart yields a detailed characterization of its spectrum, which, like Geminga, is consistent with that of a neutron star showing evidence for both magnetospheric and thermal emission.Comment: Accepted to Astrophysical Journa

The pathogenesis of low pathogenicity H7 avian influenza viruses in chickens, ducks and turkeys

<p>Abstract</p> <p>Background</p> <p>Avian influenza (AI) viruses infect numerous avian species, and low pathogenicity (LP) AI viruses of the H7 subtype are typically reported to produce mild or subclinical infections in both wild aquatic birds and domestic poultry. However relatively little work has been done to compare LPAI viruses from different avian species for their ability to cause disease in domestic poultry under the same conditions. In this study twelve H7 LPAI virus isolates from North America were each evaluated for their comparative pathogenesis in chickens, ducks, and turkeys.</p> <p>Results</p> <p>All 12 isolates were able to infect all three species at a dose of 10⁶50% egg infectious doses based on seroconversion, although not all animals seroconverted with each isolate-species combination. The severity of disease varied among isolate and species combinations, but there was a consistent trend for clinical disease to be most severe in turkeys where all 12 isolates induced disease, and mortality was observed in turkeys exposed to 9 of the 12 viruses. Turkeys also shed virus by the oral and cloacal routes at significantly higher titers than either ducks or chickens at numerous time points. Only 3 isolates induced observable clinical disease in ducks and only 6 isolates induced disease in chickens, which was generally very mild and did not result in mortality. Full genome sequence was completed for all 12 isolates and some isolates did have features consistent with adaptation to poultry (e.g. NA stalk deletions), however none of these features correlated with disease severity.</p> <p>Conclusions</p> <p>The data suggests that turkeys may be more susceptible to clinical disease from the H7 LPAI viruses included in this study than either chickens or ducks. However the severity of disease and degree of virus shed was not clearly correlated with any isolate or group of isolates, but relied on specific species and isolate combinations.</p

Synthesis of phosphonate-functionalized polystyrene and poly(methyl methacrylate) particles and their kinetic behavior in miniemulsion polymerization

Phosphonate-functionalized polymer nanoparticles were synthesized by free-radical copolymerization of vinylphosphonic acid (VPA) with styrene or methyl methacrylate (MMA) using the miniemulsion technique. The influence of different parameters such as monomer and surfactant type, amount of vinylphosphonic acid on the average particle size, and size distribution was studied using dynamic light scattering and transmission electron microscopy. Depending on the amount and type of the surfactant used (ionic or non-ionic), phosphonate-functionalized particles in a size range from 102 to 312 nm can be obtained. The density of the phosphonate groups on the particle surface was higher in the case of using MMA as a basis monomer than polystyrene. The kinetic behavior of VPA copolymerization with styrene or MMA using a hydrophobic initiator was investigated by reaction calorimetry. Different kinetic curves were observed for miniemulsion (co)polymerization of styrene- and MMA-based nanoparticles indicating different nucleation mechanisms

A change in the optical polarization associated with a gamma-ray flare in the blazar 3C 279

It is widely accepted that strong and variable radiation detected over all accessible energy bands in a number of active galaxies arises from a relativistic, Doppler-boosted jet pointing close to our line of sight. The size of the emitting zone and the location of this region relative to the central supermassive black hole are, however, poorly known, with estimates ranging from light-hours to a light-year or more. Here we report the coincidence of a gamma-ray flare with a dramatic change of optical polarization angle. This provides evidence for co-spatiality of optical and gamma-ray emission regions and indicates a highly ordered jet magnetic field. The results also require a non-axisymmetric structure of the emission zone, implying a curved trajectory for the emitting material within the jet, with the dissipation region located at a considerable distance from the black hole, at about 10^5 gravitational radii.Comment: Published in Nature issued on 18 February 2010. Corresponding authors: Masaaki Hayashida and Greg Madejsk

Substrate Reduction Augments the Efficacy of Enzyme Therapy in a Mouse Model of Fabry Disease

Fabry disease is an X-linked glycosphingolipid storage disorder caused by a deficiency in the activity of the lysosomal hydrolase α-galactosidase A (α-gal). This deficiency results in accumulation of the glycosphingolipid globotriaosylceramide (GL-3) in lysosomes. Endothelial cell storage of GL-3 frequently leads to kidney dysfunction, cardiac and cerebrovascular disease. The current treatment for Fabry disease is through infusions of recombinant α-gal (enzyme-replacement therapy; ERT). Although ERT can markedly reduce the lysosomal burden of GL-3 in endothelial cells, variability is seen in the clearance from several other cell types. This suggests that alternative and adjuvant therapies may be desirable. Use of glucosylceramide synthase inhibitors to abate the biosynthesis of glycosphingolipids (substrate reduction therapy, SRT) has been shown to be effective at reducing substrate levels in the related glycosphingolipidosis, Gaucher disease. Here, we show that such an inhibitor (eliglustat tartrate, Genz-112638) was effective at lowering GL-3 accumulation in a mouse model of Fabry disease. Relative efficacy of SRT and ERT at reducing GL-3 levels in Fabry mouse tissues differed with SRT being more effective in the kidney, and ERT more efficacious in the heart and liver. Combination therapy with ERT and SRT provided the most complete clearance of GL-3 from all the tissues. Furthermore, treatment normalized urine volume and uromodulin levels and significantly delayed the loss of a nociceptive response. The differential efficacies of SRT and ERT in the different tissues indicate that the combination approach is both additive and complementary suggesting the possibility of an improved therapeutic paradigm in the management of Fabry disease