Continuous-action reinforcement learning for memory allocation in virtualized servers

In a virtualized computing server (node) with multiple Virtual Machines (VMs), it is necessary to dynamically allocate memory among the VMs. In many cases, this is done only considering the memory demand of each VM without having a node-wide view. There are many solutions for the dynamic memory allocation problem, some of which use machine learning in some form. This paper introduces CAVMem (Continuous-Action Algorithm for Virtualized Memory Management), a proof-of-concept mechanism for a decentralized dynamic memory allocation solution in virtualized nodes that applies a continuous-action reinforcement learning (RL) algorithm called Deep Deterministic Policy Gradient (DDPG). CAVMem with DDPG is compared with other RL algorithms such as Q-Learning (QL) and Deep Q-Learning (DQL) in an environment that models a virtualized node. In order to obtain linear scaling and be able to dynamically add and remove VMs, CAVMem has one agent per VM connected via a lightweight coordination mechanism. The agents learn how much memory to bid for or return, in a given state, so that each VM obtains a fair level of performance subject to the available memory resources. Our results show that CAVMem with DDPG performs better than QL and a static allocation case, but it is competitive with DQL. However, CAVMem incurs significant less training overheads than DQL, making the continuous-action approach a more cost-effective solution.This research is part of a project that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 754337 (EuroEXA) and the European Union’s 7th Framework Programme under grant agreement number 610456 (Euroserver). It also received funding from the Spanish Ministry of Science and Technology (project TIN2015-65316-P), Generalitat de Catalunya (contract 2014-SGR-1272), and the Severo Ochoa Programme (SEV-2015-0493) of the Spanish Government.Peer ReviewedPostprint (author's final draft

Mechanistic Systems Modeling to Improve Understanding and Prediction of Cardiotoxicity Caused by Targeted Cancer Therapeutics

Tyrosine kinase inhibitors (TKIs) are highly potent cancer therapeutics that have been linked with serious cardiotoxicity, including left ventricular dysfunction, heart failure, and QT prolongation. TKI-induced cardiotoxicity is thought to result from interference with tyrosine kinase activity in cardiomyocytes, where these signaling pathways help to control critical processes such as survival signaling, energy homeostasis, and excitation–contraction coupling. However, mechanistic understanding is limited at present due to the complexities of tyrosine kinase signaling, and the wide range of targets inhibited by TKIs. Here, we review the use of TKIs in cancer and the cardiotoxicities that have been reported, discuss potential mechanisms underlying cardiotoxicity, and describe recent progress in achieving a more systematic understanding of cardiotoxicity via the use of mechanistic models. In particular, we argue that future advances are likely to be enabled by studies that combine large-scale experimental measurements with Quantitative Systems Pharmacology (QSP) models describing biological mechanisms and dynamics. As such approaches have proven extremely valuable for understanding and predicting other drug toxicities, it is likely that QSP modeling can be successfully applied to cardiotoxicity induced by TKIs. We conclude by discussing a potential strategy for integrating genome-wide expression measurements with models, illustrate initial advances in applying this approach to cardiotoxicity, and describe challenges that must be overcome to truly develop a mechanistic and systematic understanding of cardiotoxicity caused by TKIs

Population pharmacokinetics of oxcarbazepine and its metabolite 10-hydroxycarbazepine in healthy subjects

Oxcarbazepine is indicated for the treatment of partial or generalised tonic-clonic seizures. Most of the absorbed oxcarbazepine is converted into its active metabolite, 10-hydroxycarbazepine (MHD), which can exist as R-(-)- and S-(+)-MHD enantiomers. Here we describe the influence of the P-glycoprotein (P-gp) inhibitor verapamil, on the disposition of oxcarbazepine and MHD enantiomers, both of which are P-gp substrates. Healthy subjects (n=12) were randomised to oxcarbazepine or oxcarbazepine combined with verapamil at doses of 300mg b.i.d. and 80mg t.i.d., respectively. Blood samples (n=185) were collected over a period of 12h post oxcarbazepine dose. An integrated PK model was developed using nonlinear mixed effects modelling using a meta-analytical approach. The pharmacokinetics of oxcarbazepine was described by a two-compartment model with absorption transit compartments and first-order elimination. The concentration-time profiles of both MHD enantiomers were characterised by a one-compartment distribution model. Clearance estimates (95% CI) were 84.9L/h (69.5-100.3) for oxcarbazepine and 2.0L/h (1.9-2.1) for both MHD enantiomers. The volume of distribution was much larger for oxcarbazepine (131L (97-165)) as compared to R-(-)- and S-(+)-MHD (23.6L (14.4-32.8) vs. 31.7L (22.5-40.9), respectively). Co-administration of verapamil resulted in a modest increase of the apparent bioavailability of oxcarbazepine by 12% (10-28), but did not affect parent or metabolite clearances. Despite the evidence of comparable systemic levels of OXC and MHD following administration of verapamil, differences in brain exposure to both moieties cannot be excluded after P-glycoprotein inhibition

Bi-allelic variants in NAE1 cause intellectual disability, ischiopubic hypoplasia, stress-mediated lymphopenia and neurodegeneration

Neddylation has been implicated in various cellular pathways and in the pathophysiology of numerous diseases. We identified four individuals with bi-allelic variants in NAE1, which encodes the neddylation E1 enzyme. Pathogenicity was supported by decreased NAE1 abundance and overlapping clinical and cellular phenotypes. To delineate how cellular consequences of NAE1 deficiency would lead to the clinical phenotype, we focused primarily on the rarest phenotypic features, based on the assumption that these would best reflect the pathophysiology at stake. Two of the rarest features, neuronal loss and lymphopenia worsening during infections, suggest that NAE1 is required during cellular stress caused by infections to protect against cell death. In support, we found that stressing the proteasome system with MG132—requiring upregulation of neddylation to restore proteasomal function and proteasomal stress—led to increased cell death in fibroblasts of individuals with NAE1 genetic variants. Additionally, we found decreased lymphocyte counts after CD3/CD28 stimulation and decreased NF-κB translocation in individuals with NAE1 variants. The rarest phenotypic feature—delayed closure of the ischiopubic rami—correlated with significant downregulation of RUN2X and SOX9 expression in transcriptomic data of fibroblasts. Both genes are involved in the pathophysiology of ischiopubic hypoplasia. Thus, we show that NAE1 plays a major role in (skeletal) development and cellular homeostasis during stress. Our approach suggests that a focus on rare phenotypic features is able to provide significant pathophysiological insights in diseases caused by mutations in genes with pleiotropic effects.</p

Bi-allelic variants in NAE1 cause intellectual disability, ischiopubic hypoplasia, stress-mediated lymphopenia and neurodegeneration

Neddylation has been implicated in various cellular pathways and in the pathophysiology of numerous diseases. We identified four individuals with bi-allelic variants in NAE1, which encodes the neddylation E1 enzyme. Pathogenicity was supported by decreased NAE1 abundance and overlapping clinical and cellular phenotypes. To delineate how cellular consequences of NAE1 deficiency would lead to the clinical phenotype, we focused primarily on the rarest phenotypic features, based on the assumption that these would best reflect the pathophysiology at stake. Two of the rarest features, neuronal loss and lymphopenia worsening during infections, suggest that NAE1 is required during cellular stress caused by infections to protect against cell death. In support, we found that stressing the proteasome system with MG132—requiring upregulation of neddylation to restore proteasomal function and proteasomal stress—led to increased cell death in fibroblasts of individuals with NAE1 genetic variants. Additionally, we found decreased lymphocyte counts after CD3/CD28 stimulation and decreased NF-κB translocation in individuals with NAE1 variants. The rarest phenotypic feature—delayed closure of the ischiopubic rami—correlated with significant downregulation of RUN2X and SOX9 expression in transcriptomic data of fibroblasts. Both genes are involved in the pathophysiology of ischiopubic hypoplasia. Thus, we show that NAE1 plays a major role in (skeletal) development and cellular homeostasis during stress. Our approach suggests that a focus on rare phenotypic features is able to provide significant pathophysiological insights in diseases caused by mutations in genes with pleiotropic effects.</p

Bi-allelic variants in NAE1 cause intellectual disability, ischiopubic hypoplasia, stress-mediated lymphopenia and neurodegeneration

Neddylation has been implicated in various cellular pathways and in the pathophysiology of numerous diseases. We identified four individuals with bi-allelic variants in NAE1, which encodes the neddylation E1 enzyme. Pathogenicity was supported by decreased NAE1 abundance and overlapping clinical and cellular phenotypes. To delineate how cellular consequences of NAE1 deficiency would lead to the clinical phenotype, we focused primarily on the rarest phenotypic features, based on the assumption that these would best reflect the pathophysiology at stake. Two of the rarest features, neuronal loss and lymphopenia worsening during infections, suggest that NAE1 is required during cellular stress caused by infections to protect against cell death. In support, we found that stressing the proteasome system with MG132—requiring upregulation of neddylation to restore proteasomal function and proteasomal stress—led to increased cell death in fibroblasts of individuals with NAE1 genetic variants. Additionally, we found decreased lymphocyte counts after CD3/CD28 stimulation and decreased NF-κB translocation in individuals with NAE1 variants. The rarest phenotypic feature—delayed closure of the ischiopubic rami—correlated with significant downregulation of RUN2X and SOX9 expression in transcriptomic data of fibroblasts. Both genes are involved in the pathophysiology of ischiopubic hypoplasia. Thus, we show that NAE1 plays a major role in (skeletal) development and cellular homeostasis during stress. Our approach suggests that a focus on rare phenotypic features is able to provide significant pathophysiological insights in diseases caused by mutations in genes with pleiotropic effects.</p

Bi-allelic variants in NAE1 cause intellectual disability, ischiopubic hypoplasia, stress-mediated lymphopenia and neurodegeneration

Neddylation has been implicated in various cellular pathways and in the pathophysiology of numerous diseases. We identified four individuals with bi-allelic variants in NAE1, which encodes the neddylation E1 enzyme. Pathogenicity was supported by decreased NAE1 abundance and overlapping clinical and cellular phenotypes. To delineate how cellular consequences of NAE1 deficiency would lead to the clinical phenotype, we focused primarily on the rarest phenotypic features, based on the assumption that these would best reflect the pathophysiology at stake. Two of the rarest features, neuronal loss and lymphopenia worsening during infections, suggest that NAE1 is required during cellular stress caused by infections to protect against cell death. In support, we found that stressing the proteasome system with MG132—requiring upregulation of neddylation to restore proteasomal function and proteasomal stress—led to increased cell death in fibroblasts of individuals with NAE1 genetic variants. Additionally, we found decreased lymphocyte counts after CD3/CD28 stimulation and decreased NF-κB translocation in individuals with NAE1 variants. The rarest phenotypic feature—delayed closure of the ischiopubic rami—correlated with significant downregulation of RUN2X and SOX9 expression in transcriptomic data of fibroblasts. Both genes are involved in the pathophysiology of ischiopubic hypoplasia. Thus, we show that NAE1 plays a major role in (skeletal) development and cellular homeostasis during stress. Our approach suggests that a focus on rare phenotypic features is able to provide significant pathophysiological insights in diseases caused by mutations in genes with pleiotropic effects.</p

Bi-allelic variants in NAE1 cause intellectual disability, ischiopubic hypoplasia, stress-mediated lymphopenia and neurodegeneration

Neddylation has been implicated in various cellular pathways and in the pathophysiology of numerous diseases. We identified four individuals with bi-allelic variants in NAE1, which encodes the neddylation E1 enzyme. Pathogenicity was supported by decreased NAE1 abundance and overlapping clinical and cellular phenotypes. To delineate how cellular consequences of NAE1 deficiency would lead to the clinical phenotype, we focused primarily on the rarest phenotypic features, based on the assumption that these would best reflect the pathophysiology at stake. Two of the rarest features, neuronal loss and lymphopenia worsening during infections, suggest that NAE1 is required during cellular stress caused by infections to protect against cell death. In support, we found that stressing the proteasome system with MG132—requiring upregulation of neddylation to restore proteasomal function and proteasomal stress—led to increased cell death in fibroblasts of individuals with NAE1 genetic variants. Additionally, we found decreased lymphocyte counts after CD3/CD28 stimulation and decreased NF-κB translocation in individuals with NAE1 variants. The rarest phenotypic feature—delayed closure of the ischiopubic rami—correlated with significant downregulation of RUN2X and SOX9 expression in transcriptomic data of fibroblasts. Both genes are involved in the pathophysiology of ischiopubic hypoplasia. Thus, we show that NAE1 plays a major role in (skeletal) development and cellular homeostasis during stress. Our approach suggests that a focus on rare phenotypic features is able to provide significant pathophysiological insights in diseases caused by mutations in genes with pleiotropic effects.</p

DC-electric-field-induced and low-frequency electromodulation second-harmonic generation spectroscopy of Si(001)-SiO2_2 interfaces

The mechanism of DC-Electric-Field-Induced Second-Harmonic (EFISH) generation at weakly nonlinear buried Si(001)-SiO$_2$ interfaces is studied experimentally in planar Si(001)-SiO$_2$-Cr MOS structures by optical second-harmonic generation (SHG) spectroscopy with a tunable Ti:sapphire femtosecond laser. The spectral dependence of the EFISH contribution near the direct two-photon $E_1$ transition of silicon is extracted. A systematic phenomenological model of the EFISH phenomenon, including a detailed description of the space charge region (SCR) at the semiconductor-dielectric interface in accumulation, depletion, and inversion regimes, has been developed. The influence of surface quantization effects, interface states, charge traps in the oxide layer, doping concentration and oxide thickness on nonlocal screening of the DC-electric field and on breaking of inversion symmetry in the SCR is considered. The model describes EFISH generation in the SCR using a Green function formalism which takes into account all retardation and absorption effects of the fundamental and second harmonic (SH) waves, optical interference between field-dependent and field-independent contributions to the SH field and multiple reflection interference in the SiO$_2$ layer. Good agreement between the phenomenological model and our recent and new EFISH spectroscopic results is demonstrated. Finally, low-frequency electromodulated EFISH is demonstrated as a useful differential spectroscopic technique for studies of the Si-SiO$_2$ interface in silicon-based MOS structures.Comment: 31 pages, 14 figures, 1 table, figures are also available at http://kali.ilc.msu.su/articles/50/efish.ht