Continuous Multiagent Control using Collective Behavior Entropy for Large-Scale Home Energy Management

With the increasing popularity of electric vehicles, distributed energy generation and storage facilities in smart grid systems, an efficient Demand-Side Management (DSM) is urgent for energy savings and peak loads reduction. Traditional DSM works focusing on optimizing the energy activities for a single household can not scale up to large-scale home energy management problems. Multi-agent Deep Reinforcement Learning (MA-DRL) shows a potential way to solve the problem of scalability, where modern homes interact together to reduce energy consumers consumption while striking a balance between energy cost and peak loads reduction. However, it is difficult to solve such an environment with the non-stationarity, and existing MA-DRL approaches cannot effectively give incentives for expected group behavior. In this paper, we propose a collective MA-DRL algorithm with continuous action space to provide fine-grained control on a large scale microgrid. To mitigate the non-stationarity of the microgrid environment, a novel predictive model is proposed to measure the collective market behavior. Besides, a collective behavior entropy is introduced to reduce the high peak loads incurred by the collective behaviors of all householders in the smart grid. Empirical results show that our approach significantly outperforms the state-of-the-art methods regarding power cost reduction and daily peak loads optimization

Dynamic resilient modulus of subgrade silty clay for heavy-haul railway: an experimental investigation and the predicted method

A large-scale series of cyclic triaxial tests were conducted to explore the evolution of the dynamic resilient modulus of silty clay for the heavy-haul railway subgrade. A novel loading sequence for measuring the dynamic resilient modulus was established, which characterized the dynamic stress state of the subgrade induced by the heavy-haul train load. In the experimental investigation, the deviatoric stresses, confining stress, initial moisture content, and compaction degree were considered as variables, and the effects of the aforementioned variables were evaluated quantitatively. The experimental results showed that the dynamic resilient modulus was negatively related to deviatoric stresses and initial moisture content, where the average decreased rates were 14.65% and 27.79% with the increase in deviatoric stresses from 60 kPa to 150 kPa and increase in the initial moisture content from 9.8% to 15.8%, respectively. Furthermore, the dynamic resilient modulus was positively related to confining stress and compaction degree, where the average increased rates were 23.25% and 27.48% with the increase in confining stress from 20 kPa to 60 kPa and increase in compaction degree from 0.91 to 0.95. To provide a better application, the two high-accuracy predicted methods were established through the empirical model and artificial neural network approach including the aforementioned variables. This study can provide useful guidelines for the effective and safe design of the heavy-haul railway subgrade filled with silty clay

Transcript Profiling Identifies Dynamic Gene Expression Patterns and an Important Role for Nrf2/Keap1 Pathway in the Developing Mouse Esophagus

Morphological changes during human and mouse esophageal development have been well characterized. However, changes at the molecular level in the course of esophageal morphogenesis remain unclear. This study aims to globally profile critical genes and signaling pathways during the development of mouse esophagus. By using microarray analysis this study also aims to determine how the Nrf2/Keap1 pathway regulates the morphogenesis of the esophageal epithelium.Gene expression microarrays were used to survey gene expression in the esophagus at three critical phases: specification, metaplasia and maturation. The esophagi were isolated from wild-type, Nrf2(-/-), Keap1(-/-), or Nrf2(-/-)Keap1(-/-) embryos or young adult mice. Array data were statistically analyzed for differentially expressed genes and pathways. Histochemical and immunohistochemical staining were used to verify potential involvement of the Wnt pathway, Pparβ/δ and the PI3K/Akt pathway in the development of esophageal epithelium.Dynamic gene expression patterns accompanied the morphological changes of the developing esophagus at critical phases. Particularly, the Nrf2/Keap1 pathway had a baseline activity in the metaplasia phase and was further activated in the maturation phase. The Wnt pathway was active early and became inactive later in the metaplasia phase. In addition, Keap1(-/-) mice showed increased expression of Nrf2 downstream targets and genes involved in keratinization. Microarray and immunostaining data also suggested that esophageal hyperkeratosis in the Keap1(-/-) mice was due to activation of Pparβ/δ and the PI3K/Akt pathway.Morphological changes of the esophageal epithelium are associated with dynamic changes in gene expression. Nrf2/Keap1 pathway activity is required for maturation of mouse esophageal epithelium

Mechano-stimulated modifications in the chloroplast antioxidant system and proteome changes are associated with cold response in wheat

BACKGROUND: Mechanical wounding can cause morphological and developmental changes in plants, which may affect the responses to abiotic stresses. However, the mechano-stimulation triggered regulation network remains elusive. Here, the mechano-stimulation was applied at two different times during the growth period of wheat before exposing the plants to cold stress (5.6 °C lower temperature than the ambient temperature, viz., 5.0 °C) at the jointing stage. RESULTS: Results showed that mechano-stimulation at the Zadoks growth stage 26 activated the antioxidant system, and substantially, maintained the homeostasis of reactive oxygen species. In turn, the stimulation improved the electron transport and photosynthetic rate of wheat plants exposed to cold stress at the jointing stage. Proteomic and transcriptional analyses revealed that the oxidative stress defense, ATP synthesis, and photosynthesis-related proteins and genes were similarly modulated by mechano-stimulation and the cold stress. CONCLUSIONS: It was concluded that mechano-stimulated modifications of the chloroplast antioxidant system and proteome changes are related to cold tolerance in wheat. The findings might provide deeper insights into roles of reactive oxygen species in mechano-stimulated cold tolerance of photosynthetic apparatus, and be helpful to explore novel approaches to mitigate the impacts of low temperature occurring at critical developmental stages. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12870-015-0610-6) contains supplementary material, which is available to authorized users

Sox2 Cooperates with Inflammation-Mediated Stat3 Activation in the Malignant Transformation of Foregut Basal Progenitor Cells

SummarySox2 regulates the self-renewal of multiple types of stem cells. Recent studies suggest it also plays oncogenic roles in the formation of squamous carcinoma in several organs, including the esophagus where Sox2 is predominantly expressed in the basal progenitor cells of the stratified epithelium. Here, we use mouse genetic models to reveal a mechanism by which Sox2 cooperates with microenvironmental signals to malignantly transform epithelial progenitor cells. Conditional overexpression of Sox2 in basal cells expands the progenitor population in both the esophagus and forestomach. Significantly, carcinoma only develops in the forestomach, where pathological progression correlates with inflammation and nuclear localization of Stat3 in progenitor cells. Importantly, co-overexpression of Sox2 and activated Stat3 (Stat3C) also transforms esophageal basal cells but not the differentiated suprabasal cells. These findings indicate that basal stem/progenitor cells are the cells of origin of squamous carcinoma and that cooperation between Sox2 and microenvironment-activated Stat3 is required for Sox2-driven tumorigenesis

Insight into the efficient oxidation of methyl-ethyl-ketone over hierarchically micro-mesostructured Pt/K-(Al)SiO 2 nanorod catalysts: Structure-activity relationships and mechanism

Hierarchically micro-mesostructured Pt/K-Al-SiO2 catalysts with regular nanorod (Pt/KA-NRS) and spherical nanoflower-like (Pt/KA-SNFS) morphologies were prepared. The existence of Al atoms generates Brønsted acid sites and reduces silanol groups over the supports, promoting the dispersion of Pt nanoparticles and stability of catalysts. Potassium atoms balance the negative charge of supports and enhance O2 mobility. The Pt/KA-NRS catalysts exhibit unexceptionable low temperature activity, CO2 selectivity, and stability for MEK oxidation. Amongst, 0.27 wt.% Pt/KA-NRS completely converts MEK at just 170 °C (activation energy as low as 37.22 kJ·mol−1), more than 100 °C lower than other typical Pt/Pd supported catalysts reported in the literature. Diacetyl and 2,3-butandiol are the main intermediates during MEK activation, which convert into H2O and CO2 through aldehydes and acids. The excellent catalytic activity of Pt/KA-NRS is ascribed to their regular morphology, high Pt0 content and dispersion, excellent MEK adsorption capacity and superior O2/CO2 desorption capability under low temperature