Hieros: Hierarchical Imagination on Structured State Space Sequence World Models

One of the biggest challenges to modern deep reinforcement learning (DRL) algorithms is sample efficiency. Many approaches learn a world model in order to train an agent entirely in imagination, eliminating the need for direct environment interaction during training. However, these methods often suffer from either a lack of imagination accuracy, exploration capabilities, or runtime efficiency. We propose Hieros, a hierarchical policy that learns time abstracted world representations and imagines trajectories at multiple time scales in latent space. Hieros uses an S5 layer-based world model, which predicts next world states in parallel during training and iteratively during environment interaction. Due to the special properties of S5 layers, our method can train in parallel and predict next world states iteratively during imagination. This allows for more efficient training than RNN-based world models and more efficient imagination than Transformer-based world models. We show that our approach outperforms the state of the art in terms of mean and median normalized human score on the Atari 100k benchmark, and that our proposed world model is able to predict complex dynamics very accurately. We also show that Hieros displays superior exploration capabilities compared to existing approaches.Comment: Submitted to ICLR 2024, 23 pages, 11 figures, code available at: https://github.com/Snagnar/Hiero

In-vehicle nitrogen dioxide concentrations in road tunnels

There is a lack of knowledge regarding in-vehicle concentrations of nitrogen dioxide (NO) during transit through road tunnels in urban environments. Furthermore, previous studies have tended to involve a single vehicle and the range of in-vehicle NO concentrations that vehicle occupants may be exposed to is not well defined. This study describes simultaneous measurements of in-vehicle and outside-vehicle NO concentrations on a route through Sydney, Australia that included several major tunnels, minor tunnels and busy surface roads. Tests were conducted on nine passenger vehicles to assess how vehicle characteristics and ventilation settings affected in-vehicle NO concentrations and the in-vehicle-to-outside vehicle (I/O) concentration ratio. NO was measured directly using a cavity attenuated phase shift (CAPS) technique that gave a high temporal and spatial resolution. In the major tunnels, transit-average in-vehicle NO concentrations were lower than outside-vehicle concentrations for all vehicles with cabin air recirculation either on or off. However, markedly lower I/O ratios were obtained with recirculation on (0.08–0.36), suggesting that vehicle occupants can significantly lower their exposure to NO in tunnels by switching recirculation on. The highest mean I/O ratios for NO were measured in older vehicles (0.35–0.36), which is attributed to older vehicles having higher air exchange rates. The results from this study can be used to inform the design and operation of future road tunnels and modelling of personal exposure to NO

Altered expression of microRNA in the airway wall in chronic asthma: miR-126 as a potential therapeutic target

Background: The role of microRNAs (miRNAs) in regulating gene expression is currently an area of intense interest. Relatively little is known, however, about the role of miRNAs in inflammatory and immunologically-driven disorders. In a mouse model, we have previously shown that miRNAs are potentially important therapeutic targets in allergic asthma, because inhibition of miR-126, one of a small subset of miRNAs upregulated in the airway wall, effectively suppressed Th2-driven airway inflammation and other features of asthma. In the present study, we extended investigation of the therapeutic potential of miRNA inhibition to our well-established model of chronic asthma. Methods: Female BALB/c mice were systemically sensitised with ovalbumin (OVA) and chronically challenged with low mass concentrations of aerosolised OVA for up to 6 weeks. Airway tissue was obtained by blunt dissection and RNA was isolated for miRNA profiling. On the basis of the results obtained, animals were subsequently treated with either an antagomir to miR-126 (ant-miR-126) or a scrambled control antagomir once weekly during the 6 weeks of chronic challenge, and the effects on airway inflammation and remodelling were assessed using established morphometric techniques. Results: Compared to naïve mice, there was selective upregulation of a modest number of miRNAs, notably miR-126, in the airway wall tissue of chronically challenged animals. The relative increase was maximal after 2 weeks of inhalational challenge and subsequently declined to baseline levels. Compared to treatment with the scrambled control, ant-miR-126 significantly reduced recruitment of intraepithelial eosinophils, but had no effect on the chronic inflammatory response, or on changes of airway remodelling. Conclusions: In this model of chronic asthma, there was an initial increase in expression of a small number of miRNAs in the airway wall, notably miR-126. However, this later declined to baseline levels, suggesting that sustained changes in miRNA may not be essential for perpetuation of chronic asthma. Moreover, inhibition of miR-126 by administration of an antagomir suppressed eosinophil recruitment into the airways but had no effect on chronic inflammation in the airway wall, or on changes of remodelling, suggesting that multiple miRNAs are likely to regulate the development of these lesions

A unique role for IL-13 in inducing esophageal eosinophilia through MID-1 and STAT6

IntroductionEosinophilic esophagitis (EoE) is associated with allergen-driven inflammation of the esophagus and an upregulated Th2 cytokine signature. Recombinant interleukin (IL)-13 (rIL-13) administration to mice induces some of the hallmark features of EoE, including increased eotaxin expression and eosinophil recruitment. Inflammation in EoE has previously been shown to depend on the expression of TRAIL and MID-1, which reduced protein phosphatase 2A (PP2A) activity. The relationship between IL-13 and TRAIL signalling in esophageal eosinophilia is currently unknown.ObjectiveTo investigate the interaction between IL-13-driven eosinophil infiltration and TRAIL or MID-1 in the esophagus.MethodWe administered rIL-13 to wild type (WT), TRAIL-deficient (Tnsf10−/−) or STAT6-deficient (STAT6−/−) mice and targeted MID-1 with small interfering RNA.ResultsrIL-13 administration to mice increased TRAIL and MID-1 expression in the esophagus while reducing PP2A activity. TRAIL deficient, but not STAT6 deficient mice demonstrated increased MID-1 expression and PP2A reduction upon IL-13 challenge which correlated with eosinophil infiltration into the esophagus. Silencing MID-1 expression with siRNA completely ablated IL-13 induced eosinophil infiltration of the esophagus, restored PP2A activity, and reduced eotaxin-1 expression.ConclusionIL-13-driven eosinophil infiltration of the esophagus induced eosinophilia and eotaxin-1 expression in a STAT6-dependent and MID-1-dependent manner. This study highlights a novel mechanism employed by IL-13 to perpetuate eosinophil infiltration

Exposure to Stress and Air Pollution from Bushfires during Pregnancy: Could Epigenetic Changes Explain Effects on the Offspring?

Due to climate change, bushfires are becoming a more frequent and more severe phenomenon which contributes to poor health effects associated with air pollution. In pregnancy, environmental exposures can have lifelong consequences for the fetus, but little is known about these consequences in the context of bushfire smoke exposure. In this review we summarise the current knowledge in this area, and propose a potential mechanism linking bushfire smoke exposure in utero to poor perinatal and respiratory outcomes in the offspring. Bushfire smoke exposure is associated with poor pregnancy outcomes including reduced birth weight and an increased risk of prematurity. Some publications have outlined the adverse health effects on young children, particularly in relation to emergency department presentations and hospital admissions for respiratory problems, but there are no studies in children who were exposed to bushfire smoke in utero. Prenatal stress is likely to occur as a result of catastrophic bushfire events, and stress is known to be associated with poor perinatal and respiratory outcomes. Changes to DNA methylation are potential epigenetic mechanisms linking both smoke particulate exposure and prenatal stress to poor childhood respiratory health outcomes. More research is needed in large pregnancy cohorts exposed to bushfire events to explore this further, and to design appropriate mitigation interventions, in this area of global public health importance.Vanessa Murphy is supported by an Investigator Grant from the Medical Research Future Fund (grant ID 1196252)

Intrinsic Defect in T Cell Production of Interleukin (IL)-13 in the Absence of Both IL-5 and Eotaxin Precludes the Development of Eosinophilia and Airways Hyperreactivity in Experimental Asthma

Interleukin (IL)-5 and IL-13 are thought to play key roles in the pathogenesis of asthma. Although both cytokines use eotaxin to regulate eosinophilia, IL-13 is thought to operate a separate pathway to IL-5 to induce airways hyperreactivity (AHR) in the allergic lung. However, identification of the key pathway(s) used by IL-5 and IL-13 in the disease process is confounded by the failure of anti–IL-5 or anti–IL-13 treatments to completely inhibit the accumulation of eosinophils in lung tissue. By using mice deficient in both IL-5 and eotaxin (IL-5/eotaxin−/−) we have abolished tissue eosinophilia and the induction of AHR in the allergic lung. Notably, in mice deficient in IL-5/eotaxin the ability of CD4+ T helper cell (Th)2 lymphocytes to produce IL-13, a critical regulator of airways smooth muscle constriction and obstruction, was significantly impaired. Moreover, the transfer of eosinophils to IL-5/eotaxin−/− mice overcame the intrinsic defect in T cell IL-13 production. Thus, factors produced by eosinophils may either directly or indirectly modulate the production of IL-13 during Th2 cell development. Our data show that IL-5 and eotaxin intrinsically modulate IL-13 production from Th2 cells and that these signaling systems are not necessarily independent effector pathways and may also be integrated to regulate aspects of allergic disease

Digestion of Raw and Roasted Almonds in Simulated Gastric Environment

Knowledge of digestion kinetics of solid foods in human stomach, as affected by food processing methods, is critical in establishing processing conditions at the manufacturing stage to achieve desirable release of nutrients in the gastrointestinal tract. The objective of this study was to investigate how roasting affected disintegration and solid release properties of almond in simulated gastric environment. In vitro trials were performed for raw and roasted almonds by using static soaking method and a model stomach system. The changes in sample weight, dry mass, and moisture during the trials were determined. Both compression and penetration tests were used to investigate the texture of almonds with a focus on the influence of absorption of gastric juice. Light microscopy and transmission electronic microscopy were used to study the change in microstructure of the raw and roasted almonds after simulated digestion. The results suggested that the slow disintegration rate and the high amount of swelling of the almonds in the stomach may contribute to their high satiety property. Roasting significantly improved the disintegration rates of almonds and increased loss of solids during simulated digestion, which is well correlated with the decrease in the rigidity of almond samples after absorbing gastric juice. Microstructure of digested almonds showed breakage and breach of cell walls due to acid hydrolysis. Intercellular and intracellular channels formed in almonds during roasting are important for penetration of gastric juice that may facilitate an effective digestion

Comparative acute efficacy and tolerability of OROS and immediate release formulations of methylphenidate in the treatment of adults with attention-deficit/hyperactivity disorder

<p>Abstract</p> <p>Background</p> <p>The main aim of this study was to compare the safety and efficacy of IR MPH administered three times daily to those of once daily OROS-MPH.</p> <p>Methods</p> <p>Subjects were outpatient adults satisfying full diagnostic criteria for DSM-IV ADHD between 19 and 60 years of age. Data from two independently conducted 6-week placebo controlled, randomized clinical trials of IR-MPH (tid) and of OROS-MPH were pooled to create three study groups: Placebo (N = 116), IR-MPH (tid) (N = 102) and OROS-MPH (N = 67).</p> <p>Results</p> <p>Eight-five percent (N = 99) of placebo treated subjects, 77% (N = 79) of the IR-MPH (tid) treated subjects, and 82% (N = 55) of the OROS-MPH treated subjects completed the 6-week trial. Total daily doses at endpoint were 80.9 ± 31.9 mg, 74.8 ± 26.2 mg, and 95.4 ± 26.3 mg in the OROS-MPH, IR-MPH (tid), and placebo groups, respectively. At endpoint, 66% (N = 44) of subjects receiving OROS-MPH and 70% (N = 71) of subjects receiving IR-MPH (tid) were considered responders compared with 31% (N = 36) on placebo.</p> <p>Conclusion</p> <p>Comparison of data from two similarly designed, large, randomized, placebo-controlled, trials, showed that equipotent daily doses of once daily OROS-MPH had similar efficacy to that of TID administered IR MPH.</p> <p>Trial Registration</p> <p>The trial of OROS-MPH was registered at clinicaltrials.gov, number NCT00181571.</p