CROP: Towards Distributional-Shift Robust Reinforcement Learning using Compact Reshaped Observation Processing

The safe application of reinforcement learning (RL) requires generalization from limited training data to unseen scenarios. Yet, fulfilling tasks under changing circumstances is a key challenge in RL. Current state-of-the-art approaches for generalization apply data augmentation techniques to increase the diversity of training data. Even though this prevents overfitting to the training environment(s), it hinders policy optimization. Crafting a suitable observation, only containing crucial information, has been shown to be a challenging task itself. To improve data efficiency and generalization capabilities, we propose Compact Reshaped Observation Processing (CROP) to reduce the state information used for policy optimization. By providing only relevant information, overfitting to a specific training layout is precluded and generalization to unseen environments is improved. We formulate three CROPs that can be applied to fully observable observation- and action-spaces and provide methodical foundation. We empirically show the improvements of CROP in a distributionally shifted safety gridworld. We furthermore provide benchmark comparisons to full observability and data-augmentation in two different-sized procedurally generated mazes.Comment: 9 pages, 5 figures, accepted for publication at IJCAI 202

Monocyte, Lymphocyte and Neutrophil Ratios – Easy-to-Use Biomarkers for the Diagnosis of Pediatric Tuberculosis

Background: The neutrophil-to-lymphocyte-ratio (NLR), neutrophil-to-monocyte-plus-lymphocyte-ratio (NMLR) and monocyte-to-lymphocyte-ratio (MLR) may have diagnostic potential for tuberculosis (TB). Methods: Data of two prospective multicenter studies in Switzerland were used, which included children <18 years with TB exposure, infection or disease or with febrile non-TB lower-respiratory-tract infection (nTB-LRTI). Results: Of the 389 children included 25 (6.4%) had TB disease, 12 (3.1%) TB infection, 28 (7.2%) were healthy TB exposed and 324 (83.3%) nTB-LRTI. Median (IQR) NLR was highest with 2.0 (1.2, 2.2) in children with TB disease compared to TB exposed [0.8 (0.6, 1.3); P = 0.002] and nTB-LRTI [0.3 (0.1, 1.0); P < 0.001]. Median (IQR) NMLR was highest with 1.4 (1.2, 1.7) in children with TB disease compared to healthy exposed [0.7 (0.6, 1.1); P = 0.003] and children with nTB-LRTI [0.2 (0.1, 0.6); P < 0.001). Receiver operating characteristic curves to detect TB disease compared to nTB-LRTI for NLR and NMLR had an area under the curve of 0.82 and 0.86, the sensitivity of 88% and 88%, and specificity of 71% and 76%, respectively. Conclusion: NLR and NMLR are promising, easy-to-obtain diagnostic biomarkers to differentiate children with TB disease from other lower respiratory tract infections. These results require validation in a larger study and in settings with high and low TB endemicity

Attention-Based Recurrence for Multi-Agent Reinforcement Learning under Stochastic Partial Observability

Stochastic partial observability poses a major challenge for decentralized coordination in multi-agent reinforcement learning but is largely neglected in state-of-the-art research due to a strong focus on state-based centralized training for decentralized execution (CTDE) and benchmarks that lack sufficient stochasticity like StarCraft Multi-Agent Challenge (SMAC). In this paper, we propose Attention-based Embeddings of Recurrence In multi-Agent Learning (AERIAL) to approximate value functions under stochastic partial observability. AERIAL replaces the true state with a learned representation of multi-agent recurrence, considering more accurate information about decentralized agent decisions than state-based CTDE. We then introduce MessySMAC, a modified version of SMAC with stochastic observations and higher variance in initial states, to provide a more general and configurable benchmark regarding stochastic partial observability. We evaluate AERIAL in Dec-Tiger as well as in a variety of SMAC and MessySMAC maps, and compare the results with state-based CTDE. Furthermore, we evaluate the robustness of AERIAL and state-based CTDE against various stochasticity configurations in MessySMAC.Comment: Accepted at ICML 202

The kinetic profiles of copeptin and mid regional proadrenomedullin (MR-proADM) in pediatric lower respiratory tract infections

BACKGROUND Kinetics of copeptin and mid regional proadrenomedullin (MR-proADM) during febrile pediatric lower respiratory tract infections (LRTI) are unknown. We aimed to analyze kinetic profiles of copeptin and MR-proADM and the impact of clinical and laboratory factors on those biomarkers. METHODS This is a retrospective post-hoc analysis of a randomized controlled trial, evaluating procalcitonin guidance for antibiotic treatment of LRTI (ProPAED-study). In 175 pediatric patients presenting to the emergency department plasma copeptin and MR-proADM concentrations were determined on day 1, 3, and 5. Their association with clinical characteristics and other inflammatory biomarkers were tested by non-linear mixed effect modelling. RESULTS Median copeptin and MR-proADM values were elevated on day 1 and decreased during on day 3 and 5 (-26%; -34%, respectively). The initial concentrations of MR-proADM at inclusion were higher in patients receiving antibiotics intravenously compared to oral administration (difference 0.62 pmol/L, 95%CI 0.44;1.42, p<0.001). Intensive care unit (ICU) admission was associated with a daily increase of MR-proADM (increase/day 1.03 pmol/L, 95%CI 0.43;1.50, p<0.001). Positive blood culture in patients with antibiotic treatment and negative results on nasopharyngeal aspirates, or negative blood culture were associated with a decreasing MR-proADM (decrease/day -0.85 pmol/L, 95%CI -0.45;-1.44), p<0.001). CONCLUSION Elevated MR-proADM and increases thereof were associated with ICU admission suggesting the potential as a prognostic factor for severe pediatric LRTI. MR-proADM might only bear limited value for decision making on stopping antibiotics due to its slow decrease. Copeptin had no added value in our setting

Exposure to radial extracorporeal shock waves modulates viability and gene expression of human skeletal muscle cells: a controlled in vitro study

Background: Recent clinical and animal studies have shown that extracorporeal shock wave therapy has a promoting influence on the healing process of musculoskeletal disorders. However, the underlying biological effects of extracorporeal shock wave therapy on human skeletal muscle cells have not yet been investigated. Methods: In this study, we investigated human skeletal muscle cells after exposure to radial extracorporeal shock waves in a standardized in vitro setup. Cells were isolated from muscle specimens taken from adult patients undergoing spine surgery. Primary muscle cells were exposed once or twice to radial extracorporeal shock waves in vitro with different energy flux densities. Cell viability and gene expression of the paired box protein 7 (Pax7), neural cell adhesion molecule (NCAM), and myogenic factor 5 (Myf5) and MyoD as muscle cell markers were compared to non-treated muscle cells that served as controls. Results: Isolated muscle cells were positive for the hallmark protein of satellite cells, Pax7, as well as for the muscle cell markers NCAM, MyoD, and Myf5. Exposure to radial extracorporeal shock waves at low energy flux densities enhanced cell viability, whereas higher energy flux densities had no further significant impact. Gene expression analyses of muscle specific genes (Pax7, NCAM, Myf5, and MyoD) demonstrated a significant increase after single exposure to the highest EFD (4 bar, 0.19 mJ/mm(2)) and after double exposure with the medium EFDs (2 and 3 bar;0.09 and 0.14 mJ/mm(2), respectively). Double exposure of the highest EFD, however, results in a significant down-regulation when compared to single exposure with this EFD. Conclusions: This is the first study demonstrating that radial extracorporal shock wave therapy has the potential to modulate the biological function of human skeletal muscle cells. Based on our experimental findings, we hypothesize that radial extracorporal shock wave therapy could be a promising therapeutic modality to improve the healing process of sports-related structural muscle injuries

Interseasonal RSV infections in Switzerland - rapid establishment of a clinician-led national reporting system (RSV EpiCH).

In anticipation of an interseasonal respiratory syncytial virus (RSV) epidemic, a clinician-led reporting system was rapidly established to capture RSV infections in Swiss hospitals, starting in January 2021. Here, we present details of the reporting system and first results to June 2021. An unusual epidemiology was observed with an interseasonal surge of RSV infections associated with COVID-19-related non-pharmacological interventions. These data allowed real-time adjustment of RSV prophylaxis guidelines and consequently underscore the need for and continuation of systematic nationwide RSV surveillance

Best Practice Recommendations for the Diagnosis and Management of Children With Pediatric Inflammatory Multisystem Syndrome Temporally Associated With SARS-CoV-2 (PIMS-TS; Multisystem Inflammatory Syndrome in Children, MIS-C) in Switzerland.

Background: Following the spread of the coronavirus disease 2019 (COVID-19) pandemic a new disease entity emerged, defined as Pediatric Inflammatory Multisystem Syndrome temporally associated with COVID-19 (PIMS-TS), or Multisystem Inflammatory Syndrome in Children (MIS-C). In the absence of trials, evidence for treatment remains scarce. Purpose: To develop best practice recommendations for the diagnosis and treatment of children with PIMS-TS in Switzerland. It is acknowledged that the field is changing rapidly, and regular revisions in the coming months are pre-planned as evidence is increasing. Methods: Consensus guidelines for best practice were established by a multidisciplinary group of Swiss pediatric clinicians with expertise in intensive care, immunology/rheumatology, infectious diseases, hematology, and cardiology. Subsequent to literature review, four working groups established draft recommendations which were subsequently adapted in a modified Delphi process. Recommendations had to reach &gt;80% agreement for acceptance. Results: The group achieved agreement on 26 recommendations, which specify diagnostic approaches and interventions across anti-inflammatory, anti-infectious, and support therapies, and follow-up for children with suspected PIMS-TS. A management algorithm was derived to guide treatment depending on the phenotype of presentation, categorized into PIMS-TS with (a) shock, (b) Kawasaki-disease like, and (c) undifferentiated inflammatory presentation. Conclusion: Available literature on PIMS-TS is limited to retrospective or prospective observational studies. Informed by these cohort studies and indirect evidence from other inflammatory conditions in children and adults, as well as guidelines from international health authorities, the Swiss PIMS-TS recommendations represent best practice guidelines based on currently available knowledge to standardize treatment of children with suspected PIMS-TS. Given the absence of high-grade evidence, regular updates of the recommendations will be warranted, and participation of patients in trials should be encouraged

Proteomics identifies neddylation as a potential therapy target in small intestinal neuroendocrine tumors.

Patients with small intestinal neuroendocrine tumors (SI-NETs) frequently develop spread disease; however, the underlying molecular mechanisms of disease progression are not known and effective preventive treatment strategies are lacking. Here, protein expression profiling was performed by HiRIEF-LC-MS in 14 primary SI-NETs from patients with and without liver metastases detected at the time of surgery and initial treatment. Among differentially expressed proteins, overexpression of the ubiquitin-like protein NEDD8 was identified in samples from patients with liver metastasis. Further, NEDD8 correlation analysis indicated co-expression with RBX1, a key component in cullin-RING ubiquitin ligases (CRLs). In vitro inhibition of neddylation with the therapeutic agent pevonedistat (MLN4924) resulted in a dramatic decrease of proliferation in SI-NET cell lines. Subsequent mass spectrometry-based proteomics analysis of pevonedistat effects and effects of the proteasome inhibitor bortezomib revealed stabilization of multiple targets of CRLs including p27, an established tumor suppressor in SI-NET. Silencing of NEDD8 and RBX1 using siRNA resulted in a stabilization of p27, suggesting that the cellular levels of NEDD8 and RBX1 affect CRL activity. Inhibition of CRL activity, by either NEDD8/RBX1 silencing or pevonedistat treatment of cells resulted in induction of apoptosis that could be partially rescued by siRNA-based silencing of p27. Differential expression of both p27 and NEDD8 was confirmed in a second cohort of SI-NET using immunohistochemistry. Collectively, these findings suggest a role for CRLs and the ubiquitin proteasome system in suppression of p27 in SI-NET, and inhibition of neddylation as a putative therapeutic strategy in SI-NET