On overfitting and asymptotic bias in batch reinforcement learning with partial observability

This paper provides an analysis of the tradeoff between asymptotic bias (suboptimality with unlimited data) and overfitting (additional suboptimality due to limited data) in the context of reinforcement learning with partial observability. Our theoretical analysis formally characterizes that while potentially increasing the asymptotic bias, a smaller state representation decreases the risk of overfitting. This analysis relies on expressing the quality of a state representation by bounding L1 error terms of the associated belief states. Theoretical results are empirically illustrated when the state representation is a truncated history of observations, both on synthetic POMDPs and on a large-scale POMDP in the context of smartgrids, with real-world data. Finally, similarly to known results in the fully observable setting, we also briefly discuss and empirically illustrate how using function approximators and adapting the discount factor may enhance the tradeoff between asymptotic bias and overfitting in the partially observable context.Comment: Accepted at the Journal of Artificial Intelligence Research (JAIR) - 31 page

Hypovitaminosis D is associated with depression and anxiety in schizophrenia: results from the national FACE-SZ cohort. Running title: hypovitaminosis D, depression and anxiety in schizophrenia

International audienceBackground. Guidelines have been edited for the treatment of schizophrenia (SZ) and bipola

CD4CD8αα Lymphocytes, A Novel Human Regulatory T Cell Subset Induced by Colonic Bacteria and Deficient in Patients with Inflammatory Bowel Disease

It has become evident that bacteria in our gut affect health and disease, but less is known about how they do this. Recent studies in mice showed that gut Clostridium bacteria and their metabolites can activate regulatory T cells (Treg) that in turn mediate tolerance to signals that would ordinarily cause inflammation. In this study we identify a subset of human T lymphocytes, designated CD4CD8αα T cells that are present in the surface lining of the colon and in the blood. We demonstrate Treg activity and show these cells to be activated by microbiota; we identify F. prausnitzii, a core Clostridium strain of the human gut microbiota, as a major inducer of these Treg cells. Interestingly, there are fewer F. prausnitzii in individuals suffering from inflammatory bowel disease (IBD), and accordingly the CD4CD8αα T cells are decreased in the blood and gut of patients with IBD. We argue that CD4CD8αα colonic Treg probably help control or prevent IBD. These data open the road to new diagnostic and therapeutic strategies for the management of IBD and provide new tools to address the impact of the intestinal microbiota on the human immune system

Identifying Individual T Cell Receptors of Optimal Avidity for Tumor Antigens.

Cytotoxic T cells recognize, via their T cell receptors (TCRs), small antigenic peptides presented by the major histocompatibility complex (pMHC) on the surface of professional antigen-presenting cells and infected or malignant cells. The efficiency of T cell triggering critically depends on TCR binding to cognate pMHC, i.e., the TCR-pMHC structural avidity. The binding and kinetic attributes of this interaction are key parameters for protective T cell-mediated immunity, with stronger TCR-pMHC interactions conferring superior T cell activation and responsiveness than weaker ones. However, high-avidity TCRs are not always available, particularly among self/tumor antigen-specific T cells, most of which are eliminated by central and peripheral deletion mechanisms. Consequently, systematic assessment of T cell avidity can greatly help distinguishing protective from non-protective T cells. Here, we review novel strategies to assess TCR-pMHC interaction kinetics, enabling the identification of the functionally most-relevant T cells. We also discuss the significance of these technologies in determining which cells within a naturally occurring polyclonal tumor-specific T cell response would offer the best clinical benefit for use in adoptive therapies, with or without T cell engineering

STK11/LKB1 Modulation of the Immune Response in Lung Cancer: From Biology to Therapeutic Impact

International audienceThe STK11/LKB1 gene codes for liver kinase B1 (STK11/LKB1), a highly conserved serine/threonine kinase involved in many energy-related cellular processes. The canonical tumor-suppressive role for STK11/LKB1 involves the activation of AMPK-related kinases, a master regulator of cell survival during stress conditions. In pre-clinical models, inactivation of STK11/LKB1 leads to the progression of lung cancer with the acquisition of metastatic properties. Moreover, preclinical and clinical data have shown that inactivation of STK11/LKB1 is associated with an inert tumor immune microenvironment, with a reduced density of infiltrating cytotoxic CD8+ T lymphocytes, a lower expression of PD-(L)1, and a neutrophil-enriched tumor microenvironment. In this review, we first describe the biological function of STK11/LKB1 and the role of its inactivation in cancer cells. We report descriptive epidemiology, co-occurring genomic alterations, and prognostic impact for lung cancer patients. Finally, we discuss recent data based on pre-clinical models and lung cancer cohorts analyzing the results of STK11/LKB1 alterations on the immune system and response or resistance to immune checkpoint inhibitors

Human adipose mesenchymal stem cells as potent anti-fibrosis therapy for systemic sclerosis

International audienc

Neuromedin B promotes chondrocyte differentiation of mesenchymal stromal cells via calcineurin and calcium signaling

International audienceBackground. Articular cartilage is a complex tissue with poor healing capacities. Current approaches for cartilage repair based on mesenchymal stromal cells (MSCs) are often disappointing because of the lack of relevant differentiation factors that could drive MSC differentiation towards a stable mature chondrocyte phenotype. Results. We used a large-scale transcriptomic approach to identify genes that are modulated at early stages of chondrogenic differentiation using the reference cartilage micropellet model. We identified several modulated genes and selected neuromedin B (NMB) as one of the early and transiently modulated genes. We found that the timely regulated increase of NMB was specific for chondrogenesis and not observed during osteogenesis or adipogenesis. Furthermore, NMB expression levels correlated with the differentiation capacity of MSCs and its inhibition resulted in impaired chondrogenic differentiation indicating that NMB is required for chondrogenesis. We further showed that NMB activated the calcineurin activity through a Ca 2+ -dependent signaling pathway. Conclusion. NMB is a newly described chondroinductive bioactive factor that upregulates the key chondrogenic transcription factor Sox9 through the modulation of Ca 2+ signaling pathway and calcineurin activity. Graphical abstrac

Serum-Mediated Oxidative Stress from Systemic Sclerosis Patients Affects Mesenchymal Stem Cell Function

The Supplementary Material for this article can be found online at http://journal.frontiersin.org/article/10.3389/fimmu.2017.00988/full#supplementary-material.International audienceObjectives: Properties of mesenchymal stromal/stem cells (MSCs) from systemic sclerosis (SSc) patients have been reported to be altered. MSC-based therapy may therefore rely on the use of allogeneic MSCs from healthy subjects. Here, we investigated whether heterologous MSCs could exhibit altered properties following exposure to oxidative environment of SSc sera.Methods: Human bone marrow-derived MSCs were cultured in the presence of various sera: control human serum AB (SAB), SAB with HOCl-induced AOPPs at 400 or 1,000 µmol/L (SAB400 or SAB1000, respectively), or H2O2-induced AOPPs or SSc patient serum (PS). Proliferation, apoptosis, and senescence rates of MSCs were evaluated after 3, 6, and 10 days in culture. Reactive oxygen species and nitric oxide production were quantified at 24 h. Trilineage potential of differentiation was tested after 21 days in specific culture conditions and immunosuppressive function measured in a T lymphocyte proliferative assay.Results: In the presence of oxidative environment of PS, MSCs retained their proliferative potential and survived for at least the first 3 days of exposure, while the number of senescent MSCs increased at day 6 and apoptosis rate at day 10. Exposure to PS enhanced the antioxidant capacity of MSCs, notably the expression of SOD2 antioxidant gene. By contrast, the osteoblastic/adipogenic potential of MSCs was increased, whereas their immunosuppressive function was slightly reduced.Discussion: Although some functional properties of MSCs were affected upon culture with PS, evidence from preclinical studies and the present one suggested that MSCs can adapt to the oxidative environment and exert their therapeutic effect