Evaluation of template-based models in CASP8 with standard measures

The strategy for evaluating template-based models submitted to CASP has continuously evolved from CASP1 to CASP5, leading to a standard procedure that has been used in all subsequent editions. The established approach includes methods for calculating the quality of each individual model, for assigning scores based on the distribution of the results for each target and for computing the statistical significance of the differences in scores between prediction methods. These data are made available to the assessor of the template-based modeling category, who uses them as a starting point for further evaluations and analyses. This article describes the detailed workflow of the procedure, provides justifications for a number of choices that are customarily made for CASP data evaluation, and reports the results of the analysis of template-based predictions at CASP8

The PMDB Protein Model Database

The Protein Model Database (PMDB) is a public resource aimed at storing manually built 3D models of proteins. The database is designed to provide access to models published in the scientific literature, together with validating experimental data. It is a relational database and it currently contains >74 000 models for ∼240 proteins. The system is accessible at and allows predictors to submit models along with related supporting evidence and users to download them through a simple and intuitive interface. Users can navigate in the database and retrieve models referring to the same target protein or to different regions of the same protein. Each model is assigned a unique identifier that allows interested users to directly access the data

Genome3D: exploiting structure to help users understand their sequences.

Genome3D (http://www.genome3d.eu) is a collaborative resource that provides predicted domain annotations and structural models for key sequences. Since introducing Genome3D in a previous NAR paper, we have substantially extended and improved the resource. We have annotated representatives from Pfam families to improve coverage of diverse sequences and added a fast sequence search to the website to allow users to find Genome3D-annotated sequences similar to their own. We have improved and extended the Genome3D data, enlarging the source data set from three model organisms to 10, and adding VIVACE, a resource new to Genome3D. We have analysed and updated Genome3D's SCOP/CATH mapping. Finally, we have improved the superposition tools, which now give users a more powerful interface for investigating similarities and differences between structural models

Interleukin-22 orchestrates a pathological endoplasmic reticulum stress response transcriptional programme in colonic epithelial cells.

OBJECTIVE: The functional role of interleukin-22 (IL22) in chronic inflammation is controversial, and mechanistic insights into how it regulates target tissue are lacking. In this study, we evaluated the functional role of IL22 in chronic colitis and probed mechanisms of IL22-mediated regulation of colonic epithelial cells. DESIGN: To investigate the functional role of IL22 in chronic colitis and how it regulates colonic epithelial cells, we employed a three-dimentional mini-gut epithelial organoid system, in vivo disease models and transcriptomic datasets in human IBD. RESULTS: As well as inducing transcriptional modules implicated in antimicrobial responses, IL22 also coordinated an endoplasmic reticulum (ER) stress response transcriptional programme in colonic epithelial cells. In the colon of patients with active colonic Crohn's disease (CD), there was enrichment of IL22-responsive transcriptional modules and ER stress response modules. Strikingly, in an IL22-dependent model of chronic colitis, targeting IL22 alleviated colonic epithelial ER stress and attenuated colitis. Pharmacological modulation of the ER stress response similarly impacted the severity of colitis. In patients with colonic CD, antibody blockade of IL12p40, which simultaneously blocks IL12 and IL23, the key upstream regulator of IL22 production, alleviated the colonic epithelial ER stress response. CONCLUSIONS: Our data challenge perceptions of IL22 as a predominantly beneficial cytokine in IBD and provide novel insights into the molecular mechanisms of IL22-mediated pathogenicity in chronic colitis. Targeting IL22-regulated pathways and alleviating colonic epithelial ER stress may represent promising therapeutic strategies in patients with colitis. TRIAL REGISTRATION NUMBER: NCT02749630

Genetics of circulating inflammatory proteins identifies drivers of immune-mediated disease risk and therapeutic targets

Circulating proteins have important functions in inflammation and a broad range of diseases. To identify genetic influences on inflammation-related proteins, we conducted a genome-wide protein quantitative trait locus (pQTL) study of 91 plasma proteins measured using the Olink Target platform in 14,824 participants. We identified 180 pQTLs (59 cis, 121 trans). Integration of pQTL data with eQTL and disease genome-wide association studies provided insight into pathogenesis, implicating lymphotoxin-alpha in multiple sclerosis. Using Mendelian randomization (MR) to assess causality in disease etiology, we identified both shared and distinct effects of specific proteins across immune-mediated diseases, including directionally discordant effects of CD40 on risk of rheumatoid arthritis versus multiple sclerosis and inflammatory bowel disease. MR implicated CXCL5 in the etiology of ulcerative colitis (UC) and we show elevated gut CXCL5 transcript expression in patients with UC. These results identify targets of existing drugs and provide a powerful resource to facilitate future drug target prioritization. Here the authors identify genetic effectors of the level of inflammation-related plasma proteins and use Mendelian randomization to identify proteins that contribute to immune-mediated disease risk

Tumor-activated lymph node fibroblasts suppress T cell function in diffuse large B cell lymphoma

Recent transcriptomic-based analysis of diffuse large B cell lymphoma (DLBCL) has highlighted the clinical relevance of LN fibroblast and tumor-infiltrating lymphocyte (TIL) signatures within the tumor microenvironment (TME). However, the immunomodulatory role of fibroblasts in lymphoma remains unclear. Here, by studying human and mouse DLBCL-LNs, we identified the presence of an aberrantly remodeled fibroblastic reticular cell (FRC) network expressing elevated fibroblast-activated protein (FAP). RNA-Seq analyses revealed that exposure to DLBCL reprogrammed key immunoregulatory pathways in FRCs, including a switch from homeostatic to inflammatory chemokine expression and elevated antigen-presentation molecules. Functional assays showed that DLBCL-activated FRCs (DLBCL-FRCs) hindered optimal TIL and chimeric antigen receptor (CAR) T cell migration. Moreover, DLBCL-FRCs inhibited CD8+ TIL cytotoxicity in an antigen-specific manner. Notably, the interrogation of patient LNs with imaging mass cytometry identified distinct environments differing in their CD8+ TIL-FRC composition and spatial organization that associated with survival outcomes. We further demonstrated the potential to target inhibitory FRCs to rejuvenate interacting TILs. Cotreating organotypic cultures with FAP-targeted immunostimulatory drugs and a bispecific antibody (glofitamab) augmented antilymphoma TIL cytotoxicity. Our study reveals an immunosuppressive role of FRCs in DLBCL, with implications for immune evasion, disease pathogenesis, and optimizing immunotherapy for patients

An Expanded Evaluation of Protein Function Prediction Methods Shows an Improvement In Accuracy

Background: A major bottleneck in our understanding of the molecular underpinnings of life is the assignment of function to proteins. While molecular experiments provide the most reliable annotation of proteins, their relatively low throughput and restricted purview have led to an increasing role for computational function prediction. However, assessing methods for protein function prediction and tracking progress in the field remain challenging. Results: We conducted the second critical assessment of functional annotation (CAFA), a timed challenge to assess computational methods that automatically assign protein function. We evaluated 126 methods from 56 research groups for their ability to predict biological functions using Gene Ontology and gene-disease associations using Human Phenotype Ontology on a set of 3681 proteins from 18 species. CAFA2 featured expanded analysis compared with CAFA1, with regards to data set size, variety, and assessment metrics. To review progress in the field, the analysis compared the best methods from CAFA1 to those of CAFA2. Conclusions: The top-performing methods in CAFA2 outperformed those from CAFA1. This increased accuracy can be attributed to a combination of the growing number of experimental annotations and improved methods for function prediction. The assessment also revealed that the definition of top-performing algorithms is ontology specific, that different performance metrics can be used to probe the nature of accurate predictions, and the relative diversity of predictions in the biological process and human phenotype ontologies. While there was methodological improvement between CAFA1 and CAFA2, the interpretation of results and usefulness of individual methods remain context-dependent

An expanded evaluation of protein function prediction methods shows an improvement in accuracy

Background: A major bottleneck in our understanding of the molecular underpinnings of life is the assignment of function to proteins. While molecular experiments provide the most reliable annotation of proteins, their relatively low throughput and restricted purview have led to an increasing role for computational function prediction. However, assessing methods for protein function prediction and tracking progress in the field remain challenging. Results: We conducted the second critical assessment of functional annotation (CAFA), a timed challenge to assess computational methods that automatically assign protein function. We evaluated 126 methods from 56 research groups for their ability to predict biological functions using Gene Ontology and gene-disease associations using Human Phenotype Ontology on a set of 3681 proteins from 18 species. CAFA2 featured expanded analysis compared with CAFA1, with regards to data set size, variety, and assessment metrics. To review progress in the field, the analysis compared the best methods from CAFA1 to those of CAFA2. Conclusions: The top-performing methods in CAFA2 outperformed those from CAFA1. This increased accuracy can be attributed to a combination of the growing number of experimental annotations and improved methods for function prediction. The assessment also revealed that the definition of top-performing algorithms is ontology specific, that different performance metrics can be used to probe the nature of accurate predictions, and the relative diversity of predictions in the biological process and human phenotype ontologies. While there was methodological improvement between CAFA1 and CAFA2, the interpretation of results and usefulness of individual methods remain context-dependent. Keywords: Protein function prediction, Disease gene prioritizationpublishedVersio

The CAFA challenge reports improved protein function prediction and new functional annotations for hundreds of genes through experimental screens

Background The Critical Assessment of Functional Annotation (CAFA) is an ongoing, global, community-driven effort to evaluate and improve the computational annotation of protein function. Results Here, we report on the results of the third CAFA challenge, CAFA3, that featured an expanded analysis over the previous CAFA rounds, both in terms of volume of data analyzed and the types of analysis performed. In a novel and major new development, computational predictions and assessment goals drove some of the experimental assays, resulting in new functional annotations for more than 1000 genes. Specifically, we performed experimental whole-genome mutation screening in Candida albicans and Pseudomonas aureginosa genomes, which provided us with genome-wide experimental data for genes associated with biofilm formation and motility. We further performed targeted assays on selected genes in Drosophila melanogaster, which we suspected of being involved in long-term memory. Conclusion We conclude that while predictions of the molecular function and biological process annotations have slightly improved over time, those of the cellular component have not. Term-centric prediction of experimental annotations remains equally challenging; although the performance of the top methods is significantly better than the expectations set by baseline methods in C. albicans and D. melanogaster, it leaves considerable room and need for improvement. Finally, we report that the CAFA community now involves a broad range of participants with expertise in bioinformatics, biological experimentation, biocuration, and bio-ontologies, working together to improve functional annotation, computational function prediction, and our ability to manage big data in the era of large experimental screens.Peer reviewe