Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulation

In this paper, we present a novel method for achieving dexterous manipulation of complex objects, while simultaneously securing the object without the use of passive support surfaces. We posit that a key difficulty for training such policies in a Reinforcement Learning framework is the difficulty of exploring the problem state space, as the accessible regions of this space form a complex structure along manifolds of a high-dimensional space. To address this challenge, we use two versions of the non-holonomic Rapidly-Exploring Random Trees algorithm; one version is more general, but requires explicit use of the environment's transition function, while the second version uses manipulation-specific kinematic constraints to attain better sample efficiency. In both cases, we use states found via sampling-based exploration to generate reset distributions that enable training control policies under full dynamic constraints via model-free Reinforcement Learning. We show that these policies are effective at manipulation problems of higher difficulty than previously shown, and also transfer effectively to real robots. Videos of the real-hand demonstrations can be found on the project website: https://sbrl.cs.columbia.edu/Comment: 10 pages, 6 figures, submitted to Robotics Science & Systems 202

Integrated analysis of single-cell RNA-seq and chipset data unravels PANoptosis-related genes in sepsis

BackgroundThe poor prognosis of sepsis warrants the investigation of biomarkers for predicting the outcome. Several studies have indicated that PANoptosis exerts a critical role in tumor initiation and development. Nevertheless, the role of PANoptosis in sepsis has not been fully elucidated.MethodsWe obtained Sepsis samples and scRNA-seq data from the GEO database. PANoptosis-related genes were subjected to consensus clustering and functional enrichment analysis, followed by identification of differentially expressed genes and calculation of the PANoptosis score. A PANoptosis-based prognostic model was developed. In vitro experiments were performed to verify distinct PANoptosis-related genes. An external scRNA-seq dataset was used to verify cellular localization.ResultsUnsupervised clustering analysis using 16 PANoptosis-related genes identified three subtypes of sepsis. Kaplan-Meier analysis showed significant differences in patient survival among the subtypes, with different immune infiltration levels. Differential analysis of the subtypes identified 48 DEGs. Boruta algorithm PCA analysis identified 16 DEGs as PANoptosis-related signature genes. We developed PANscore based on these signature genes, which can distinguish different PANoptosis and clinical characteristics and may serve as a potential biomarker. Single-cell sequencing analysis identified six cell types, with high PANscore clustering relatively in B cells, and low PANscore in CD16+ and CD14+ monocytes and Megakaryocyte progenitors. ZBP1, XAF1, IFI44L, SOCS1, and PARP14 were relatively higher in cells with high PANscore.ConclusionWe developed a machine learning based Boruta algorithm for profiling PANoptosis related subgroups with in predicting survival and clinical features in the sepsis

Afatinib combined with anti-PD1 enhances immunotherapy of hepatocellular carcinoma via ERBB2/STAT3/PD-L1 signaling

BackgroundAfatinib is mainly used to treat advanced non-small cell lung cancer, but its therapeutic effect on hepatocellular carcinoma is still unclear.MethodsOver 800 drugs were screened by CCK8 technology and afatinib was found to have a significant inhibitory effect on liver cancer cells. The expression of PDL1 in tumor cells treated with drugs were detected by qRT-PCR and Weston Blot experiments. The effects of afatinib on the growth, migration and invasion of HCC cells were evaluated using wound healing, Transwell, and cell cloning assays. The in vivo effects of afatinib in combination with anti-PD1 were evaluated in C57/BL6J mice with subcutaneous tumorigenesis. Bioinformatics analysis was performed to explore the specific mechanism of afatinib's inhibition of ERBB2 in improving the expression level of PD-L1, which was subsequently verified through experiments.ResultsAfatinib was found to have a significant inhibitory effect on liver cancer cells, as confirmed by in vitro experiments, which demonstrated that it could significantly suppress the growth, invasion and migration of HCC cells. qRT PCR and Weston Blot experiments also showed that Afatinib can enhance the expression of PD-L1 in tumor cells. In addition, in vitro experiments confirmed that afatinib can significantly enhance the immunotherapeutic effect of hepatocellular carcinoma. Afatinib’s ability to increase PD-L1 expression is mediated by STAT3 activation following its action on HCC cells.ConclusionAfatinib enhances PD-L1 expression in tumor cells through the STAT3/PD-L1 pathway. The combination of afatinib and anti-PD1 treatment significantly increases the immunotherapeutic effect of HCC

MUSiC : a model-unspecific search for new physics in proton-proton collisions at root s=13TeV

Results of the Model Unspecific Search in CMS (MUSiC), using proton-proton collision data recorded at the LHC at a centre-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 35.9 fb(-1), are presented. The MUSiC analysis searches for anomalies that could be signatures of physics beyond the standard model. The analysis is based on the comparison of observed data with the standard model prediction, as determined from simulation, in several hundred final states and multiple kinematic distributions. Events containing at least one electron or muon are classified based on their final state topology, and an automated search algorithm surveys the observed data for deviations from the prediction. The sensitivity of the search is validated using multiple methods. No significant deviations from the predictions have been observed. For a wide range of final state topologies, agreement is found between the data and the standard model simulation. This analysis complements dedicated search analyses by significantly expanding the range of final states covered using a model independent approach with the largest data set to date to probe phase space regions beyond the reach of previous general searches.Peer reviewe

Measurement of prompt open-charm production cross sections in proton-proton collisions at root s=13 TeV

The production cross sections for prompt open-charm mesons in proton-proton collisions at a center-of-mass energy of 13TeV are reported. The measurement is performed using a data sample collected by the CMS experiment corresponding to an integrated luminosity of 29 nb(-1). The differential production cross sections of the D*(+/-), D-+/-, and D-0 ((D) over bar (0)) mesons are presented in ranges of transverse momentum and pseudorapidity 4 < p(T) < 100 GeV and vertical bar eta vertical bar < 2.1, respectively. The results are compared to several theoretical calculations and to previous measurements.Peer reviewe

Search for new particles in events with energetic jets and large missing transverse momentum in proton-proton collisions at root s=13 TeV

A search is presented for new particles produced at the LHC in proton-proton collisions at root s = 13 TeV, using events with energetic jets and large missing transverse momentum. The analysis is based on a data sample corresponding to an integrated luminosity of 101 fb(-1), collected in 2017-2018 with the CMS detector. Machine learning techniques are used to define separate categories for events with narrow jets from initial-state radiation and events with large-radius jets consistent with a hadronic decay of a W or Z boson. A statistical combination is made with an earlier search based on a data sample of 36 fb(-1), collected in 2016. No significant excess of events is observed with respect to the standard model background expectation determined from control samples in data. The results are interpreted in terms of limits on the branching fraction of an invisible decay of the Higgs boson, as well as constraints on simplified models of dark matter, on first-generation scalar leptoquarks decaying to quarks and neutrinos, and on models with large extra dimensions. Several of the new limits, specifically for spin-1 dark matter mediators, pseudoscalar mediators, colored mediators, and leptoquarks, are the most restrictive to date.Peer reviewe

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe

Combined searches for the production of supersymmetric top quark partners in proton-proton collisions at root s=13 TeV

A combination of searches for top squark pair production using proton-proton collision data at a center-of-mass energy of 13 TeV at the CERN LHC, corresponding to an integrated luminosity of 137 fb(-1) collected by the CMS experiment, is presented. Signatures with at least 2 jets and large missing transverse momentum are categorized into events with 0, 1, or 2 leptons. New results for regions of parameter space where the kinematical properties of top squark pair production and top quark pair production are very similar are presented. Depending on themodel, the combined result excludes a top squarkmass up to 1325 GeV for amassless neutralino, and a neutralinomass up to 700 GeV for a top squarkmass of 1150 GeV. Top squarks with masses from 145 to 295 GeV, for neutralino masses from 0 to 100 GeV, with a mass difference between the top squark and the neutralino in a window of 30 GeV around the mass of the top quark, are excluded for the first time with CMS data. The results of theses searches are also interpreted in an alternative signal model of dark matter production via a spin-0 mediator in association with a top quark pair. Upper limits are set on the cross section for mediator particle masses of up to 420 GeV

Development and validation of HERWIG 7 tunes from CMS underlying-event measurements

This paper presents new sets of parameters (“tunes”) for the underlying-event model of the HERWIG7 event generator. These parameters control the description of multiple-parton interactions (MPI) and colour reconnection in HERWIG7, and are obtained from a fit to minimum-bias data collected by the CMS experiment at s=0.9, 7, and 13Te. The tunes are based on the NNPDF 3.1 next-to-next-to-leading-order parton distribution function (PDF) set for the parton shower, and either a leading-order or next-to-next-to-leading-order PDF set for the simulation of MPI and the beam remnants. Predictions utilizing the tunes are produced for event shape observables in electron-positron collisions, and for minimum-bias, inclusive jet, top quark pair, and Z and W boson events in proton-proton collisions, and are compared with data. Each of the new tunes describes the data at a reasonable level, and the tunes using a leading-order PDF for the simulation of MPI provide the best description of the dat