24 research outputs found

    Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?

    Full text link
    Many machine learning projects for new application areas involve teams of humans who label data for a particular purpose, from hiring crowdworkers to the paper's authors labeling the data themselves. Such a task is quite similar to (or a form of) structured content analysis, which is a longstanding methodology in the social sciences and humanities, with many established best practices. In this paper, we investigate to what extent a sample of machine learning application papers in social computing --- specifically papers from ArXiv and traditional publications performing an ML classification task on Twitter data --- give specific details about whether such best practices were followed. Our team conducted multiple rounds of structured content analysis of each paper, making determinations such as: Does the paper report who the labelers were, what their qualifications were, whether they independently labeled the same items, whether inter-rater reliability metrics were disclosed, what level of training and/or instructions were given to labelers, whether compensation for crowdworkers is disclosed, and if the training data is publicly available. We find a wide divergence in whether such practices were followed and documented. Much of machine learning research and education focuses on what is done once a "gold standard" of training data is available, but we discuss issues around the equally-important aspect of whether such data is reliable in the first place.Comment: 18 pages, includes appendi

    Safety and Efficacy of Crizotinib in Combination with Temozolomide and Radiotherapy in Patients with Newly Diagnosed Glioblastoma: Phase Ib GEINO 1402 Trial

    Full text link
    Simple Summary Most patients with glioblastoma, the most frequent primary brain tumor in adults, develop resistance to standard first-line treatment combining temozolomide and radiotherapy. Signaling through the hepatocyte growth factor receptor (c-MET) and the midkine (ALK ligand) promotes gliomagenesis and glioma stem cell maintenance, contributing to the resistance of glioma cells to anticancer therapies. This trial reports for the first time that the addition of crizotinib, an ALK, ROS1, and c-MET inhibitor, to standard RT and TMZ is safe and resulted in a promising efficacy for newly diagnosed patients with glioblastoma. Background: MET-signaling and midkine (ALK ligand) promote glioma cell maintenance and resistance against anticancer therapies. ALK and c-MET inhibition with crizotinib have a preclinical therapeutic rationale to be tested in newly diagnosed GBM. Methods: Eligible patients received crizotinib with standard radiotherapy (RT)/temozolomide (TMZ) followed by maintenance with crizotinib. The primary objective was to determine the recommended phase 2 dose (RP2D) in a 3 + 3 dose escalation (DE) strategy and safety evaluation in the expansion cohort (EC). Secondary objectives included progression-free (PFS) and overall survival (OS) and exploratory biomarker analysis. Results: The study enrolled 38 patients. The median age was 52 years (33-76), 44% were male, 44% were MGMT methylated, and three patients had IDH1/2 mutation. In DE, DLTs were reported in 1/6 in the second cohort (250 mg/QD), declaring 250 mg/QD of crizotinib as the RP2D for the EC. In the EC, 9/25 patients (32%) presented grade >= 3 adverse events. The median follow up was 18.7 months (m) and the median PFS was 10.7 m (95% CI, 7.7-13.8), with a 6 m PFS and 12 m PFS of 71.5% and 38.8%, respectively. At the time of this analysis, 1 died without progression and 24 had progressed. The median OS was 22.6 m (95% CI, 14.1-31.1) with a 24 m OS of 44.5%. Molecular biomarkers showed no correlation with efficacy. Conclusions: The addition of crizotinib to standard RT and TMZ for newly diagnosed GBM was safe and the efficacy was encouraging, warranting prospective validation in an adequately powered, randomized controlled study

    Advent of ureotelism

    No full text
    corecore