24 research outputs found
Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?
Many machine learning projects for new application areas involve teams of
humans who label data for a particular purpose, from hiring crowdworkers to the
paper's authors labeling the data themselves. Such a task is quite similar to
(or a form of) structured content analysis, which is a longstanding methodology
in the social sciences and humanities, with many established best practices. In
this paper, we investigate to what extent a sample of machine learning
application papers in social computing --- specifically papers from ArXiv and
traditional publications performing an ML classification task on Twitter data
--- give specific details about whether such best practices were followed. Our
team conducted multiple rounds of structured content analysis of each paper,
making determinations such as: Does the paper report who the labelers were,
what their qualifications were, whether they independently labeled the same
items, whether inter-rater reliability metrics were disclosed, what level of
training and/or instructions were given to labelers, whether compensation for
crowdworkers is disclosed, and if the training data is publicly available. We
find a wide divergence in whether such practices were followed and documented.
Much of machine learning research and education focuses on what is done once a
"gold standard" of training data is available, but we discuss issues around the
equally-important aspect of whether such data is reliable in the first place.Comment: 18 pages, includes appendi
Safety and Efficacy of Crizotinib in Combination with Temozolomide and Radiotherapy in Patients with Newly Diagnosed Glioblastoma: Phase Ib GEINO 1402 Trial
Simple Summary Most patients with glioblastoma, the most frequent primary brain tumor in adults, develop resistance to standard first-line treatment combining temozolomide and radiotherapy. Signaling through the hepatocyte growth factor receptor (c-MET) and the midkine (ALK ligand) promotes gliomagenesis and glioma stem cell maintenance, contributing to the resistance of glioma cells to anticancer therapies. This trial reports for the first time that the addition of crizotinib, an ALK, ROS1, and c-MET inhibitor, to standard RT and TMZ is safe and resulted in a promising efficacy for newly diagnosed patients with glioblastoma. Background: MET-signaling and midkine (ALK ligand) promote glioma cell maintenance and resistance against anticancer therapies. ALK and c-MET inhibition with crizotinib have a preclinical therapeutic rationale to be tested in newly diagnosed GBM. Methods: Eligible patients received crizotinib with standard radiotherapy (RT)/temozolomide (TMZ) followed by maintenance with crizotinib. The primary objective was to determine the recommended phase 2 dose (RP2D) in a 3 + 3 dose escalation (DE) strategy and safety evaluation in the expansion cohort (EC). Secondary objectives included progression-free (PFS) and overall survival (OS) and exploratory biomarker analysis. Results: The study enrolled 38 patients. The median age was 52 years (33-76), 44% were male, 44% were MGMT methylated, and three patients had IDH1/2 mutation. In DE, DLTs were reported in 1/6 in the second cohort (250 mg/QD), declaring 250 mg/QD of crizotinib as the RP2D for the EC. In the EC, 9/25 patients (32%) presented grade >= 3 adverse events. The median follow up was 18.7 months (m) and the median PFS was 10.7 m (95% CI, 7.7-13.8), with a 6 m PFS and 12 m PFS of 71.5% and 38.8%, respectively. At the time of this analysis, 1 died without progression and 24 had progressed. The median OS was 22.6 m (95% CI, 14.1-31.1) with a 24 m OS of 44.5%. Molecular biomarkers showed no correlation with efficacy. Conclusions: The addition of crizotinib to standard RT and TMZ for newly diagnosed GBM was safe and the efficacy was encouraging, warranting prospective validation in an adequately powered, randomized controlled study
Recommended from our members
Requerimientos del paradigma de la atención primaria a la salud en los albores del siglo XXI
Mexico is going througb a transition process in many
areas, sucn as demography, epidemiology, culture and
edueation, eeonomy and politics. In this rapidly changing
seene, the national commitment to provide quality health
services for every Mexican remains constant. Primary
health eare is considered the most effective strategy to
achieve this goal, whicb is identical to that of the World
Health Organization: "Health for all by the year 2000".
Primary health care overeomes a traditional diehotomy
in health services by integrating first level attention with
public health activities, sueh as health edueation, home
and work place sanitation, vaeeination and eommunity
partieipation. In order to ea"y out the primary health
care strategy, the National Health System must face
major challenges whieh are analyzed in this paper as wel/
as the various possible ways to overeome them. Finally, innovative Mexican programs are described. The authors
concIude that all necessary elements needed to make the
"Health for All" goal a reaIity are available
Recommended from our members
Design and Implementation of a Platform for Genomic Medicine in Mexico
Chapter 99 discusses the design and implementation of a platform for genomic medicine in Mexico, including implications for healthcare, ethical, legal and social implications, human genetics and genomic sciences in Mexico, ancestry of the Mexican population, a strategy to establish a national institute of genomic medicine, the foundation and initial development of INMEGEN, its board of trustees and its alignment with federal programs, INMEGEN work and achievements between 2004–2009, academic activities and technological infrastructure, and the Mexican genome diversity project