Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task

Chatbots have the risk of generating offensive utterances, which must be avoided. Post-deployment, one way for a chatbot to continuously improve is to source utterance/label pairs from feedback by live users. However, among users are trolls, who provide training examples with incorrect labels. To de-troll training data, previous work removed training examples that have high user-aggregated cross-validation (CV) error. However, CV is expensive; and in a coordinated attack, CV may be overwhelmed by trolls in number and in consistency among themselves. In the present work, I address both limitations by proposing a solution inspired by methodology in automated essay scoring (AES): have multiple users rate each utterance, then perform latent class analysis (LCA) to infer correct labels. As it does not require GPU computations, LCA is inexpensive. In experiments, I found that the AES-like solution can infer training labels with high accuracy when trolls are consistent, even when trolls are the majority.Comment: Accept-Findings at EMNLP 202

Synthesis and Characterization of Novel Organometallic Complexes

https://scholarworks.seattleu.edu/fss-2019/1010/thumbnail.jp

Identification of druggable small molecule antagonists of the Plasmodium falciparum hexose transporter PfHT and assessment of ligand access to the glucose permeation pathway via FLAG-mediated protein engineering

Although the Plasmodium falciparum hexose transporter PfHT has emerged as a promising target for anti-malarial therapy, previously identified small-molecule inhibitors have lacked promising drug-like structural features necessary for development as clinical therapeutics. Taking advantage of emerging insight into structure/function relationships in homologous facilitative hexose transporters and our novel high throughput screening platform, we investigated the ability of compounds satisfying Lipinksi rules for drug likeness to directly interact and inhibit PfHT. The Maybridge HitFinder chemical library was interrogated by searching for compounds that reduce intracellular glucose by >40% at 10 μM. Testing of initial hits via measurement of 2-deoxyglucose (2-DG) uptake in PfHT over-expressing cell lines identified 6 structurally unique glucose transport inhibitors. WU-1 (3-(2,6-dichlorophenyl)-5-methyl-N-[2-(4-methylbenzenesulfonyl)ethyl]-1,2-oxazole-4-carboxamide) blocked 2-DG uptake (IC50 = 5.8 ± 0.6 μM) with minimal effect on the human orthologue class I (GLUTs 1–4), class II (GLUT8) and class III (GLUT5) facilitative glucose transporters. WU-1 showed comparable potency in blocking 2-DG uptake in freed parasites and inhibiting parasite growth, with an IC50 of 6.1 ± 0.8 μM and EC50 of 5.5 ± 0.6 μM, respectively. WU-1 also directly competed for N-[2-[2-[2-[(N-biotinylcaproylamino)ethoxy)ethoxyl]-4-[2-(trifluoromethyl)-3H-diazirin-3-yl]benzoyl]-1,3-bis(mannopyranosyl-4-yloxy)-2-propylamine (ATB-BMPA) binding and inhibited the transport of D-glucose with an IC50 of 5.9 ± 0.8 μM in liposomes containing purified PfHT. Kinetic analysis revealed that WU-1 acts as a non-competitive inhibitor of zero-trans D-fructose uptake. Decreased potency for WU-1 and the known endofacial ligand cytochalasin B was observed when PfHT was engineered to contain an N-terminal FLAG tag. This modification resulted in a concomitant increase in affinity for 4,6-O-ethylidene-α-D-glucose, an exofacially directed transport antagonist, but did not alter the Km for 2-DG. Taken together, these data are consistent with a model in which WU-1 binds preferentially to the transporter in an inward open conformation and support the feasibility of developing potent and selective PfHT antagonists as a novel class of anti-malarial drugs.</div

eXtraembryonic ENdoderm (XEN) Stem Cells Produce Factors that Activate Heart Formation

Initial specification of cardiomyocytes in the mouse results from interactions between the extraembryonic anterior visceral endoderm (AVE) and the nascent mesoderm. However the mechanism by which AVE activates cardiogenesis is not well understood, and the identity of specific cardiogenic factors in the endoderm remains elusive. Most mammalian studies of the cardiogenic potential of the endoderm have relied on the use of cell lines that are similar to the heart-inducing AVE. These include the embryonal-carcinoma-derived cell lines, END2 and PYS2. The recent development of protocols to isolate eXtraembryonic ENdoderm (XEN) stem cells, representing the extraembryonic endoderm lineage, from blastocyst stage mouse embryos offers new tools for the genetic dissection of cardiogenesis.Here, we demonstrate that XEN cell-conditioned media (CM) enhances cardiogenesis during Embryoid Body (EB) differentiation of mouse embryonic stem (ES) cells in a manner comparable to PYS2-CM and END2-CM. Addition of CM from each of these three cell lines enhanced the percentage of EBs that formed beating areas, but ultimately, only XEN-CM and PYS2-CM increased the total number of cardiomyocytes that formed. Furthermore, our observations revealed that both contact-independent and contact-dependent factors are required to mediate the full cardiogenic potential of the endoderm. Finally, we used gene array comparison to identify factors in these cell lines that could mediate their cardiogenic potential.These studies represent the first step in the use of XEN cells as a molecular genetic tool to study cardiomyocyte differentiation. Not only are XEN cells functionally similar to the heart-inducing AVE, but also can be used for the genetic dissection of the cardiogenic potential of AVE, since they can be isolated from both wild type and mutant blastocysts. These studies further demonstrate the importance of both contact-dependent and contact-independent factors in cardiogenesis and identify potential heart-inducing proteins in the endoderm

A goodness-of-fit test for the bivariate necessary-but-not-sufficient relationship

In the social sciences, theory often casts bivariate relationships between constructs in terms of logical asymmetries. For example, in psychology, one theory is that intelligence is necessary but not sufficient for creativity. But as average-based linear models fail to accommodate nuances of logical asymmetries, a mismatch between theory and method is common in the literature. Recent methodological work proposed the Linear Ceiling and Floor Probability Region (LCFPR) model, which analyzes bivariate relationships in terms of necessity and sufficiency. However, an erroneous treatment of nested models and a lack of a formal goodness-of-fit test remain unaddressed in the LCFPR framework. In this thesis, I propose a goodness-of-fit test for LCFPR that addresses such shortcomings. A simulation study shows that, using a nonparametric quantile, the power and size of the test are largely acceptable. Analyses of real datasets demonstrate the proposed procedure. Conclusions and future directions are outlined in the final chapter

Talk recordings

Videos of presentations by Michael John Ilagan

Model-agnostic unsupervised detection of bots in a Likert-type questionnaire

To detect bots in online survey data, there is a wealth of literature on statistical detection using only responses to Likert-type items. There are two traditions in the literature. One tradition requires labeled data, forgoing strong model assumptions. The other tradition requires a measurement model, forgoing collection of labeled data. In the present article, we consider the problem where neither requirement is available, for an inventory that has the same number of Likert-type categories for all items. We propose a bot detection algorithm that is both model-agnostic and unsupervised. Our proposed algorithm involves a permutation test with leave-one-out calculations of outlier statistics. For each respondent, it outputs a p-value for the null hypothesis that the respondent is a bot. Such an algorithm offers nominal sensitivity calibration that is robust to the bot response distribution. In a simulation study, we found our proposed algorithm to improve upon naive alternatives in terms of 95% sensitivity calibration and, in many scenarios, in terms of classification accuracy

Journalism, public health, and COVID-19: Some preliminary insights from the Philippines

In this essay, we engage with the call for Extraordinary Issue: Coronavirus, Crisis and Communication. Situated in the Philippines, we reflect on how COVID-19 has made visible the often-overlooked relationship between journalism and public health. In covering the pandemic, journalists struggle with the shrinking space for press freedom and limited access to information as they also grapple with threats to their physical and mental well-being. Digital media enable journalists to report even in quarantine, but new challenges such as the wide circulation of health mis-/disinformation and private information emerge. Moreover, journalists have to contend with broader structural contexts of shutdown not just of a mainstream broadcast but also of community newspapers serving as critical sources of pandemic-related information. Overall, we hope this essay broadens the dialogue among journalists, policymakers, and healthcare professionals to improve the delivery of public health services and advance health reporting. © The Author(s) 2020