Substitution-based Semantic Change Detection using Contextual Embeddings

Measuring semantic change has thus far remained a task where methods using contextual embeddings have struggled to improve upon simpler techniques relying only on static word vectors. Moreover, many of the previously proposed approaches suffer from downsides related to scalability and ease of interpretation. We present a simplified approach to measuring semantic change using contextual embeddings, relying only on the most probable substitutes for masked terms. Not only is this approach directly interpretable, it is also far more efficient in terms of storage, achieves superior average performance across the most frequently cited datasets for this task, and allows for more nuanced investigation of change than is possible with static word vectors

Friendships, Rivalries, and Trysts: Characterizing Relations between Ideas in Texts

Understanding how ideas relate to each other is a fundamental question in many domains, ranging from intellectual history to public communication. Because ideas are naturally embedded in texts, we propose the first framework to systematically characterize the relations between ideas based on their occurrence in a corpus of documents, independent of how these ideas are represented. Combining two statistics --- cooccurrence within documents and prevalence correlation over time --- our approach reveals a number of different ways in which ideas can cooperate and compete. For instance, two ideas can closely track each other's prevalence over time, and yet rarely cooccur, almost like a "cold war" scenario. We observe that pairwise cooccurrence and prevalence correlation exhibit different distributions. We further demonstrate that our approach is able to uncover intriguing relations between ideas through in-depth case studies on news articles and research papers.Comment: 11 pages, 9 figures, to appear in Proceedings of ACL 2017, code and data available at https://chenhaot.com/pages/idea-relations.html (fixed a typo

On Meaningful Human Control in High-Stakes Machine-Human Partnerships

Our team at the Summer Institute was diverse in both skills (including technical computer science, cognitive science, systems innovation, and radiology expertise) and career stage (including faculty, graduate students, and a medical student). We were brought together at the ‘pitch’ stage by a mutual interest in human-machine partnerships in complex, high-stakes domains such as healthcare, transport, and autonomous weapons. We began with a focus on the topic of “meaningful human control” – a term most often applied in the autonomous weapons literature, which refers broadly to human participation in the deployment and operation of potentially autonomous artificial intelligence (AI) systems, such that the human has a meaningful contribution to decisions and outcomes

Self-injurious behaviours are associated with alterations in the somatosensory system in children with autism spectrum disorder.

Children with autism spectrum disorder (ASD) frequently engage in self-injurious behaviours, often in the absence of reporting pain. Previous research suggests that altered pain sensitivity and repeated exposure to noxious stimuli are associated with morphological changes in somatosensory and limbic cortices. Further evidence from postmortem studies with self-injurious adults has indicated alterations in the structure and organization of the temporal lobes; however, the effect of self-injurious behaviour on cortical development in children with ASD has not yet been determined. Thirty children and adolescents (mean age = 10.6 ± 2.5 years; range 7-15 years; 29 males) with a clinical diagnosis of ASD and 30 typically developing children (N = 30, mean age = 10.7 ± 2.5 years; range 7-15 years, 26 males) underwent T1-weighted magnetic resonance and diffusion tensor imaging. No between-group differences were seen in cerebral volume, surface area or cortical thickness. Within the ASD group, self-injury scores negatively correlated with thickness in the right superior parietal lobule t = 6.3, p \u3c 0.0001, bilateral primary somatosensory cortices (SI) (right: t = 4.4, p = 0.02; left: t = 4.48, p = 0.004) and the volume of the left ventroposterior (VP) nucleus of the thalamus (r = -0.52, p = 0.008). Based on these findings, we performed an atlas-based region-of-interest diffusion tensor imaging analysis between SI and the VP nucleus and found that children who engaged in self-injury had significantly lower fractional anisotropy (r = -0.4, p = 0.04) and higher mean diffusivity (r = 0.5, p = 0.03) values in the territory of the left posterior limb of the internal capsule. Additionally, greater incidence of self-injury was associated with increased radial diffusivity values in bilateral posterior limbs of the internal capsule (left: r = 0.5, p = 0.02; right: r = 0.5, p = 0.009) and corona radiata (left: r = 0.6, p = 0.005; right: r = 0.5, p = 0.009). Results indicate that self-injury is related to alterations in somatosensory cortical and subcortical regions and their supporting white-matter pathways. Findings could reflect use-dependent plasticity in the somatosensory system or disrupted brain development that could serve as a risk marker for self-injury

The structural and geochemical evolution of the continental crust: Support for the oceanic plateau model of continental growth

The problem of the origin of the continental crust can be resolved into two fundamental questions: (1) the location and mechanisms of initial mantle extraction of the primitive crust and (2) the processes by which this primitive crust is converted into the continental crust that presently exists. We know that Archean continental crust is compositionally distinct from younger continental crust. Archean magmatism was dominantly bimodal, mafic thoeleiitic plus dacitic, heavy rare earth element depleted, in contrast to the dominantly unimodal, roughly andesitic calc-alkaline magmatism on younger crust [Taylor and McLennan, 1985; Condie, 1989]. The problem is whether these compositional differences are primarily due to different mechanisms of crustal extraction from the mantle or to different mechanisms of differentiation and alteration of newly formed continental crust