Truncation Sampling as Language Model Desmoothing

Long samples of text from neural language models can be of poor quality. Truncation sampling algorithms--like top-$p$ or top-$k$ -- address this by setting some words' probabilities to zero at each step. This work provides framing for the aim of truncation, and an improved algorithm for that aim. We propose thinking of a neural language model as a mixture of a true distribution and a smoothing distribution that avoids infinite perplexity. In this light, truncation algorithms aim to perform desmoothing, estimating a subset of the support of the true distribution. Finding a good subset is crucial: we show that top-$p$ unnecessarily truncates high-probability words, for example causing it to truncate all words but Trump for a document that starts with Donald. We introduce $\eta$-sampling, which truncates words below an entropy-dependent probability threshold. Compared to previous algorithms, $\eta$-sampling generates more plausible long English documents according to humans, is better at breaking out of repetition, and behaves more reasonably on a battery of test distributions.Comment: Findings of EMNLP, + small fixe

Dispersal Dynamics in a Wind-Driven Benthic System

Bedload and water column traps were used with simultaneous wind and water velocity measurements to study postlarval macrofaunal dispersal dynamics in Manukau Harbour, New Zealand. A 12-fold range in mean wind condition resulted in large differences in water flow (12-fold), sediment flux (285-fold), and trap collection of total number of individuals (95-fold), number of the dominant infaunal organism (84-fold for the bivalve Macomona liliana), and number of species (4-fold). There were very strong, positive relationships among wind condition, water velocity, sediment flux, and postlarval dispersal, especially in the bedload. Local density in the ambient sediment was not a good predictor of dispersal. Results indicate that postlarval dispersal may influence benthic abundance pat- terns over a range of spatial scales

Seeing an exercise as a single mathematical object: using variation to structure sense-making

In this theoretical paper we take an exercise to be a collection of procedural questions or tasks. It can be useful to treat such an exercise as a single object, with individual questions seen as elements in a mathematically and pedagogically structured set. We use the notions of 'dimensions of possible variation' and 'range of permissible change', derived from Ference Marton, to discuss affordances and constraints of some sample exercises. This gives insight into the potential pedagogical role of exercises, and shows how exercise analysis and design might contribute to hypotheses about learning trajectories. We argue that learners' response to an exercise has something in common with modeling that we might call 'micro-modeling', but we resort to a more inclusive description of mathematical thinking to describe learners' possible responses to a well-planned exercise. Finally we indicate how dimensions of possible variation inform the design and use of an exercise

Dynamical systems approach to G2 cosmology

In this paper we present a new approach for studying the dynamics of spatially inhomogeneous cosmological models with one spatial degree of freedom. By introducing suitable scale-invariant dependent variables we write the evolution equations of the Einstein field equations as a system of autonomous partial differential equations in first-order symmetric hyperbolic format, whose explicit form depends on the choice of gauge. As a first application, we show that the asymptotic behaviour near the cosmological initial singularity can be given a simple geometrical description in terms of the local past attractor on the boundary of the scale-invariant dynamical state space. The analysis suggests the name ``asymptotic silence'' to describe the evolution of the gravitational field near the cosmological initial singularity.Comment: 28 pages, 3 tables, 1 *.eps figure, LaTeX2e (10pt), matches version accepted for publication by Classical and Quantum Gravit

The Instabilities of Bianchi Type IX Einstein Static Universes

We investigate the stability of the Einstein static universe as a non-LRS Bianchi type IX solution of the Einstein equations in the presence of both non-tilted and tilted fluids. We find that the static universe is unstable to homogeneous perturbations of Bianchi type IX to the future and the past.Comment: 11 pages, no figures + revision

Mitotic stress is an integral part of the oncogene-induced senescence program that promotes multinucleation and cell cycle arrest

Oncogene-induced senescence (OIS) is a tumor suppression mechanism that blocks cell proliferation in response to oncogenic signaling. OIS is frequently accompanied by multinucleation; however, the origin of this is unknown. Here, we show that multinucleate OIS cells originate mostly from failed mitosis. Prior to senescence, mutant H-RasV12 activation in primary human fibroblasts compromised mitosis, concordant with abnormal expression of mitotic genes functionally linked to the observed mitotic spindle and chromatin defects. Simultaneously, H-RasV12 activation enhanced survival of cells with damaged mitoses, culminating in extended mitotic arrest and aberrant exit from mitosis via mitotic slippage. ERK-dependent transcriptional upregulation of Mcl1 was, at least in part, responsible for enhanced survival and slippage of cells with mitotic defects. Importantly, mitotic slippage and oncogene signaling cooperatively induced senescence and key senescence effectors p21 and p16. In summary, activated Ras coordinately triggers mitotic disruption and enhanced cell survival to promote formation of multinucleate senescent cells

Image-Based Cell Profiling Enables Quantitative Tissue Microscopy in Gastroenterology.

Immunofluorescence microscopy is an essential tool for tissue-based research, yet data reporting is almost always qualitative. Quantification of images, at the per-cell level, enables "flow cytometry-type" analyses with intact locational data but achieving this is complex. Gastrointestinal tissue, for example, is highly diverse: from mixed-cell epithelial layers through to discrete lymphoid patches. Moreover, different species (e.g., rat, mouse, and humans) and tissue preparations (paraffin/frozen) are all commonly studied. Here, using field-relevant examples, we develop open, user-friendly methodology that can encompass these variables to provide quantitative tissue microscopy for the field. Antibody-independent cell labeling approaches, compatible across preparation types and species, were optimized. Per-cell data were extracted from routine confocal micrographs, with semantic machine learning employed to tackle densely packed lymphoid tissues. Data analysis was achieved by flow cytometry-type analyses alongside visualization and statistical definition of cell locations, interactions and established microenvironments. First, quantification of Escherichia coli passage into human small bowel tissue, following Ussing chamber incubations exemplified objective quantification of rare events in the context of lumen-tissue crosstalk. Second, in rat jejenum, precise histological context revealed distinct populations of intraepithelial lymphocytes between and directly below enterocytes enabling quantification in context of total epithelial cell numbers. Finally, mouse mononuclear phagocyte-T cell interactions, cell expression and significant spatial cell congregations were mapped to shed light on cell-cell communication in lymphoid Peyer's patch. Accessible, quantitative tissue microscopy provides a new window-of-insight to diverse questions in gastroenterology. It can also help combat some of the data reproducibility crisis associated with antibody technologies and over-reliance on qualitative microscopy. © 2020 The Authors. Cytometry Part A published by Wiley Periodicals LLC. on behalf of International Society for Advancement of Cytometry.UK Medical Research Council (grant number MR/R005699/1) UK Engineering and Physical Sciences Research Council (grant EP/H008683/1) UK Biotechnology and Biological Sciences Research Council (grant number BB/P026818/1

Image-Based Cell Profiling Enables Quantitative Tissue Microscopy in Gastroenterology.

Immunofluorescence microscopy is an essential tool for tissue-based research, yet data reporting is almost always qualitative. Quantification of images, at the per-cell level, enables "flow cytometry-type" analyses with intact locational data but achieving this is complex. Gastrointestinal tissue, for example, is highly diverse: from mixed-cell epithelial layers through to discrete lymphoid patches. Moreover, different species (e.g., rat, mouse, and humans) and tissue preparations (paraffin/frozen) are all commonly studied. Here, using field-relevant examples, we develop open, user-friendly methodology that can encompass these variables to provide quantitative tissue microscopy for the field. Antibody-independent cell labeling approaches, compatible across preparation types and species, were optimized. Per-cell data were extracted from routine confocal micrographs, with semantic machine learning employed to tackle densely packed lymphoid tissues. Data analysis was achieved by flow cytometry-type analyses alongside visualization and statistical definition of cell locations, interactions and established microenvironments. First, quantification of Escherichia coli passage into human small bowel tissue, following Ussing chamber incubations exemplified objective quantification of rare events in the context of lumen-tissue crosstalk. Second, in rat jejenum, precise histological context revealed distinct populations of intraepithelial lymphocytes between and directly below enterocytes enabling quantification in context of total epithelial cell numbers. Finally, mouse mononuclear phagocyte-T cell interactions, cell expression and significant spatial cell congregations were mapped to shed light on cell-cell communication in lymphoid Peyer's patch. Accessible, quantitative tissue microscopy provides a new window-of-insight to diverse questions in gastroenterology. It can also help combat some of the data reproducibility crisis associated with antibody technologies and over-reliance on qualitative microscopy. © 2020 The Authors. Cytometry Part A published by Wiley Periodicals LLC. on behalf of International Society for Advancement of Cytometry.UK Medical Research Council (grant number MR/R005699/1) UK Engineering and Physical Sciences Research Council (grant EP/H008683/1) UK Biotechnology and Biological Sciences Research Council (grant number BB/P026818/1

Structure and stability of the Lukash plane-wave spacetime

We study the vacuum, plane-wave Bianchi $VII{}_{h}$ spacetimes described by the Lukash metric. Combining covariant with orthonormal frame techniques, we describe these models in terms of their irreducible kinematical and geometrical quantities. This covariant description is used to study analytically the response of the Lukash spacetime to linear perturbations. We find that the stability of the vacuum solution depends crucially on the background shear anisotropy. The stronger the deviation from the Hubble expansion, the more likely the overall linear instability of the model. Our analysis addresses rotational, shear and Weyl curvature perturbations and identifies conditions sufficient for the linear growth of these distortions.Comment: Revised version, references added. To appear in Class. Quantum Gra