Evaluating Composition Models for Verb Phrase Elliptical Sentence Embeddings

Ellipsis is a natural language phenomenon where part of a sentence is missing and its information must be recovered from its surrounding context, as in “Cats chase dogs and so do foxes.”. Formal semantics has different methods for resolving ellipsis and recovering the missing information, but the problem has not been considered for distributional semantics, where words have vector embeddings and combinations thereof provide embeddings for sentences. In elliptical sentences these combinations go beyond linear as copying of elided information is necessary. In this paper, we develop different models for embedding VP-elliptical sentences. We extend existing verb disambiguation and sentence similarity datasets to ones containing elliptical phrases and evaluate our models on these datasets for a variety of non-linear combinations and their linear counterparts. We compare results of these compositional models to state of the art holistic sentence encoders. Our results show that non-linear addition and a non-linear tensor-based composition outperform the naive non-compositional baselines and the linear models, and that sentence encoders perform well on sentence similarity, but not on verb disambiguation

Classical Copying versus Quantum Entanglement in Natural Language: The Case of VP-ellipsis

In Proceedings CAPNS 2018, arXiv:1811.02701In Proceedings CAPNS 2018, arXiv:1811.0270

Incremental Composition in Distributional Semantics

Despite the incremental nature of Dynamic Syntax (DS), the semantic grounding of it remains that of predicate logic, itself grounded in set theory, so is poorly suited to expressing the rampantly context-relative nature of word meaning, and related phenomena such as incremental judgements of similarity needed for the modelling of disambiguation. Here, we show how DS can be assigned a compositional distributional semantics which enables such judgements and makes it possible to incrementally disambiguate language constructs using vector space semantics. Building on a proposal in our previous work, we implement and evaluate our model on real data, showing that it outperforms a commonly used additive baseline. In conclusion, we argue that these results set the ground for an account of the non-determinism of lexical content, in which the nature of word meaning is its dependence on surrounding context for its construal

Incremental Composition in Distributional Semantics

Despite the incremental nature of Dynamic Syntax (DS), the semantic grounding of it remains that of predicate logic, itself grounded in set theory, so is poorly suited to expressing the rampantly context-relative nature of word meaning, and related phenomena such as incremental judgements of similarity needed for the modelling of disambiguation. Here, we show how DS can be assigned a compositional distributional semantics which enables such judgements and makes it possible to incrementally disambiguate language constructs using vector space semantics. Building on a proposal in our previous work, we implement and evaluate our model on real data, showing that it outperforms a commonly used additive baseline. In conclusion, we argue that these results set the ground for an account of the non-determinism of lexical content, in which the nature of word meaning is its dependence on surrounding context for its construal

DARIS : a low-frequency distributed aperture array for radio astronomy in space

The frequency band below 30 MHz is one of the last unexplored bands in radio astronomy. This band is well suited for studying the early cosmos at high hydrogen redshifts, the so-called dark ages, extragalactic surveys, (extra) solar planetary bursts, and high energy particle physics. In addition, space research such as space weather tomography, are also areas of scientific interest. \ud \ud Due to ionospheric scintillation (below 30MHz) and its opaqueness (below 15MHz), earth-bound radio astronomy observations in these bands are either severely limited in sensitivity and spatial resolution or entirely impossible. A radio telescope in space obviously would not be hampered by the Earth's ionosphere. In the past, several (limited) studies have been conducted to explore possibilities for such an array in space. These studies considered aperture synthesis arrays in space, at the back-side of the Moon, or a satellite constellation operating in a coherent mode. \u

Aperture array development for future large radio telescopes

We present the design of a phased array system for future radio telescopes. This includes a system overview and recent results of the designed and implemented system, the Electronic Multi-Beam Radio Astronomy Concept (EMBRACE). Furthermore, simulations with a full-EM antenna simulator, combined with measurements on actual hardware, will provide information for the next design step, the Aperture Array Verification System (AAVS). With AAVS, we will prove design readiness of this novel array technology

Crumbs2 mediates ventricular layer remodelling to form the spinal cord central canal

In the spinal cord, the central canal forms through a poorly understood process termed dorsal collapse that involves attrition and remodelling of pseudostratified ventricular layer (VL) cells. Here, we use mouse and chick models to show that dorsal ventricular layer (dVL) cells adjacent to dorsal midline Nestin(+) radial glia (dmNes+RG) down-regulate apical polarity proteins, including Crumbs2 (CRB2) and delaminate in a stepwise manner; live imaging shows that as one cell delaminates, the next cell ratchets up, the dmNes+RG endfoot ratchets down, and the process repeats. We show that dmNes+RG secrete a factor that promotes loss of cell polarity and delamination. This activity is mimicked by a secreted variant of Crumbs2 (CRB2S) which is specifically expressed by dmNes+RG. In cultured MDCK cells, CRB2S associates with apical membranes and decreases cell cohesion. Analysis of Crb2F/F/Nestin-Cre+/− mice, and targeted reduction of Crb2/CRB2S in slice cultures reveal essential roles for transmembrane CRB2 (CRB2TM) and CRB2S on VL cells and dmNes+RG, respectively. We propose a model in which a CRB2S–CRB2TM interaction promotes the progressive attrition of the dVL without loss of overall VL integrity. This novel mechanism may operate more widely to promote orderly progenitor delamination

Constraining the epoch of reionization with the variance statistic: simulations of the LOFAR case

Several experiments are underway to detect the cosmic redshifted 21-cm signal from neutral hydrogen from the Epoch of Reionization (EoR). Due to their very low signal-to-noise ratio, these observations aim for a statistical detection of the signal by measuring its power spectrum. We investigate the extraction of the variance of the signal as a first step towards detecting and constraining the global history of the EoR. Signal variance is the integral of the signal's power spectrum, and it is expected to be measured with a high significance. We demonstrate this through results from a simulation and parameter estimation pipeline developed for the Low Frequency Array (LOFAR)-EoR experiment. We show that LOFAR should be able to detect the EoR in 600 hours of integration using the variance statistic. Additionally, the redshift ($z_r$) and duration ($\Delta z$) of reionization can be constrained assuming a parametrization. We use an EoR simulation of $z_r = 7.68$ and $\Delta z = 0.43$ to test the pipeline. We are able to detect the simulated signal with a significance of 4 standard deviations and extract the EoR parameters as $z_r = 7.72^{+0.37}_{-0.18}$ and $\Delta z = 0.53^{+0.12}_{-0.23}$ in 600 hours, assuming that systematic errors can be adequately controlled. We further show that the significance of detection and constraints on EoR parameters can be improved by measuring the cross-variance of the signal by cross-correlating consecutive redshift bins.Comment: 13 pages, 14 figures, Accepted for publication in MNRA