BERT Knows Punta Cana is not just Beautiful, it's Gorgeous : Ranking Scalar Adjectives with Contextualised Representations

Adjectives like pretty, beautiful and gorgeous describe positive properties of the nouns they modify but with different intensity. These differences are important for natural language understanding and reasoning. We propose a novel BERT-based approach to intensity detection for scalar adjectives. We model intensity by vectors directly derived from contextualised representations and show they can successfully rank scalar adjectives. We evaluate our models both intrinsically, on gold standard datasets, and on an Indirect Question Answering task. Our results demonstrate that BERT encodes rich knowledge about the semantics of scalar adjectives, and is able to provide better quality intensity rankings than static embeddings and previous models with access to dedicated resources.Peer reviewe

Detecting and ordering adjectival scalemates

This paper presents a pattern-based method that can be used to infer adjectival scales, such as , from a corpus. Specifically, the proposed method uses lexical patterns to automatically identify and order pairs of scalemates, followed by a filtering phase in which unrelated pairs are discarded. For the filtering phase, several different similarity measures are implemented and compared. The model presented in this paper is evaluated using the current standard, along with a novel evaluation set, and shown to be at least as good as the current state-of-the-art.Comment: Paper presented at MAPLEX 2015, February 9-10, Yamagata, Japan (http://lang.cs.tut.ac.jp/maplex2015/

HiER 2015. Proceedings des 9. Hildesheimer Evaluierungs- und Retrievalworkshop

Die Digitalisierung formt unsere Informationsumwelten. Disruptive Technologien dringen verstärkt und immer schneller in unseren Alltag ein und verändern unser Informations- und Kommunikationsverhalten. Informationsmärkte wandeln sich. Der 9. Hildesheimer Evaluierungs- und Retrievalworkshop HIER 2015 thematisiert die Gestaltung und Evaluierung von Informationssystemen vor dem Hintergrund der sich beschleunigenden Digitalisierung. Im Fokus stehen die folgenden Themen: Digital Humanities, Internetsuche und Online Marketing, Information Seeking und nutzerzentrierte Entwicklung, E-Learning

Stoic Virtue: A Contemporary Interpretation

The Stoic understanding of virtue is often taken to be a non-starter. Many of the Stoic claims about virtue – that a virtue requires moral perfection and that all who are not fully virtuous are vicious – are thought to be completely out of step with our commonsense notion of virtue, making the Stoic account more of an historical oddity than a seriously defended view. Despite many voices to the contrary, I will argue that there is a way of making sense of these Stoic claims. Recent work in linguistics has shown that there is a distinction between relative and absolute gradable adjectives, with the absolute variety only applying to perfect exemplars. I will argue that taking virtue terms to be absolute gradable adjectives – and thus that they apply only to those who are fully virtuous – is one way to make sense of the Stoic view. I will also show how interpreting virtue theoretic adjectives as absolute gradable adjectives makes it possible to defend Stoicism against its most common objections, demonstrating how the Stoic account of virtue might once again be a player in the contemporary landscape of virtue theorizing

Belief, Rational and Justified

It is clear that beliefs can be assessed both as to their justification and their rationality. What is not as clear, however, is how the rationality and justification of belief relate to one another. Stewart Cohen has stumped for the popular proposal that rationality and justification come to the same thing, that rational beliefs just are justified beliefs, supporting his view by arguing that ‘justified belief’ and ‘rational belief’ are synonymous. In this paper, I will give reason to think that Cohen’s argument is spurious. I will show that ‘rational’ and ‘justified’ occupy two distinct semantic categories – ‘rational’ is an absolute gradable adjective and ‘justified’ is a relative gradable adjective – telling against the thought that ‘rational belief’ and ‘justified belief’ are synonymous. I will then argue that the burden of proof is on those who would equate rationality and justification, making the case that those who hold this prominent position face the difficulty of explaining how rationality and justification come to the same thing even though ‘rational’ and ‘justified’ are not synonymous

Not wacky vs. definitely wacky: A study of scalar adverbs in pretrained language models

Vector space models of word meaning all share the assumption that words occurring in similar contexts have similar meanings. In such models, words that are similar in their topical associations but differ in their logical force tend to emerge as semantically close, creating well-known challenges for NLP applications that involve logical reasoning. Modern pretrained language models, such as BERT, RoBERTa and GPT-3 hold the promise of performing better on logical tasks than classic static word embeddings. However, reports are mixed about their success. In the current paper, we advance this discussion through a systematic study of scalar adverbs, an under-explored class of words with strong logical force. Using three different tasks, involving both naturalistic social media data and constructed examples, we investigate the extent to which BERT, RoBERTa, GPT-2 and GPT-3 exhibit general, human-like, knowledge of these common words. We ask: 1) Do the models distinguish amongst the three semantic categories of MODALITY, FREQUENCY and DEGREE? 2) Do they have implicit representations of full scales from maximally negative to maximally positive? 3) How do word frequency and contextual factors impact model performance? We find that despite capturing some aspects of logical meaning, the models fall far short of human performance.Comment: Published in BlackBoxNLP workshop, EMNLP 202

The semantics of the native greek verb suffixes / Chariton Charitonidis

The aim of this paper is to give the semantic profile of the Greek verb-deriving suffixes -íz(o), -én(o), -év(o), -ón(o), -(i)áz(o), and -ín(o), with a special account of the ending -áo/-ó. The patterns presented are the result of an empirical analysis of data extracted from extended interviews conducted with 28 native Greek speakers in Athens, Greece in February 2009. In the first interview task the test persons were asked to force(=create) verbs by using the suffixes -ízo, -évo, -óno, -(i)ázo, and -íno and a variety of bases which conformed to the ontological distinctions made in Lieber (2004). In the second task the test persons were asked to evaluate three groups of forced verbs with a noun, an adjective, and an adverb, respectively, by using one (best/highly acceptable verb) to six (worst/unacceptable verb) points. In the third task nineteen established verb pairs with different suffixes and the ending -áo/-ó were presented. The test persons were asked to report whether there was some difference between them and what exactly this difference was. The differences reported were transformed into 16 alternations. In the fourth task 21 established verbs with different suffixes were presented. The test persons were asked to give the "opposite" or "near opposite" expression for each verb. The rationale behind this task was to arrive at the meaning of the suffixes through the semantics of the opposites. In the analysis Rochelle's Lieber's (2004) theoretical framework is used. The results of the analysis suggest (i) a sign-based treatment of affixes, (ii) a vertical preference structure in the semantic structure of the head suffixes which takes into account the semantic make-up of the bases, and (iii) the integration of socioexpressive meaning into verb structures

Sentiment polarity shifters : creating lexical resources through manual annotation and bootstrapped machine learning

Alleviating pain is good and abandoning hope is bad. We instinctively understand how words like "alleviate" and "abandon" affect the polarity of a phrase, inverting or weakening it. When these words are content words, such as verbs, nouns and adjectives, we refer to them as polarity shifters. Shifters are a frequent occurrence in human language and an important part of successfully modeling negation in sentiment analysis; yet research on negation modeling has focussed almost exclusively on a small handful of closed class negation words, such as "not", "no" and "without. A major reason for this is that shifters are far more lexically diverse than negation words, but no resources exist to help identify them. We seek to remedy this lack of shifter resources. Our most central step towards this is the creation of a large lexicon of polarity shifters that covers verbs, nouns and adjectives. To reduce the prohibitive cost of such a large annotation task, we develop a bootstrapping approach that combines automatic classification with human verification. This ensures the high quality of our lexicon while reducing annotation cost by over 70%. In designing the bootstrap classifier we develop a variety of features which use both existing semantic resources and linguistically informed text patterns. In addition we investigate how knowledge about polarity shifters might be shared across different parts of speech, highlighting both the potential and limitations of such an approach. The applicability of our bootstrapping approach extends beyond the creation of a single resource. We show how it can further be used to introduce polarity shifter resources for other languages. Through the example case of German we show that all our features are transferable to other languages. Keeping in mind the requirements of under-resourced languages, we also explore how well a classifier would do when relying only on data- but not resource-driven features. We also introduce ways to use cross-lingual information, leveraging the shifter resources we previously created for other languages. Apart from the general question of which words can be polarity shifters, we also explore a number of other factors. One of these is the matter of shifting directions, which indicates whether a shifter affects positive polarities, negative polarities or whether it can shift in either direction. Using a supervised classifier we add shifting direction information to our bootstrapped lexicon. For other aspects of polarity shifting, manual annotation is preferable to automatic classification. Not every word that can cause polarity shifting does so for every of its word senses. As word sense disambiguation technology is not robust enough to allow the automatic handling of such nuances, we manually create a complete sense-level annotation of verbal polarity shifters. To verify the usefulness of the lexica which we create, we provide an extrinsic evaluation in which we apply them to a sentiment analysis task. In this task the different lexica are not only compared amongst each other, but also against a state-of-the-art compositional polarity neural network classifier that has been shown to be able to implicitly learn the negating effect of negation words from a training corpus. However, we find that the same is not true for the far more lexically diverse polarity shifters. Instead, the use of the explicit knowledge provided by our shifter lexica brings clear gains in performance.Deutsche Forschungsgesellschaf

Quantification and scales in change

This volume contains thematic papers on semantic change which emerged from the second edition of Formal Diachronic Semantics held at Saarland University. Its authorship ranges from established scholars in the field of language change to advanced PhD students whose contributions have equally qualified and have been selected after a two-step peer-review process. The key foci are variablity and diachronic trajectories in scale structures and quantification, but readers will also find a variety of further (and clearly non-disjoint) issues covered including reference, modality, givenness, presuppositions, alternatives in language change, temporality, epistemic indefiniteness, as well as - in more general terms - the interfaces of semantics with syntax, pragmatics and morphology. Given the nature of the field, the contributions are primarily based on original corpus studies (in one case also on synchronic experimental data) and present a series of new findings and theoretical analyses of several languages, first and foremost from the Germanic and Romance subbranches of Indo-European (English, French, German, Italian, Spanish) and from Semitic (with an analysis of universal quantification in Biblical Hebrew)