While discourse relations can be signaled explicitly with conjunctions (Ex. 1) or adverbials (Ex. 2), (1) “We’ve started trying just about anything to keep sales moving in the stores, ” says Kim Renk, a Swank vice president. But there are limits. [wsj0280]1 (2) They both called it a “welcome home ” gathering. Nevertheless, an ANC rally by any other name is still an ANC rally. [wsj0559] we also find sentences (Ex. 3–5) with both forms of DRD: (3) If that became public knowledge, the last bit of influence she had over her bank would be gone. So instead she hardened her soul and pretended to be a banker who was working her own will. [COCA] (4) It’s past ten. I could go to bed but instead I crawl out the window onto my little roof with the joint behind my ear. [COCA] (5) Appealing to a young audience, he scraps an old reference to Ozzie and Harriet and instead quotes the Grateful Dead. [wsj 1615] In such cases, the conjunction and adverbial can each signal a distinct discourse relation. A previous crowd-sourced study of four adverbials that can co-occur with conjunctions (Jiang, 2013) asked respon

Clark, Chris

Dickinson, Anna

Louis, Annie

Rohde, Hannah

Webber, Bonnie

Anna Dickinson

Hannah Rohde

Annie Louis

Chris Clark

Bonnie Webber

CiteSeerX

Crowd-Sourcing Concurrent Relations

Edinburgh Research Explorer

     Edinburgh Research Explorer                                      Crowdsourcing concurrent relationsCitation for published version:Dickinson, A, Rohde, H, Louis, A, Clark, C & Webber, B 2015, 'Crowdsourcing concurrent relations' FirstConference of the TextLink COST Action Network on "Structuring Discourse in Multilingual Europe".Louvain-la-Neuve, Belgium, Belgium, 1/01/15, .Link:Link to publication record in Edinburgh Research ExplorerDocument Version:Other versionGeneral rightsCopyright for the publications made accessible via the Edinburgh Research Explorer is retained by the author(s)and / or other copyright owners and it is a condition of accessing these publications that users recognise andabide by the legal requirements associated with these rights.Take down policyThe University of Edinburgh has made every reasonable effort to ensure that Edinburgh Research Explorercontent complies with UK legislation. If you believe that the public display of this file breaches copyright pleasecontact openaccess@ed.ac.uk providing details, and we will remove access to the work immediately andinvestigate your claim.Download date: 05. Apr. 2019Crowd-Sourcing Concurrent RelationsAnna Dickinson, Hannah Rohde, Annie Louis, Chris Clark and Bonnie WebberUniversity of EdinburghWhile discourse relations can be signaled explicitly with conjunctions (Ex. 1) or adverbials (Ex. 2),(1) “We’ve started trying just about anything to keep sales moving in the stores,” says Kim Renk, aSwank vice president. But there are limits. [wsj0280]1(2) They both called it a “welcome home” gathering. Nevertheless, an ANC rally by any other nameis still an ANC rally. [wsj0559]we also find sentences (Ex. 3–5) with both forms of DRD:(3) If that became public knowledge, the last bit of influence she had over her bank would be gone.So instead she hardened her soul and pretended to be a banker who was working her own will.[COCA](4) It’s past ten. I could go to bed but instead I crawl out the window onto my little roof with thejoint behind my ear. [COCA](5) Appealing to a young audience, he scraps an old reference to Ozzie and Harriet and instead quotesthe Grateful Dead. [wsj 1615 ]In such cases, the conjunction and adverbial can each signal a distinct discourse relation. A previouscrowd-sourced study of four adverbials that can co-occur with conjunctions (Jiang, 2013) asked respon-dents to insert a conjunction that had either been removed from a passage (using examples like 3-5)or never appeared (as in 6-7). The study of 100 passages (each viewed by 52 respondents) showed astrong distinction between different adverbials: With after all, they had an overall preference for because,whereas with instead, they varied passage-by-passage, reliably inserting but in (6) and so in (7):(6) Logically, she should be dead. Instead, she feels fine, caring for her daughters and walking apedometer-measured two miles a day. [COCA](7) He suspected he shouldn’t say that. Instead he lied. [COCA]We call these concurrent relations because, as Jiang’s study shows, even without an explicit conjunction,two separate senses are concurrently conveyed. Ours is a study of concurrent relations. We aim toestablish which discourse adverbials co-occur with conjunctions and which conjunctions each adverbiallicenses and favors. Concurrent relations are a challenge for psycholinguists interested in whether anexplicit linguistic signal is only needed when other evidence is too weak (a matter of discourse efficiency).They are also a challenge for language technology, which has heretofore assumed that a discourse relationwas either signalled explicitly or inferred based on other clues, but not both at the same time.0e+001e+082e+083e+084e+08thenhoweveroverallthereforeactuallythusfor exampleotherwisefinallyin factin additioninsteadpreviouslyas a resultfirstin particularhencelaterfor instancemoreoveron the other handfurthermoreindeedyetsimilarlytherebysecondaccordinglyneverthelessadditionallyin other wordsmeanwhilethat is consequentlyin turnstillin the endafterwardsalternativelylikewisethereafteras wellnextspecificallynonethelessfirst of allearlierthat isever sincein the meantimethirdbesideslater onin contrastfor this reasonsecondlyat leastin returnultimatelyon the one handafterwardfirstlyby thenin responseby constrastfourthyet separatelysimultaneouslywhat's morethirdlystill by comparisonby contrast second in contrast later indeed first besides ultimately secondly third fourthlyat least earlier thirdly specifically fourth next however as well inteadsimultaneously separately firstly fourthly by contrastby comparison simultanouslyadverbialcountcounts of all instances of an adverbial, with or without conjunctionFigure 1: Adverbial ngram frequency: counts consist of instances with or without conjunction1References of this form are to files in the 1989 Wall Street Journal section of the Penn TreeBank.a. therefore b. nevertheless c. otherwise d. for exampleFigure 2: Sample adverbials with skewed distributions across conjunctionsa. instead b. in general c. after all d. first of allFigure 3: Sample adverbials with broader distributions across conjunctionsWe have used Google N-grams to categorize discourse adverbials by frequency (high vs. low) and co-occurence with conjunctions (skewed vs. uniform). Frequency of use is shown in Figure 1, where ‘use’was restricted to an approximation of adverbial contexts (e.g., sentence-initial overall followed by acomma to filter out adjectival uses). While no adverbial was found to occur most frequently with aconjunction, the majority of adverbials had clear conjunction preferences (Figure 2), while some had abroader distribution (Figure 3). We speculate that adverbials with a strong conjunction bias may havean underlying semantic reason for that choice (perhaps an adverbial that signals consequence can onlycombine with a conjunction of that type), whereas adverbials that combine more flexibly with a set ofconjunctions may permit properties of the linked propositions to determine the relevant conjunction.Using a web interface akin to the one shown in Figure 4, the project will crowd-source judgments soas to replicate Jiang’s experiment more systematically and with broader coverage. The first datasettargets 20 adverbials, including the four tested by Jiang (actually, after all, first of all, for example, forinstance, however, in fact, in general, in other words, indeed, instead, nevertheless, nonetheless, on theone hand, on the other hand, otherwise, specifically/more specifically, then, therefore, thus), appearingin 50 passages each. As in Jiang’s experiment, in half the passages, an overt conjunction was presentin the original text, while in the other half, the adverbial originally appeared alone. Passages havebeen drawn primarily from the New York Times Annotated Corpus (Sandhaus, 2008) and the Corpus ofContemporary American English, using web text as needed for rarer conjunction-adverbial combinations.A pre-test was conducted on the 20 targeted adverbials to pilot the interface and test whether otheradverbials show patterns similar to what Jiang (2013) found for her small set. Three of the co-authors,who were naive to the status of each passage (as underlyingly implicit vs. explicit), judged a total of 760passages, 260 implicit and 500 explicit. Their judgments confirmed Jiang’s results: For example, in theimplicit after all passages, at least one judge responded with because in all but one case; likewise, in theafter all passages which had originally appeared with an explicit conjunction, judges over-estimated theuse of because for passages with an original and or but. In contrast, other adverbials were found to bemore sensitive to the passage they appeared in: In the instead passages, for example, there was no singlepreferred conjunction. The example depicted in Figure 4 had an explicit so in the original text, thoughother senses are available (and and but are both plausible).The pre-test pointed to several potential sources of judgment variability that we must be alert to in thecrowd-sourced results. First, different readers may interpret the instructions differently. Currently, theinstructions read (in part) Your job is to make explicit the meaning that links the adjacent text spans.You must make a choice even if the insertion leads to an awkward or lengthy sentence, as long as youthink the word brings out the meaning that links the adjacent text spans. It is possible that readers maynot understand that they are being encouraged to make a sense judgment about the author’s intendedmeaning, rather than a stylistic judgement about passage readability. The different specificity of theconjunctions may add further variability: Can we assume that a judgment to insert so is a more specific—2but not conflicting—judgment than and, such that a passage for which readers selected a mix of so andand is not necessarily an ambiguous passage? Even if yes, the pre-test has revealed that certain passagespermit multiple conjunctions that are not necessarily more or less specific variants of each other. Considerexample (8):(8) You got to be nice to them otherwise, they’re not going to be nice to you.While this passage had an explicit or in the original text, pre-test readers assigned a mix of or andbecause. And while these two conjunctions are typically associated with very different meanings, theyseem to convey the same meaning here.In summary, in contrast to models of DRD usage that assume that if one DRD is present in a passage, itsignals a single relationship, our data raise three points: (i) there are many cases in which a DRD doesnot act alone (because afterall); (ii) a given DRD need not admit the presence of only one additional rela-tionship (instead with but or so or because); and (iii) discourse adverbials differ in the way they combinewith possible conjunctions—some demonstrating a clear preference, while others are more flexible.Figure 4: Experiment interface used during the pre-test, permiting either a conjunction to be selected orthe example to be ‘vetoed’. The passage depicted appeared with so in the original text.ReferencesXi Jiang. Predicting the use and interpretation of implicit and explicit discourse connectives. MSc inEnglish Language, Linguistics and English Language (LEL), University of Edinburgh, 2013.Evan Sandhaus. New York Times Annotated Corpus: Corpus overview. LDC catalogue entryLDC2008T19, 2008.3

Crowdsourcing concurrent relations

http://www.lel.ed.ac.uk/%7Ehrohde/presentations/DickinsonRohdeLouisClarkWebber.2015.abstract.pdf

Crowdsourcing concurrent relations

Abstract

Similar works

Full text

Available Versions

CiteSeerX

Edinburgh Research Explorer