49,570 research outputs found
Comparison of the language networks from literature and blogs
In this paper we present the comparison of the linguistic networks from
literature and blog texts. The linguistic networks are constructed from texts
as directed and weighted co-occurrence networks of words. Words are nodes and
links are established between two nodes if they are directly co-occurring
within the sentence. The comparison of the networks structure is performed at
global level (network) in terms of: average node degree, average shortest path
length, diameter, clustering coefficient, density and number of components.
Furthermore, we perform analysis on the local level (node) by comparing the
rank plots of in and out degree, strength and selectivity. The
selectivity-based results point out that there are differences between the
structure of the networks constructed from literature and blogs
Complex Networks Measures for Differentiation between Normal and Shuffled Croatian Texts
This paper studies the properties of the Croatian texts via complex networks.
We present network properties of normal and shuffled Croatian texts for
different shuffling principles: on the sentence level and on the text level. In
both experiments we preserved the vocabulary size, word and sentence frequency
distributions. Additionally, in the first shuffling approach we preserved the
sentence structure of the text and the number of words per sentence. Obtained
results showed that degree rank distributions exhibit no substantial deviation
in shuffled networks, and strength rank distributions are preserved due to the
same word frequencies. Therefore, standard approach to study the structure of
linguistic co-occurrence networks showed no clear difference among the
topologies of normal and shuffled texts. Finally, we showed that the in- and
out- selectivity values from shuffled texts are constantly below selectivity
values calculated from normal texts. Our results corroborate that the node
selectivity measure can capture structural differences between original and
shuffled Croatian texts
Multilayer Network of Language: a Unified Framework for Structural Analysis of Linguistic Subsystems
Recently, the focus of complex networks research has shifted from the
analysis of isolated properties of a system toward a more realistic modeling of
multiple phenomena - multilayer networks. Motivated by the prosperity of
multilayer approach in social, transport or trade systems, we propose the
introduction of multilayer networks for language. The multilayer network of
language is a unified framework for modeling linguistic subsystems and their
structural properties enabling the exploration of their mutual interactions.
Various aspects of natural language systems can be represented as complex
networks, whose vertices depict linguistic units, while links model their
relations. The multilayer network of language is defined by three aspects: the
network construction principle, the linguistic subsystem and the language of
interest. More precisely, we construct a word-level (syntax, co-occurrence and
its shuffled counterpart) and a subword level (syllables and graphemes) network
layers, from five variations of original text (in the modeled language). The
obtained results suggest that there are substantial differences between the
networks structures of different language subsystems, which are hidden during
the exploration of an isolated layer. The word-level layers share structural
properties regardless of the language (e.g. Croatian or English), while the
syllabic subword level expresses more language dependent structural properties.
The preserved weighted overlap quantifies the similarity of word-level layers
in weighted and directed networks. Moreover, the analysis of motifs reveals a
close topological structure of the syntactic and syllabic layers for both
languages. The findings corroborate that the multilayer network framework is a
powerful, consistent and systematic approach to model several linguistic
subsystems simultaneously and hence to provide a more unified view on language
Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation
This paper surveys the current state of the art in Natural Language
Generation (NLG), defined as the task of generating text or speech from
non-linguistic input. A survey of NLG is timely in view of the changes that the
field has undergone over the past decade or so, especially in relation to new
(usually data-driven) methods, as well as new applications of NLG technology.
This survey therefore aims to (a) give an up-to-date synthesis of research on
the core tasks in NLG and the architectures adopted in which such tasks are
organised; (b) highlight a number of relatively recent research topics that
have arisen partly as a result of growing synergies between NLG and other areas
of artificial intelligence; (c) draw attention to the challenges in NLG
evaluation, relating them to similar challenges faced in other areas of Natural
Language Processing, with an emphasis on different evaluation methods and the
relationships between them.Comment: Published in Journal of AI Research (JAIR), volume 61, pp 75-170. 118
pages, 8 figures, 1 tabl
- …