178 research outputs found
Zipf's Law : Balancing signal usage cost and communication efficiency
Copyright: © 2015 Salge et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are creditedWe propose a model that explains the reliable emergence of power laws (e.g., Zipf's law) during the development of different human languages. The model incorporates the principle of least effort in communications, minimizing a combination of the information-Theoretic communication inefficiency and direct signal cost. We prove a general relationship, for all optimal languages, between the signal cost distribution and the resulting distribution of signals. Zipf's law then emerges for logarithmic signal cost distributions, which is the cost distribution expected for words constructed from letters or phonemes. Copyright:Peer reviewedFinal Published versio
Parallels of human language in the behavior of bottlenose dolphins
A short review of similarities between dolphins and humans with the help of
quantitative linguistics and information theory
Scale-free Networks from Optimal Design
A large number of complex networks, both natural and artificial, share the
presence of highly heterogeneous, scale-free degree distributions. A few
mechanisms for the emergence of such patterns have been suggested, optimization
not being one of them. In this letter we present the first evidence for the
emergence of scaling (and smallworldness) in software architecture graphs from
a well-defined local optimization process. Although the rules that define the
strategies involved in software engineering should lead to a tree-like
structure, the final net is scale-free, perhaps reflecting the presence of
conflicting constraints unavoidable in a multidimensional optimization process.
The consequences for other complex networks are outlined.Comment: 6 pages, 2 figures. Submitted to Europhysics Letters. Additional
material is available at http://complex.upc.es/~sergi/software.ht
Log-periodic oscillations due to discrete effects in complex networks
We show that discretization of internode distribution in complex networks
affects internode distances l_ij calculated as a function of degrees (k_i k_j)
and an average path length as function of network size N. For dense
networks there are log-periodic oscillations of above quantities. We present
real-world examples of such a behavior as well as we derive analytical
expressions and compare them to numerical simulations. We consider a simple
case of network optimization problem, arguing that discrete effects can lead to
a nontrivial solution.Comment: 5 pages, 5 figures, REVTE
Non-crossing dependencies: Least effort, not grammar
The use of null hypotheses (in a statistical sense) is common in hard sciences but not in theoretical linguistics. Here the null hypothesis that the low frequency of syntactic dependency crossings is expected by an arbitrary ordering of words is rejected. It is shown that this would require star dependency structures, which are both unrealistic and too restrictive. The hypothesis of the limited resources of the human brain is revisited. Stronger null hypotheses taking into account actual dependency lengths for the likelihood of crossings are presented. Those hypotheses suggests that crossings are likely to reduce when dependencies are shortened. A hypothesis based on pressure to reduce dependency lengths is more parsimonious than a principle of minimization of crossings or a grammatical ban that is totally dissociated from the general and non-linguistic principle of economy.Postprint (author's final draft
Statistical Laws Governing Fluctuations in Word Use from Word Birth to Word Death
We analyze the dynamic properties of 10^7 words recorded in English, Spanish
and Hebrew over the period 1800--2008 in order to gain insight into the
coevolution of language and culture. We report language independent patterns
useful as benchmarks for theoretical models of language evolution. A
significantly decreasing (increasing) trend in the birth (death) rate of words
indicates a recent shift in the selection laws governing word use. For new
words, we observe a peak in the growth-rate fluctuations around 40 years after
introduction, consistent with the typical entry time into standard dictionaries
and the human generational timescale. Pronounced changes in the dynamics of
language during periods of war shows that word correlations, occurring across
time and between words, are largely influenced by coevolutionary social,
technological, and political factors. We quantify cultural memory by analyzing
the long-term correlations in the use of individual words using detrended
fluctuation analysis.Comment: Version 1: 31 pages, 17 figures, 3 tables. Version 2 is streamlined,
eliminates substantial material and incorporates referee comments: 19 pages,
14 figures, 3 table
Languages cool as they expand: Allometric scaling and the decreasing need for new words
We analyze the occurrence frequencies of over 15 million words recorded in millions of books published during the past two centuries in seven different languages. For all languages and chronological subsets of the data we confirm that two scaling regimes characterize the word frequency distributions, with only the more common words obeying the classic Zipf law. Using corpora of unprecedented size, we test the allometric scaling relation between the corpus size and the vocabulary size of growing languages to demonstrate a decreasing marginal need for new words, a feature that is likely related to the underlying correlations between words. We calculate the annual growth fluctuations of word use which has a decreasing trend as the corpus size increases, indicating a slowdown in linguistic evolution following language expansion. This ‘‘cooling pattern’’ forms the basis of a third statistical regularity, which unlike the Zipf and the Heaps law, is dynamical in nature
- …