Probing the Statistical Properties of Unknown Texts: Application to the Voynich Manuscript

While the use of statistical physics methods to analyze large corpora has been useful to unveil many patterns in texts, no comprehensive investigation has been performed on the interdependence between syntactic and semantic factors. In this study we propose a framework for determining whether a text (e.g., written in an unknown alphabet) is compatible with a natural language and to which language it could belong. The approach is based on three types of statistical measurements, i.e. obtained from first-order statistics of word properties in a text, from the topology of complex networks representing texts, and from intermittency concepts where text is treated as a time series. Comparative experiments were performed with the New Testament in 15 different languages and with distinct books in English and Portuguese in order to quantify the dependency of the different measurements on the language and on the story being told in the book. The metrics found to be informative in distinguishing real texts from their shuffled versions include assortativity, degree and selectivity of words. As an illustration, we analyze an undeciphered medieval manuscript known as the Voynich Manuscript. We show that it is mostly compatible with natural languages and incompatible with random texts. We also obtain candidates for keywords of the Voynich Manuscript which could be helpful in the effort of deciphering it. Because we were able to identify statistical measurements that are more dependent on the syntax than on the semantics, the framework may also serve for text analysis in language-dependent applications

Characterizing Width Uniformity by Wave Propagation

This work describes a novel image analysis approach to characterize the uniformity of objects in agglomerates by using the propagation of normal wavefronts. The problem of width uniformity is discussed and its importance for the characterization of composite structures normally found in physics and biology highlighted. The methodology involves identifying each cluster (i.e. connected component) of interest, which can correspond to objects or voids, and estimating the respective medial axes by using a recently proposed wavefront propagation approach, which is briefly reviewed. The distance values along such axes are identified and their mean and standard deviation values obtained. As illustrated with respect to synthetic and real objects (in vitro cultures of neuronal cells), the combined use of these two features provide a powerful description of the uniformity of the separation between the objects, presenting potential for several applications in material sciences and biology.Comment: 14 pages, 23 figures, 1 table, 1 referenc

Spin and density overlaps in the frustrated Ising lattice gas

We perform large scale simulations of the frustrated Ising lattice gas, a three-dimensional lattice model of a structural glass, using the parallel tempering technique. We evaluate the spin and density overlap distributions, and the corresponding non-linear susceptibilities, as a function of the chemical potential. We then evaluate the relaxation functions of the spin and density self-overlap, and study the behavior of the relaxation times. The results suggest that the spin variables undergo a transition very similar to the one of the Ising spin glass, while the density variables do not show any sign of transition at the same chemical potential. It may be that the density variables undergo a transition at a higher chemical potential, inside the phase where the spins are frozen.Comment: 7 pages, 10 figure