Bias Analysis in Entropy Estimation

We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction formulas of current entropy estimates recently discussed in literature. The trade-off between bias reduction and the increase of the corresponding statistical error is analyzed.Comment: 5 pages, 3 figure

Entropy estimates of small data sets

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon, R\'enyi and Tsallis) specially devised to provide a compromise between low bias and small statistical errors, for short data series. This new estimator out-performs other currently available ones when the data sets are small and the probabilities of the possible outputs of the random variable are not close to zero. Otherwise, other well-known estimators remain a better choice. The potential range of applicability of this estimator is quite broad specially for biological and digital data series.Comment: 11 pages, 2 figure

Small-world networks: Evidence for a crossover picture

Watts and Strogatz [Nature 393, 440 (1998)] have recently introduced a model for disordered networks and reported that, even for very small values of the disorder $p$ in the links, the network behaves as a small-world. Here, we test the hypothesis that the appearance of small-world behavior is not a phase-transition but a crossover phenomenon which depends both on the network size $n$ and on the degree of disorder $p$. We propose that the average distance $\ell$ between any two vertices of the network is a scaling function of $n / n^*$. The crossover size $n^*$ above which the network behaves as a small-world is shown to scale as $n^*(p \ll 1) \sim p^{-\tau}$ with $\tau \approx 2/3$.Comment: 5 pages, 5 postscript figures (1 in color), Latex/Revtex/multicols/epsf. Accepted for publication in Physical Review Letter

Transition to Stochastic Synchronization in Spatially Extended Systems

Spatially extended dynamical systems, namely coupled map lattices, driven by additive spatio-temporal noise are shown to exhibit stochastic synchronization. In analogy with low-dymensional systems, synchronization can be achieved only if the maximum Lyapunov exponent becomes negative for sufficiently large noise amplitude. Moreover, noise can suppress also the non-linear mechanism of information propagation, that may be present in the spatially extended system. A first example of phase transition is observed when both the linear and the non-linear mechanisms of information production disappear at the same critical value of the noise amplitude. The corresponding critical properties can be hardly identified numerically, but some general argument suggests that they could be ascribed to the Kardar-Parisi-Zhang universality class. Conversely, when the non-linear mechanism prevails on the linear one, another type of phase transition to stochastic synchronization occurs. This one is shown to belong to the universality class of directed percolation.Comment: 21 pages, Latex - 14 EPS Figs - To appear on Physical Review

On the relationship between directed percolation and the synchronization transition in spatially extended systems

We study the nature of the synchronization transition in spatially extended systems by discussing a simple stochastic model. An analytic argument is put forward showing that, in the limit of discontinuous processes, the transition belongs to the directed percolation (DP) universality class. The analysis is complemented by a detailed investigation of the dependence of the first passage time for the amplitude of the difference field on the adopted threshold. We find the existence of a critical threshold separating the regime controlled by linear mechanisms from that controlled by collective phenomena. As a result of this analysis we conclude that the synchronization transition belongs to the DP class also in continuous models. The conclusions are supported by numerical checks on coupled map lattices too

Correlation property of length sequences based on global structure of complete genome

This paper considers three kinds of length sequences of the complete genome. Detrended fluctuation analysis, spectral analysis, and the mean distance spanned within time $L$ are used to discuss the correlation property of these sequences. The values of the exponents from these methods of these three kinds of length sequences of bacteria indicate that the long-range correlations exist in most of these sequences. The correlation have a rich variety of behaviours including the presence of anti-correlations. Further more, using the exponent $\gamma$, it is found that these correlations are all linear ($\gamma=1.0\pm 0.03$). It is also found that these sequences exhibit $1/f$ noise in some interval of frequency ($f>1$). The length of this interval of frequency depends on the length of the sequence. The shape of the periodogram in $f>1$ exhibits some periodicity. The period seems to depend on the length and the complexity of the length sequence.Comment: RevTex, 9 pages with 5 figures and 3 tables. Phys. Rev. E Jan. 1,2001 (to appear

Repertoires of the Nucleosome-Positioning Dinucleotides

It is generally accepted that the organization of eukaryotic DNA into chromatin is strongly governed by a code inherent in the genomic DNA sequence. This code, as well as other codes, is superposed on the triplets coding for amino acids. The history of the chromatin code started three decades ago with the discovery of the periodic appearance of certain dinucleotides, with AA/TT and RR/YY giving the strongest signals, all with a period of 10.4 bases. Every base-pair stack in the DNA duplex has specific deformation properties, thus favoring DNA bending in a specific direction. The appearance of the corresponding dinucleotide at the distance 10.4 xn bases will facilitate DNA bending in that direction, which corresponds to the minimum energy of DNA folding in the nucleosome. We have analyzed the periodic appearances of all 16 dinucleotides in the genomes of thirteen different eukaryotic organisms. Our data show that a large variety of dinucleotides (if not all) are, apparently, contributing to the nucleosome positioning code. The choice of the periodical dinucleotides differs considerably from one organism to another. Among other 10.4 base periodicities, a strong and very regular 10.4 base signal was observed for CG dinucleotides in the genome of the honey bee A. mellifera. Also, the dinucleotide CG appears as the only periodical component in the human genome. This observation seems especially relevant since CpG methylation is well known to modulate chromatin packing and regularity. Thus, the selection of the dinucleotides contributing to the chromatin code is species specific, and may differ from region to region, depending on the sequence context

How to Achieve Fast Entrainment? The Timescale to Synchronization

Entrainment, where oscillators synchronize to an external signal, is ubiquitous in nature. The transient time leading to entrainment plays a major role in many biological processes. Our goal is to unveil the specific dynamics that leads to fast entrainment. By studying a generic model, we characterize the transient time to entrainment and show how it is governed by two basic properties of an oscillator: the radial relaxation time and the phase velocity distribution around the limit cycle. Those two basic properties are inherent in every oscillator. This concept can be applied to many biological systems to predict the average transient time to entrainment or to infer properties of the underlying oscillator from the observed transients. We found that both a sinusoidal oscillator with fast radial relaxation and a spike-like oscillator with slow radial relaxation give rise to fast entrainment. As an example, we discuss the jet-lag experiments in the mammalian circadian pacemaker