Extrinsic Jensen-Shannon Divergence: Applications to Variable-Length Coding

This paper considers the problem of variable-length coding over a discrete memoryless channel (DMC) with noiseless feedback. The paper provides a stochastic control view of the problem whose solution is analyzed via a newly proposed symmetrized divergence, termed extrinsic Jensen-Shannon (EJS) divergence. It is shown that strictly positive lower bounds on EJS divergence provide non-asymptotic upper bounds on the expected code length. The paper presents strictly positive lower bounds on EJS divergence, and hence non-asymptotic upper bounds on the expected code length, for the following two coding schemes: variable-length posterior matching and MaxEJS coding scheme which is based on a greedy maximization of the EJS divergence. As an asymptotic corollary of the main results, this paper also provides a rate-reliability test. Variable-length coding schemes that satisfy the condition(s) of the test for parameters $R$ and $E$, are guaranteed to achieve rate $R$ and error exponent $E$. The results are specialized for posterior matching and MaxEJS to obtain deterministic one-phase coding schemes achieving capacity and optimal error exponent. For the special case of symmetric binary-input channels, simpler deterministic schemes of optimal performance are proposed and analyzed.Comment: 17 pages (two-column), 4 figures, to appear in IEEE Transactions on Information Theor

Stochasticity & Predictability in Terrestrial Planet Formation

Terrestrial planets are thought to be the result of a vast number of gravitational interactions and collisions between smaller bodies. We use numerical simulations to show that practically identical initial conditions result in a wide array of final planetary configurations. This is a result of the chaotic evolution of trajectories which are highly sensitive to minuscule displacements. We determine that differences between systems evolved from virtually identical initial conditions can be larger than the differences between systems evolved from very different initial conditions. This implies that individual simulations lack predictive power. For example, there is not a reproducible mapping between the initial and final surface density profiles. However, some key global properties can still be extracted if the statistical spread across many simulations is considered. Based on these spreads, we explore the collisional growth and orbital properties of terrestrial planets which assemble from different initial conditions (we vary the initial planetesimal distribution, planetesimal masses, and giant planet orbits). Confirming past work, we find that the resulting planetary systems are sculpted by sweeping secular resonances. Configurations with giant planets on eccentric orbits produce fewer and more massive terrestrial planets on tighter orbits than those with giants on circular orbits. This is further enhanced if the initial mass distribution is biased to the inner regions. In all cases, the outer edge of the system is set by the final location of the $\nu_6$ resonance and we find that the mass distribution peaks at the $\nu_5$ resonance. Using existing observations, we find that extrasolar systems follow similar trends. Although differences between our numerical modelling and exoplanetary systems remain, we suggest that CoRoT-7, HD 20003, and HD 20781 may host undetected giant planets.Comment: replaced to match published version, 20 pages, 11 figures, published in MNRAS, simulation outputs available at https://cheleb.net/astro/sp15