Minimum Rates of Approximate Sufficient Statistics

Given a sufficient statistic for a parametric family of distributions, one can estimate the parameter without access to the data. However, the memory or code size for storing the sufficient statistic may nonetheless still be prohibitive. Indeed, for $n$ independent samples drawn from a $k$-nomial distribution with $d=k-1$ degrees of freedom, the length of the code scales as $d\log n+O(1)$. In many applications, we may not have a useful notion of sufficient statistics (e.g., when the parametric family is not an exponential family) and we also may not need to reconstruct the generating distribution exactly. By adopting a Shannon-theoretic approach in which we allow a small error in estimating the generating distribution, we construct various {\em approximate sufficient statistics} and show that the code length can be reduced to $\frac{d}{2}\log n+O(1)$. We consider errors measured according to the relative entropy and variational distance criteria. For the code constructions, we leverage Rissanen's minimum description length principle, which yields a non-vanishing error measured according to the relative entropy. For the converse parts, we use Clarke and Barron's formula for the relative entropy of a parametrized distribution and the corresponding mixture distribution. However, this method only yields a weak converse for the variational distance. We develop new techniques to achieve vanishing errors and we also prove strong converses. The latter means that even if the code is allowed to have a non-vanishing error, its length must still be at least $\frac{d}{2}\log n$.Comment: To appear in the IEEE Transactions on Information Theor

Mass Limits to Primordial Star Formation from Protostellar Feedback

How massive were the first stars? This question is of fundamental importance for galaxy formation and cosmic reionization. Here we consider how protostellar feedback can limit the mass of a forming star. For this we must understand the rate at which primordial protostars accrete, how they and their feedback output evolve, and how this feedback interacts with the infalling matter. We describe the accretion rate with an ``isentropic accretion'' model: the rate is initially very large (~0.03 M_sun/yr when m_* =1 M_sun) and declines as m_*^{-3/7}. Protostellar evolution is treated with a model that tracks the total energy of the star. A key difference compared to previous studies is allowance for rotation of the infalling envelope. This leads to photospheric conditions at the star and dramatic differences in the feedback. Two feedback mechanisms are considered: HII region breakout and radiation pressure from Lyman-alpha and FUV photons. Radiation pressure appears to be the dominant mechanism for suppressing infall, becoming dynamically important around 20 M_sun.Comment: 4 pages; To appear in proceedings of the 13th Annual Astrophysics Conference in Maryland: The Emergence of Cosmic Structure, eds. S. Holt and C. Reynolds, (AIP