We provide and critically analyze a framework to learn critical behavior in
classical partition functions through the application of non-parametric methods
to data sets of thermal configurations. We illustrate our approach in phase
transitions in 2D and 3D Ising models. First, we extend previous studies on the
intrinsic dimension of 2D partition function data sets, by exploring the effect
of volume in 3D Ising data. We find that as opposed to 2D systems for which
this quantity has been successfully used in unsupervised characterizations of
critical phenomena, in the 3D case its estimation is far more challenging. To
circumvent this limitation, we then use the principal component analysis (PCA)
entropy, a "Shannon entropy" of the normalized spectrum of the covariance
matrix. We find a striking qualitative similarity to the thermodynamic entropy,
which the PCA entropy approaches asymptotically. The latter allows us to
extract -- through a conventional finite-size scaling analysis with modest
lattice sizes -- the critical temperature with less than 1% error for both
2D and 3D models while being computationally efficient. The PCA entropy can
readily be applied to characterize correlations and critical phenomena in a
huge variety of many-body problems and suggests a (direct) link between
easy-to-compute quantities and entropies.Comment: Corrected affiliation informatio