HARP: Hierarchical Representation Learning for Networks

We present HARP, a novel method for learning low dimensional embeddings of a graph's nodes which preserves higher-order structural features. Our proposed method achieves this by compressing the input graph prior to embedding it, effectively avoiding troublesome embedding configurations (i.e. local minima) which can pose problems to non-convex optimization. HARP works by finding a smaller graph which approximates the global structure of its input. This simplified graph is used to learn a set of initial representations, which serve as good initializations for learning representations in the original, detailed graph. We inductively extend this idea, by decomposing a graph in a series of levels, and then embed the hierarchy of graphs from the coarsest one to the original graph. HARP is a general meta-strategy to improve all of the state-of-the-art neural algorithms for embedding graphs, including DeepWalk, LINE, and Node2vec. Indeed, we demonstrate that applying HARP's hierarchical paradigm yields improved implementations for all three of these methods, as evaluated on both classification tasks on real-world graphs such as DBLP, BlogCatalog, CiteSeer, and Arxiv, where we achieve a performance gain over the original implementations by up to 14% Macro F1.Comment: To appear in AAAI 201

Nuts and bolts of supersymmetry

A topological mechanism is a zero elastic-energy deformation of a mechanical structure that is robust against smooth changes in system parameters. Here, we map the nonlinear elasticity of a paradigmatic class of topological mechanisms onto linear fermionic models using a supersymmetric field theory introduced by Witten and Olive. Heuristically, this approach consists of taking the square root of a non-linear Hamiltonian and generalizes the standard procedure of obtaining two copies of Dirac equation from the square root of the linear Klein Gordon equation. Our real space formalism goes beyond topological band theory by incorporating non-linearities and spatial inhomogeneities, such as domain walls, where topological states are typically localized. By viewing the two components of the real fermionic field as site and bond displacements respectively, we determine the relation between the supersymmetry transformations and the Bogomolny-Prasad-Sommerfield (BPS) bound saturated by the mechanism. We show that the mechanical constraint, which enforces a BPS saturated kink into the system, simultaneously precludes an anti-kink. This mechanism breaks the usual kink-antikink symmetry and can be viewed as a manifestation of the underlying supersymmetry being half-broken.Comment: 14 pages, 5 figure

The Expressive Power of Word Embeddings

We seek to better understand the difference in quality of the several publicly released embeddings. We propose several tasks that help to distinguish the characteristics of different embeddings. Our evaluation of sentiment polarity and synonym/antonym relations shows that embeddings are able to capture surprisingly nuanced semantics even in the absence of sentence structure. Moreover, benchmarking the embeddings shows great variance in quality and characteristics of the semantics captured by the tested embeddings. Finally, we show the impact of varying the number of dimensions and the resolution of each dimension on the effective useful features captured by the embedding space. Our contributions highlight the importance of embeddings for NLP tasks and the effect of their quality on the final results.Comment: submitted to ICML 2013, Deep Learning for Audio, Speech and Language Processing Workshop. 8 pages, 8 figure

Kink-antikink asymmetry and impurity interactions in topological mechanical chains

We study the dynamical response of a diatomic periodic chain of rotors coupled by springs, whose unit cell breaks spatial inversion symmetry. In the continuum description, we derive a nonlinear field theory which admits topological kinks and antikinks as nonlinear excitations but where a topological boundary term breaks the symmetry between the two and energetically favors the kink configuration. Using a cobweb plot, we develop a fixed-point analysis for the kink motion and demonstrate that kinks propagate without the Peierls-Nabarro potential energy barrier typically associated with lattice models. Using continuum elasticity theory, we trace the absence of the Peierls-Nabarro barrier for the kink motion to the topological boundary term which ensures that only the kink configuration, and not the antikink, costs zero potential energy. Further, we study the eigenmodes around the kink and antikink configurations using a tangent stiffness matrix approach appropriate for pre-stressed structures to explicitly show how the usual energy degeneracy between the two no longer holds. We show how the kink-antikink asymmetry also manifests in the way these nonlinear excitations interact with impurities introduced in the chain as disorder in the spring stiffness. Finally, we discuss the effect of impurities in the (bond) spring length and build prototypes based on simple linkages that verify our predictions.Comment: 20 pages, 21 figure

The Quantum McKay Correspondence for polyhedral singularities

Let G be a polyhedral group, namely a finite subgroup of SO(3). Nakamura's G-Hilbert scheme provides a preferred Calabi-Yau resolution Y of the polyhedral singularity C^3/G. The classical McKay correspondence describes the classical geometry of Y in terms of the representation theory of G. In this paper we describe the quantum geometry of Y in terms of R, an ADE root system associated to G. Namely, we give an explicit formula for the Gromov-Witten partition function of Y as a product over the positive roots of R. In terms of counts of BPS states (Gopakumar-Vafa invariants), our result can be stated as a correspondence: each positive root of R corresponds to one half of a genus zero BPS state. As an application, we use the crepant resolution conjecture to provide a full prediction for the orbifold Gromov-Witten invariants of [C^3/G].Comment: Introduction rewritten. Issue regarding non-uniqueness of conifold resolution clarified. Version to appear in Inventione