LPNL: Scalable Link Prediction with Large Language Models

Exploring the application of large language models (LLMs) to graph learning is a emerging endeavor. However, the vast amount of information inherent in large graphs poses significant challenges to this process. This work focuses on the link prediction task and introduces $\textbf{LPNL}$ (Link Prediction via Natural Language), a framework based on large language models designed for scalable link prediction on large-scale heterogeneous graphs. We design novel prompts for link prediction that articulate graph details in natural language. We propose a two-stage sampling pipeline to extract crucial information from the graphs, and a divide-and-conquer strategy to control the input tokens within predefined limits, addressing the challenge of overwhelming information. We fine-tune a T5 model based on our self-supervised learning designed for link prediction. Extensive experimental results demonstrate that LPNL outperforms multiple advanced baselines in link prediction tasks on large-scale graphs

SLANG: New Concept Comprehension of Large Language Models

The dynamic nature of language, particularly evident in the realm of slang and memes on the Internet, poses serious challenges to the adaptability of large language models (LLMs). Traditionally anchored to static datasets, these models often struggle to keep up with the rapid linguistic evolution characteristic of online communities. This research aims to bridge this gap by enhancing LLMs' comprehension of the evolving new concepts on the Internet, without the high cost of continual retraining. In pursuit of this goal, we introduce $\textbf{SLANG}$, a benchmark designed to autonomously integrate novel data and assess LLMs' ability to comprehend emerging concepts, alongside $\textbf{FOCUS}$, an approach uses causal inference to enhance LLMs to understand new phrases and their colloquial context. Our benchmark and approach involves understanding real-world instances of linguistic shifts, serving as contextual beacons, to form more precise and contextually relevant connections between newly emerging expressions and their meanings. The empirical analysis shows that our causal inference-based approach outperforms the baseline methods in terms of precision and relevance in the comprehension of Internet slang and memes

Graph Descriptive Order Improves Reasoning with Large Language Model

In recent years, large language models have achieved state-of-the-art performance across multiple domains. However, the progress in the field of graph reasoning with LLM remains limited. Our work delves into this gap by thoroughly investigating graph reasoning with LLMs. In this work, we reveal the impact of the order of graph description on LLMs' graph reasoning performance, which significantly affects LLMs' reasoning abilities. By altering this order, we enhance the performance of LLMs from 42.22\% to 70\%. Furthermore, we introduce the Scaled Graph Reasoning benchmark for assessing LLMs' performance across various graph sizes and evaluate the relationship between LLMs' graph reasoning abilities and graph size. We discover that the graph reasoning performance of LLMs does not monotonically decrease with the increase in graph size. The experiments span several mainstream models, including GPT-3.5, LLaMA-2-7B, and LLaMA-2-13B, to offer a comprehensive evaluation

CaS: A key medium for C-O-S-Ca cycles in Earth

Oldhamite (CaS) is a rare mineral, which is only observed naturally in enstatite meteorites.No occurrence of CaS has been documented from other groups of meteorites and terrestrial samples. However, in experiments at 1.5 GPa/1510 K and 0.5 GPa/1320 K, when the lgfo2 is lower than -10.57 (FMQ-0.52), CaS was produced in this study by a two-melt mechanism involving the reaction between molten pyrrhotite-pentlandite-bearing orthopyroxenite and molten CaCO3. CaS can be easily oxidized to form CaSO4 or hydrolyzed to produce calcium hydroxide, which may explain why it has never been found in geological samples from Earth. We speculate that part of the anhydrite and gypsum in black smokers along mid-ocean ridges are related to the oxidation or hydrolysis of CaS in the underlying mantle. CaS can be produced when the Siberian mantle plume intruded into the lithosphere.Comment: The third versio

Corrigendum to: The TianQin project: current progress on science and technology

In the originally published version, this manuscript included an error related to indicating the corresponding author within the author list. This has now been corrected online to reflect the fact that author Jun Luo is the corresponding author of the article

Effect of water on the dislocation creep of enstatite aggregates at pressure of 300 MPa

This dataset includes raw data collected during the experiments and FTIR/XRD analyses data obtained from samples before and after deformation. To investigate the effect of water on the rheological properties of enstatite, we have conducted triaxial compressive creep experiments, under both water-saturated and anhydrous conditions, on enstatite aggregates using a gas-medium apparatus at the Department of Earth Sciences, University of Minnesota. Values of load, displacement, temperature and pressure versus time data were collected every second during each deformation experiment. X-ray diffraction (XRD) analyses were performed on the starting enstatite powder, the sample before and after deformation using a Rigaku-Miniflex diffractometer with cobalt target. To evaluate water saturation level of experiments, thin sections of enstatite aggregates and embedded olivine single crystals from each experiment were double-polished to a thickness of 200 to 300 µm with diamond lapping film down to a 1-μm finish for Fourier-transform infrared (FTIR) analyses. Infrared absorption spectra were collected with a Bruker Tensor 37 Fourier-transform infrared (FTIR) spectrometer

In Situ Study on Dehydration and Phase Transformation of Antigorite

Antigorite is the main carrier of water in Earth’s subduction zones. The dehydration processes of antigorite were investigated by carrying out in situ phase transition experiments using a dynamic diamond anvil cell, with a time-resolved Raman scattering system, at 0.3–10 GPa and 396–1100 K. Three typical phase transformation reactions occurred within the P–T range of this study, corresponding to three reaction products. At low pressures (<0.7 GPa), antigorite transfers to talc and forsterite; as the temperature increases, the talc disappears and a combination of forsterite and clinoenstatite occurs. At moderate pressures (1.8–7.5 GPa), antigorite dehydrates into forsterite and clinoenstatite as temperatures increase; with the continuous increase in pressure, the dehydration products become clinoenstatite and phase A. At high pressures (>8.6 GPa), the products of the dehydration phase transition of antigorite are consistently clinoenstatite and phase A. Compared with the previous studies carried out by large-volume presses (such as a multi anvil press and a piston-cylinder press), the reaction to produce phase A occurs at higher P–T conditions, and the stable temperature region for talc as a dehydration product is narrower. Moreover, large quantities of pores with 5–10 μm in diameter formed in dehydration products, supporting the hypothesis that intermediate-depth earthquakes may result from dehydration embrittlement. The precise phase boundary determined by this in situ study provides a better understanding of the dehydration phase transition behavior and geological phenomena exhibited by antigorite under different pressure and temperature conditions

Diffusion Creep of Enstatite at High Pressures Under Hydrous Conditions

Mantle convection and large-scale plate motion depend critically on the nature of the lithosphere-asthenosphere boundary and thus on the viscosity structure of Earth's upper mantle, which is determined by the rheological properties of its constituent minerals. To constrain the flow behavior of orthopyroxene, the second most abundant constituent of the upper mantle, deformation experiments were carried out in triaxial compressive creep on fine-grained (similar to 6m) samples of enstatite at high pressures (3.8-6.3GPa) and high temperatures (1323-1573K) using a deformation-DIA apparatus. Based on results from this study, the deformation behavior of enstatite is quantitatively presented in the form of a flow law that describes the dependence of deformation rate on differential stress, water fugacity, temperature, and pressure. Specifically, the creep rate depends approximately linearly on stress, indicating deformation in the diffusion creep regime. A least squares regression fit to our data yielded a flow law for diffusion creep with an activation energy of similar to 200kJ/mol and an activation volume of similar to 14x10(-6)m(3)/mol. The magnitude of the water-weakening effect is similar to that for olivine with a water fugacity exponent of r approximate to 0.7. This strong dependence of viscosity on water fugacity (concentration) indicates that the viscosity of an orthopyroxene-bearing mantle varies from one geological setting to another, depending on the large-scale water distribution. Based on the rheology contrast between olivine and enstatite, we conclude that olivine is weaker than enstatite throughout most of the upper mantle except in some shallow regions in the diffusion creep regime