Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extraction

Entities, as the essential elements in relation extraction tasks, exhibit certain structure. In this work, we formulate such structure as distinctive dependencies between mention pairs. We then propose SSAN, which incorporates these structural dependencies within the standard self-attention mechanism and throughout the overall encoding stage. Specifically, we design two alternative transformation modules inside each self-attention building block to produce attentive biases so as to adaptively regularize its attention flow. Our experiments demonstrate the usefulness of the proposed entity structure and the effectiveness of SSAN. It significantly outperforms competitive baselines, achieving new state-of-the-art results on three popular document-level relation extraction datasets. We further provide ablation and visualization to show how the entity structure guides the model for better relation extraction. Our code is publicly available.Comment: Accepted to AAAI 202

Rare earth elements in oysters and mussels collected from the Chinese coast: Bioaccumulation and human health risks

Rare earth elements (REEs) are increasingly used in various industries worldwide, resulting in their release into aquatic ecosystems. We evaluated the distribution and bioaccumulation of 14 REEs in marine sediments and biotas along the Chinese coasts. The total concentration of REEs (ΣREEs) in sediments was 41.65-170.94 mg/kg. The concentrations of ΣREEs were 1.97-4.77 and 0.62-4.96 mg/kg dry mass (DM) for oysters and mussels. The concentration of total light REEs (ΣLREEs) was higher than the concentration of total heavy REEs (ΣHREEs) at all samples. The bioaccumulation factor (BAF) of ΣLREEs was higher than ΣHREEs and BAF of ΣREE was 0.34-1.49 and 0.25-1.10 for oysters and mussels. The positive correlation between sediments and biotas was higher in mussels than oysters, showing a good potential for being environmental indicators for REEs. The risk of REEs to humans via oysters and mussels consumption could be negligible based on the estimated daily intake