49 research outputs found
Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-grained Student Ensemble
Distantly-Supervised Named Entity Recognition (DS-NER) effectively alleviates
the data scarcity problem in NER by automatically generating training samples.
Unfortunately, the distant supervision may induce noisy labels, thus
undermining the robustness of the learned models and restricting the practical
application. To relieve this problem, recent works adopt self-training
teacher-student frameworks to gradually refine the training labels and improve
the generalization ability of NER models. However, we argue that the
performance of the current self-training frameworks for DS-NER is severely
underestimated by their plain designs, including both inadequate student
learning and coarse-grained teacher updating. Therefore, in this paper, we make
the first attempt to alleviate these issues by proposing: (1) adaptive teacher
learning comprised of joint training of two teacher-student networks and
considering both consistent and inconsistent predictions between two teachers,
thus promoting comprehensive student learning. (2) fine-grained student
ensemble that updates each fragment of the teacher model with a temporal moving
average of the corresponding fragment of the student, which enhances consistent
predictions on each model fragment against noise. To verify the effectiveness
of our proposed method, we conduct experiments on four DS-NER datasets. The
experimental results demonstrate that our method significantly surpasses
previous SOTA methods.Comment: Accepted at AAAI 202
Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Data
Inspired by early research on exploring naturally annotated data for Chinese
word segmentation (CWS), and also by recent research on integration of speech
and text processing, this work for the first time proposes to mine word
boundaries from parallel speech/text data. First we collect parallel
speech/text data from two Internet sources that are related with CWS data used
in our experiments. Then, we obtain character-level alignments and design
simple heuristic rules for determining word boundaries according to pause
duration between adjacent characters. Finally, we present an effective
complete-then-train strategy that can better utilize extra naturally annotated
data for model training. Experiments demonstrate our approach can significantly
boost CWS performance in both cross-domain and low-resource scenarios.Comment: latest versio
How Well Do Large Language Models Understand Syntax? An Evaluation by Asking Natural Language Questions
While recent advancements in large language models (LLMs) bring us closer to
achieving artificial general intelligence, the question persists: Do LLMs truly
understand language, or do they merely mimic comprehension through pattern
recognition? This study seeks to explore this question through the lens of
syntax, a crucial component of sentence comprehension. Adopting a natural
language question-answering (Q&A) scheme, we craft questions targeting nine
syntactic knowledge points that are most closely related to sentence
comprehension. Experiments conducted on 24 LLMs suggest that most have a
limited grasp of syntactic knowledge, exhibiting notable discrepancies across
different syntactic knowledge points. In particular, questions involving
prepositional phrase attachment pose the greatest challenge, whereas those
concerning adjectival modifier and indirect object are relatively easier for
LLMs to handle. Furthermore, a case study on the training dynamics of the LLMs
reveals that the majority of syntactic knowledge is learned during the initial
stages of training, hinting that simply increasing the number of training
tokens may not be the `silver bullet' for improving the comprehension ability
of LLMs.Comment: 20 pages, 6 figure
Extremely large magnetoresistance in topologically trivial semimetal -WP
Extremely large magnetoresistance (XMR) was recently discovered in many
non-magnetic materials, while its underlying mechanism remains poorly
understood due to the complex electronic structure of these materials. Here, we
report an investigation of the -phase WP, a topologically trivial
semimetal with monoclinic crystal structure (C2/m), which contrasts to the
recently discovered robust type-II Weyl semimetal phase in -WP. We
found that -WP exhibits almost all the characteristics of XMR
materials: the near-quadratic field dependence of MR, a field-induced up-turn
in resistivity following by a plateau at low temperature, which can be
understood by the compensation effect, and high mobility of carriers confirmed
by our Hall effect measurements. It was also found that the normalized MRs
under different magnetic fields has the same temperature dependence in
-WP, the Kohler scaling law can describe the MR data in a wide
temperature range, and there is no obvious change in the anisotropic parameter
value with temperature. The resistance polar diagram has a peanut
shape when field is rotated in plane, which can be understood by
the anisotropy of Fermi surface. These results indicate that both
field-induced-gap and temperature-induced Lifshitz transition are not the
origin of up-turn in resistivity in the -WP semimetal. Our findings
establish -WP as a new reference material for exploring the XMR
phenomena.Comment: 18 pages, 12 figure
Activation of aldehyde dehydrogenase-2 improves ischemic random skin flap survival in rats
ObjectiveRandom skin flaps have many applications in plastic and reconstructive surgeries. However, distal flap necrosis restricts wider clinical utility. Mitophagy, a vital form of autophagy for damaged mitochondria, is excessively activated in flap ischemia/reperfusion (I/R) injury, thus inducing cell death. Aldehyde dehydrogenase-2 (ALDH2), an allosteric tetrameric enzyme, plays an important role in regulating mitophagy. We explored whether ALDH2 activated by N-(1,3-benzodioxol-5-ylmethyl)-2,6-dichlorobenzamide (Alda-1) could reduce the risk of ischemic random skin flap necrosis, and the possible mechanism of action.MethodsModified McFarlane flap models were established in 36 male Sprague-Dawley rats assigned randomly to three groups: a low-dose Alda-1 group (10 mg/kg/day), a high-dose Alda-1 group (20 mg/kg/day) and a control group. The percentage surviving skin flap area, neutrophil density and microvessel density (MVD) were evaluated on day 7. Oxidative stress was quantitated by measuring the superoxide dismutase (SOD) and malondialdehyde (MDA) levels. Blood perfusion and skin flap angiogenesis were assessed via laser Doppler flow imaging and lead oxide-gelatin angiography, respectively. The expression levels of inflammatory cytokines (IL-1β, IL-6, and TNF-α), vascular endothelial growth factor (VEGF), ALDH2, PTEN-induced kinase 1 (PINK1), and E3 ubiquitin ligase (Parkin) were immunohistochemically detected. Indicators of mitophagy such as Beclin-1, p62, and microtubule-associated protein light chain 3 (LC3) were evaluated by immunofluorescence.ResultsAlda-1 significantly enhanced the survival area of random skin flaps. The SOD activity increased and the MDA level decreased, suggesting that Alda-1 reduced oxidative stress. ALDH2 was upregulated, and mitophagy-related proteins (PINK1, Parkin, Beclin-1, p62, and LC3) were downregulated, indicating that ALDH2 inhibited mitophagy through the PINK1/Parkin signaling pathway. Treatment with Alda-1 reduced neutrophil infiltration and expressions of inflammatory cytokines. Alda-1 significantly upregulated VEGF expression, increased the MVD, promoted angiogenesis, and enhanced blood perfusion.ConclusionALDH2 activation can effectively enhance random skin flap viability via inhibiting PINK1/Parkin-dependent mitophagy. Moreover, enhancement of ALDH2 activity also exerts anti-inflammatory and angiogenic properties
A technological combination of lead-glaze and calcium-glaze recently found in China: Scientific comparative analysis of glazed ceramics from Shangyu, Zhejiang Province.
To study the relationship between the glazed pottery from southern China and the lead-glazed pottery in northern China in the Han Dynasty (202BC-220AD), 34 samples unearthed from Shangyu(), Zhejiang Province have been studied by LA-ICP-AES, SEM/EDS and XRD. The results showed that these samples included the typical lead-glazed pottery, the proto-porcelain and the glazed pottery using both lead and calcium as glaze fluxing agents. Previously, the lead-glazed pottery type was considered as the main northern products during the Han dynasty while the calcium-glazed pottery type or the proto-porcelain was the representative of the south of China. However, apart from the two typical types above, a new variety of glaze categorized as the calcium-lead glaze was discovered in the samples from Shangyu. This indicates that there were technology exchanges and amalgamation of lead-glaze and calcium-glaze between the south and the north during the Han Dynasty. As a result, a new type of glazed potteries with both features was created, which had a more beautiful appearance than the proto-porcelain but perhaps had some undesirable aspects. The manufacturing process of the new variety might also lay foundations for the invention of celadon
Edge detection depends on achromatic channel in Drosophila melanogaster
Edges represent important information in object recognition, and thus edge detection is crucial for animal survival. Various types of edges result from visual contrast, such as luminance contrast and color contrast. So far, the molecular and neural mechanisms underlying edge detection and the relationship between different edge information-processing pathways have been largely undemonstrated. In the present study, using a color light-emitting-diode-based Buridan's paradigm, we demonstrated that a blue/green demarcation is able to generate edge-orientation behavior in the adult fly. There is a blue/green intensity ratio, the so-called point of equal luminance, at which wild-type flies did not show obvious orientation behavior towards edges. This suggests that orientation behavior towards edges is dependent on luminance contrast in Drosophila. The results of mutants ninaE(17) and sev(LY3); rh5(2); rh6(1) demonstrated that achromatic R1-R6 photoreceptor cells, but not chromatic R7/R8 photoreceptor cells, were necessary for orientation behavior towards edges. Moreover, ectopic expression of rhodopsin 4 (Rh4), Rh5 or Rh6 could efficiently restore the edge-orientation defect in the ninaE(17) mutant. Altogether, our results show that R1-R6 photoreceptor cells are both necessary and sufficient for orientation behavior towards edges in Drosophila