223 research outputs found
mPMR: A Multilingual Pre-trained Machine Reader at Scale
We present multilingual Pre-trained Machine Reader (mPMR), a novel method for
multilingual machine reading comprehension (MRC)-style pre-training. mPMR aims
to guide multilingual pre-trained language models (mPLMs) to perform natural
language understanding (NLU) including both sequence classification and span
extraction in multiple languages. To achieve cross-lingual generalization when
only source-language fine-tuning data is available, existing mPLMs solely
transfer NLU capability from a source language to target languages. In
contrast, mPMR allows the direct inheritance of multilingual NLU capability
from the MRC-style pre-training to downstream tasks. Therefore, mPMR acquires
better NLU capability for target languages. mPMR also provides a unified solver
for tackling cross-lingual span extraction and sequence classification, thereby
enabling the extraction of rationales to explain the sentence-pair
classification process.Comment: To appear at ACL 2023 main conferenc
Research on natural frequency of structure considering elastic joint with interval uncertainty
An efficient method, namely fixed interface mode synthesis-interval factor method (FIMS-IFM), is proposed to calculate the natural frequency of structure considering elastic joint with interval uncertainty. In this proposed method, the interval uncertain elastic joint is treated as spatial beam element with interval uncertain material parameters. Additionally, both the proposed method and Monte-Carlo simulation method are used to calculate the natural frequency of a specially designed structure with interval uncertain elastic joint. A meaningful conclusion can be acquired via comparing the calculation results of the two methods that, FIMS-IFM is correct and high-efficiency
Corrosion Performance of Embedded Steel Bar in Cl--contaminated Limestone Calcined Clay Cement (LC3) at initial stage of hydration
Limestone Calcined Clay Cement (LC3) presents brilliant properties in binding Cl- so that the embedded steel bars are probably protected in Cl--contaminated condition, which meets the need of sea sand application. However, the corrosion performance of steel bars embedded in LC3 paste with Cl‑ is unclear, especially in early age hydration. Thus, a series of experiments were carried out to evaluate the corrosion performance of steel bars on initial and hardened stages of hydration, including concentration of OH- and Cl- in real pore solution, open circuit potential (OCP) and chemical elements of steel bars. In terms of early age hydration, the OCP of steel bars and ions concentration in pore solution indicated that both specimens embedded in PC and LC3 pastes were at a highly corrosion state, however, elemental results showed that no obvious corrosion happened at this stage. With respect to hardened age hydration, visual corrosion could be seen on PC-embedded steel bars, with more Fe3+ and O2-, in comparison with LC3-embedded one, which was related to the much lower absolute OCP and Cl- concentration in pore solution. Overall, LC3 cement demonstrates protective effect on steel bar in special contaminated-Cl- concentration
Stage-by-stage Wavelet Optimization Refinement Diffusion Model for Sparse-View CT Reconstruction
Diffusion models have emerged as potential tools to tackle the challenge of
sparse-view CT reconstruction, displaying superior performance compared to
conventional methods. Nevertheless, these prevailing diffusion models
predominantly focus on the sinogram or image domains, which can lead to
instability during model training, potentially culminating in convergence
towards local minimal solutions. The wavelet trans-form serves to disentangle
image contents and features into distinct frequency-component bands at varying
scales, adeptly capturing diverse directional structures. Employing the Wavelet
transform as a guiding sparsity prior significantly enhances the robustness of
diffusion models. In this study, we present an innovative approach named the
Stage-by-stage Wavelet Optimization Refinement Diffusion (SWORD) model for
sparse-view CT reconstruction. Specifically, we establish a unified
mathematical model integrating low-frequency and high-frequency generative
models, achieving the solution with optimization procedure. Furthermore, we
perform the low-frequency and high-frequency generative models on wavelet's
decomposed components rather than sinogram or image domains, ensuring the
stability of model training. Our method rooted in established optimization
theory, comprising three distinct stages, including low-frequency generation,
high-frequency refinement and domain transform. Our experimental results
demonstrate that the proposed method outperforms existing state-of-the-art
methods both quantitatively and qualitatively
An Improved Model of Physical and Emotional Social Defeat: Different Effects on Social Behavior and Body Weight of Adolescent Mice by Interaction With Social Support
Social stress is a prevalent etiological environmental factor that can affect health, especially during adolescence. Either experiencing or witnessing a traumatic event during adolescence can increase the risk of psychiatric disorders, such as PTSD. The present study attempted to establish an improved social stress model to better distinguish the effects of physical and emotional social stress on the behavior and physiology of adolescent mice. In addition, we investigated how social support affected these stress-induced changes in social behavior. On PND 28, male littermates were exposed to either physical stress (PS) or emotional stress (ES), afterwards, half of them were paired-housed and the others were singly housed. The PS exposed mice were directly confronted with a violent aggressor using the social defeat stress (SDS) paradigm for 15 min/trial (with the total of 10 trials randomly administered over a week), while the ES exposed mice were placed in a neighboring compartment to witness the PS procedure. Our results indicate that both stressors induced an effective stress response in adolescent mice, but PS and ES had differential influence in the context of relevant social anxiety/fear and social interaction with peers. Additionally, social support following stress exposure exerted beneficial effects on the social anxiety/fear in ES exposed mice, but not on PS exposed mice, suggesting that the type of stressor may affect the intervention efficacy of social support. These findings provide extensive evidence that physical and emotional stressors induce different effects. Moreover, ES exposed mice, rather than PS exposed mice, seemed to benefit from social support. In summary, the study suggests that this paradigm will be helpful in investigating the effects of psychological intervention for the treatment of stress-related psychiatric disorders
From Clozing to Comprehending: Retrofitting Pre-trained Language Model to Pre-trained Machine Reader
We present Pre-trained Machine Reader (PMR), a novel method to retrofit
Pre-trained Language Models (PLMs) into Machine Reading Comprehension (MRC)
models without acquiring labeled data. PMR is capable of resolving the
discrepancy between model pre-training and downstream fine-tuning of existing
PLMs, and provides a unified solver for tackling various extraction tasks. To
achieve this, we construct a large volume of general-purpose and high-quality
MRC-style training data with the help of Wikipedia hyperlinks and design a Wiki
Anchor Extraction task to guide the MRC-style pre-training process. Although
conceptually simple, PMR is particularly effective in solving extraction tasks
including Extractive Question Answering and Named Entity Recognition, where it
shows tremendous improvements over previous approaches especially under
low-resource settings. Moreover, viewing sequence classification task as a
special case of extraction task in our MRC formulation, PMR is even capable to
extract high-quality rationales to explain the classification process,
providing more explainability of the predictions
Applying latent tree analysis to classify Traditional Chinese Medicine syndromes (Zheng) in patients with psoriasis vulgari
OBJECTIVE
To treat patients with psoriasis vulgaris using Traditional Chinese Medicine (TCM), one must stratify patients into subtypes (known as TCM syndromes or Zheng) and apply appropriate TCM treatments to different subtypes. However, no unified symptom-based classification scheme of subtypes (Zheng) exists for psoriasis vulgaris. The present paper aims to classify patients with psoriasis vulgaris into different subtypes via the analysis of clinical TCM symptom and sign data.
METHODS
A cross-sectional survey was carried out in Beijing from 2005-2008, collecting clinical TCM symptom and sign data from 2764 patients with psoriasis vulgaris. Roughly 108 symptoms and signs were initially analyzed using latent tree analysis, with a selection of the resulting latent variables then used as features to cluster patients into subtypes.
RESULTS
The initial latent tree analysis yielded a model with 43 latent variables. The second phase of the analysis divided patients into three subtype groups with clear TCM Zheng connotations: 'blood deficiency and wind dryness'; 'blood heat'; and 'blood stasis'.
CONCLUSIONS
Via two-phase analysis of clinic symptom and sign data, three different Zheng subtypes were identified for psoriasis vulgaris. Statistical characteristics of the three subtypes are presented. This constitutes an evidence-based solution to the syndromedifferentiation problem that exists with psoriasis vulgaris
- …