1,336 research outputs found

    SoftMCL: Soft Momentum Contrastive Learning for Fine-grained Sentiment-aware Pre-training

    Full text link
    The pre-training for language models captures general language understanding but fails to distinguish the affective impact of a particular context to a specific word. Recent works have sought to introduce contrastive learning (CL) for sentiment-aware pre-training in acquiring affective information. Nevertheless, these methods present two significant limitations. First, the compatibility of the GPU memory often limits the number of negative samples, hindering the opportunities to learn good representations. In addition, using only a few sentiment polarities as hard labels, e.g., positive, neutral, and negative, to supervise CL will force all representations to converge to a few points, leading to the issue of latent space collapse. This study proposes a soft momentum contrastive learning (SoftMCL) for fine-grained sentiment-aware pre-training. Instead of hard labels, we introduce valence ratings as soft-label supervision for CL to fine-grained measure the sentiment similarities between samples. The proposed SoftMCL is conducted on both the word- and sentence-level to enhance the model's ability to learn affective information. A momentum queue was introduced to expand the contrastive samples, allowing storing and involving more negatives to overcome the limitations of hardware platforms. Extensive experiments were conducted on four different sentiment-related tasks, which demonstrates the effectiveness of the proposed SoftMCL method. The code and data of the proposed SoftMCL is available at: https://www.github.com/wangjin0818/SoftMCL/.Comment: Accepted by LREC-COLING 202

    The impact of information and communication technology (ICT) on the dynamic capabilities of supply chains

    Get PDF
    This study aimed at empirically examining the impact of information and communication technology interaction intensity among supply chain members on the dynamic capabilities of organizations. The study took Taiwan's top 1000 manufacturers as the study population, whereas the relationship between the manufacturers and their suppliers was taken as the research unit, and the respondents consisted of the executives or senior procurement specialists dealing with suppliers in the organizations. LISREL was used to verify models and test their goodness-of-fit. In the data analysis, the parameters were estimated with the default maximum likelihood estimation method. Empirical results of this research can help businesses take a closer look into how the intensity of supply chain ICT interaction impacts the dynamic capabilities of the supply chain members, so that businesses can hold on to different intensities of their supply chain ICT interactions to increase the relationship commitment and trust among the supply chain members, and further promote their dynamic capabilities

    Personalized LoRA for Human-Centered Text Understanding

    Full text link
    Effectively and efficiently adapting a pre-trained language model (PLM) for human-centered text understanding (HCTU) is challenging since user tokens are million-level in most personalized applications and do not have concrete explicit semantics. A standard and parameter-efficient approach (e.g., LoRA) necessitates memorizing numerous suits of adapters for each user. In this work, we introduce a personalized LoRA (PLoRA) with a plug-and-play (PnP) framework for the HCTU task. PLoRA is effective, parameter-efficient, and dynamically deploying in PLMs. Moreover, a personalized dropout and a mutual information maximizing strategies are adopted and hence the proposed PLoRA can be well adapted to few/zero-shot learning scenarios for the cold-start issue. Experiments conducted on four benchmark datasets show that the proposed method outperforms existing methods in full/few/zero-shot learning scenarios for the HCTU task, even though it has fewer trainable parameters. For reproducibility, the code for this paper is available at: https://github.com/yoyo-yun/PLoRA.Comment: Accepted by AAAI 202

    Continuous epidermal growth factor receptor-tyrosine kinase inhibitor administration in primary lung adenocarcinoma patients harboring favorable mutations with controlled target lung tumors dose not hinder survival benefit despite small new lesions

    Get PDF
    AbstractBackgroundIn this study, we investigated the efficacy of continuous epidermal growth factor receptor (EGFR) tyrosine kinase inhibitors (TKIs) administration in lung adenocarcinoma patients harboring favorable mutations regarding the progressive disease (PD) status with appearance of indolent new lesions.MethodsFrom June 2010 to October 2012, 102 patients with lung adenocarcinoma, harboring favorable EGFR mutations and treated with EGFR-TKI were analyzed. Definite new lesions were detected during EGFR-TKI therapy, even though the primary target tumors were controlled.ResultsOf the 102 patients, 57 continued and 45 discontinued EGFR-TKI therapy. The median overall survival was 529 days for the discontinuation group and 791 days for the continuation group (p = 0.0197). Median survival time after the discontinuation of EGFR-TKI was 181 days and 115 days in the discontinuation and continuation groups, respectively (p = 0.1776), whereas median survival time after the appearance of indolent new lesions was 204 days and 262 days, respectively (p = 0.0237).ConclusionContinuous EGFR-TKI administration in favorable EGFR-mutative lung adenocarcinoma patients with controlled primary tumors did not hinder the survival benefit, despite the appearance of new lesions

    Probing the A1 to L10 Transformation in FeCuPt Using the First Order Reversal Curve Method

    Full text link
    The A1- L10 phase transformation has been investigated in (001) FeCuPt thin films prepared by atomic-scale multilayer sputtering and rapid thermal annealing (RTA). Traditional x-ray diffraction is not always applicable in generating a true order parameter, due to non-ideal crystallinity of the A1 phase. Using the first-order reversal curve (FORC) method, the A1 and L10 phases are deconvoluted into two distinct features in the FORC distribution, whose relative intensities change with the RTA temperature. The L10 ordering takes place via a nucleation-and-growth mode. A magnetization-based phase fraction is extracted, providing a quantitative measure of the L10 phase homogeneity.Comment: 17 pages, 5 figures, 4 page supplementary material (4 figures
    • …
    corecore