132 research outputs found

    Segatron: Segment-Aware Transformer for Language Modeling and Understanding

    Full text link
    Transformers are powerful for sequence modeling. Nearly all state-of-the-art language models and pre-trained language models are based on the Transformer architecture. However, it distinguishes sequential tokens only with the token position index. We hypothesize that better contextual representations can be generated from the Transformer with richer positional information. To verify this, we propose a segment-aware Transformer (Segatron), by replacing the original token position encoding with a combined position encoding of paragraph, sentence, and token. We first introduce the segment-aware mechanism to Transformer-XL, which is a popular Transformer-based language model with memory extension and relative position encoding. We find that our method can further improve the Transformer-XL base model and large model, achieving 17.1 perplexity on the WikiText-103 dataset. We further investigate the pre-training masked language modeling task with Segatron. Experimental results show that BERT pre-trained with Segatron (SegaBERT) can outperform BERT with vanilla Transformer on various NLP tasks, and outperforms RoBERTa on zero-shot sentence representation learning.Comment: Accepted by AAAI 202

    Developing Fairness Rules for Talent Intelligence Management System

    Get PDF
    Talent management is an important business strategy, but inherently expensive due to the unique, subjective, and developing nature of each talent. Applying artificial intelligence (AI) to analyze large-scale data, talent intelligence management system (TIMS) is intended to address the talent management problems of organizations. While TIMS has greatly improved the efficiency of talent management, especially in the processes of talent selection and matching, high-potential talent discovery and talent turnover prediction, it also brings new challenges. Ethical issues, such as how to maintain fairness when designing and using TIMS, are typical examples. Through the Delphi study in a leading global AI company, this paper proposes eight fairness rules to avoid fairness risks when designing TIMS

    Design, Implementation and Modeling of Flooding Disaster-Oriented USV

    Get PDF
    Although there exist some unmanned surface platforms, and parts of them have been applied in flooding disaster relief, the autonomy of these platforms is still so weak that most of them can only work under the control of operators. The primary reason is the difficulty of obtaining a dynamical model that is sufficient rich for model-based control and sufficient simple for model parameters identification. This makes them difficult to be used to achieve some high-performance autonomous control, such as robust control with respect to disturbances and unknown dynamics and trajectory tracking control in complicated and dynamical surroundings. In this chapter, a flooding disaster-oriented unmanned surface vehicle (USV) designed and implemented by Shenyang Institute of Automation, Chinese Academy of Sciences (SIA, CAS) is introduced first, including the hardware and software structures. Then, we propose a quasi-linear parameter varying (qLPV) model to approach the dynamics of the USV system. We first apply this to solve a structured modeling problem and then introduce model error to solve an unstructured modeling problem. Subsequently, the qLPV model identification results are analyzed and the superiority compared to two linear models is demonstrated. At last, extensive application experiments, including rescuing rope throwing using an automatic pneumatic and water sampling in a 2.5 m radius circle, are described in detail to show the performance of course keeping control and GPS point tracking control based on the proposed model

    Chinese Herbal Medicine Qi Ju Di Huang Wan for the Treatment of Essential Hypertension: A Systematic Review of Randomized Controlled Trials

    Get PDF
    Background. Chinese herbs are potentially effective for hypertension. Qi Ju Di Huang Wan (QJDHW) is a commonly used Chinese herbal medicine as a monotherapy or in combination with other antihypertensive agents for the treatment of essential hypertension (EH). However, there is no critically appraised evidence such as systematic reviews or meta-analyses on the effectiveness and safety of QJDHW for EH. Methods and Findings. CENTRAL, PubMed, CBM, CNKI, VIP, and online clinical trial registry websites were searched for published and unpublished randomized controlled trials (RCTs) of QJDHW for essential hypertension up to January 2013 with no language restrictions. A total of 10 randomized trials involving 1024 patients were included. Meta-analysis showed that QJDHW combined with antihypertensive drugs was more effective in lowering blood pressure and improving TCM syndrome for the treatment of essential hypertension than antihypertensive drugs used alone. No trials reported severe adverse events related to QJDHW. Conclusions. Our review suggests that QJDHW combined with antihypertensive drugs might be an effective treatment for lowering blood pressure and improving symptoms in patients with essential hypertension. However, the finding should be interpreted with caution because of the poor methodological quality of included trials. There is an urgent need for well-designed, long-term studies to assess the effectiveness of QJDHW in the treatment of essential hypertension

    Direct Measurement of a Non-Hermitian Topological Invariant in a Hybrid Light-Matter System

    Full text link
    Topology is central to understanding and engineering materials that display robust physical phenomena immune to imperfections. Different topological phases of matter are characterised by topological invariants. In energy-conserving (Hermitian) systems, these invariants are determined by the winding of eigenstates in momentum space. In non-Hermitian systems, a novel topological invariant is predicted to emerge from the winding of the complex eigenenergies. Here, we directly measure the non-Hermitian topological invariant arising from exceptional points in the momentum-resolved spectrum of exciton polaritons. These are hybrid light-matter quasiparticles formed by photons strongly coupled to electron-hole pairs (excitons) in a halide perovskite semiconductor at room temperature. We experimentally map out both the real (energy) and imaginary (linewidth) parts of the spectrum near the exceptional points and extract the novel topological invariant - fractional spectral winding. Our work represents an essential step towards realisation of non-Hermitian topological phases in a condensed matter system
    corecore