Joint Extraction of Entities and Relations Using Reinforcement Learning and Deep Learning

We use both reinforcement learning and deep learning to simultaneously extract entities and relations from unstructured texts. For reinforcement learning, we model the task as a two-step decision process. Deep learning is used to automatically capture the most important information from unstructured texts, which represent the state in the decision process. By designing the reward function per step, our proposed method can pass the information of entity extraction to relation extraction and obtain feedback in order to extract entities and relations simultaneously. Firstly, we use bidirectional LSTM to model the context information, which realizes preliminary entity extraction. On the basis of the extraction results, attention based method can represent the sentences that include target entity pair to generate the initial state in the decision process. Then we use Tree-LSTM to represent relation mentions to generate the transition state in the decision process. Finally, we employ Q-Learning algorithm to get control policy π in the two-step decision process. Experiments on ACE2005 demonstrate that our method attains better performance than the state-of-the-art method and gets a 2.4% increase in recall-score

Finishing the euchromatic sequence of the human genome

The sequence of the human genome encodes the genetic instructions for human physiology, as well as rich information about human evolution. In 2001, the International Human Genome Sequencing Consortium reported a draft sequence of the euchromatic portion of the human genome. Since then, the international collaboration has worked to convert this draft into a genome sequence with high accuracy and nearly complete coverage. Here, we report the result of this finishing process. The current genome sequence (Build 35) contains 2.85 billion nucleotides interrupted by only 341 gaps. It covers ∼99% of the euchromatic genome and is accurate to an error rate of ∼1 event per 100,000 bases. Many of the remaining euchromatic gaps are associated with segmental duplications and will require focused work with new methods. The near-complete sequence, the first for a vertebrate, greatly improves the precision of biological analyses of the human genome including studies of gene number, birth and death. Notably, the human enome seems to encode only 20,000-25,000 protein-coding genes. The genome sequence reported here should serve as a firm foundation for biomedical research in the decades ahead

A Symmetrical Fuzzy Neural Network Regression Method Coordinating Structure and Parameter Identifications for Regression

Fuzzy neural networks have both the interpretability of fuzzy systems and the self-learning ability of neural networks, but they will face the challenge of “rule explosion” when dealing with high-dimensional data. Moreover, the structure and parameter identifications of models are generally performed in two stages, and this always attends to one thing and loses another in terms of interpretability and predictive performance. In this paper, a fuzzy neural network regression method (FNNR) that coordinates structure identification and parameter identification is proposed. To alleviate the problem of rule explosion, the structure identification and parameter identification are coordinated in the training process, and the numbers of fuzzy rules and fuzzy partitions are effectively limited, while the parameters of fuzzy rules are optimized. The symmetrical architecture of the FNNR is designed for automatic structure identification. An alternate training strategy is adopted by treating discrete and continuous parameters differently, and thus the convergence efficiency of the algorithm is improved. To enhance interpretability, regularized terms are designed from fuzzy rule level and fuzzy partition level to guide the model to learn fuzzy rules with simple structures and clear semantics. The experimental results show that the proposed method has both a compact structure and high precision

A New Approach to Derive Priority Weights from Additive Interval Fuzzy Preference Relations Based on Logarithms

This paper investigates the consistency definition and the weight-deriving method for additive interval fuzzy preference relations (IFPRs) using a particular characterization based on logarithms. In a recently published paper, a new approach with a parameter is developed to obtain priority weights from fuzzy preference relations (FPRs), then a new consistency definition for the additive IFPRs is defined, and finally linear programming models for deriving interval weights from consistent and inconsistent IFPRs are proposed. However, the discussion of the parameter value is not adequate and the weights obtained by the linear models for inconsistent IFPRs are dependent on alternative labels and not robust to permutations of the decision makers’ judgments. In this paper, we first investigate the value of the parameter more thoroughly and give the closed form solution for the parameter. Then, we design a numerical example to illustrate the drawback of the linear models. Finally, we construct a linear model to derive interval weights from IFPRs based on the additive transitivity based consistency definition. To demonstrate the effectiveness of our proposed method, we compare our method to the existing method on three numerical examples. The results show that our method performs better on both consistent and inconsistent IFPRs

MoCoUTRL: a momentum contrastive framework for unsupervised text representation learning

This paper presents MoCoUTRL: a Momentum Contrastive Framework for Unsupervised Text Representation Learning. This model improves two aspects of recently popular contrastive learning algorithms in natural language processing (NLP). Firstly, MoCoUTRL employs multi-granularity semantic contrastive learning objectives, enabling a more comprehensive understanding of the semantic features of samples. Secondly, MoCoUTRL uses a dynamic dictionary to act as the approximately ground-truth representation for each token, providing the pseudo labels for token-level contrastive learning. The MoCoUTRL can extend the use of pre-trained language models (PLM) and even large-scale language models (LLM) into a plug-and-play semantic feature extractor that can fuel multiple downstream tasks. Experimental results on several publicly available datasets and further theoretical analysis validate the effectiveness and interpretability of the proposed method in this paper

Integrating 3D Printed Grinding Tools and Closed- Loop Temperature Management for Optimal Surgical Outcomes

Grinding is a commonly employed surgical technique for the partial removal of bone. However, the grinding process often generates excessive heat at the interface, leading to localized temperature raise. This can result in irreversible damage to not only the bone but also surrounding tissues, such as nerves. Existing devices rely on the continuous application of coolant to mitigate temperature rise. With the rate and location of coolant deposition being primarily empirical, the current process brings potential risks to patients. In this study, a novel grinding device capable of continuously monitoring grinding temperatures and applying coolant precisely when needed is designed. Utilizing additive manufacturing techniques, a customized grinding tool head equipped with embedded temperature sensors and coolant channels is successfully created. This innovation has enabled the development of an intelligent closed-loop device that provides precise temperature control during surgery. The device effectively maintains the grinding surface temperature within the user-defined range, with a latency of less than 1 s. Furthermore, the design ensures that the coolant spray outlets remain unobstructed by debris during grinding and effectively removes debris at the interface, reducing the risk of potential complications, such as bone hyperplasia