Named Entity Recognition in Electronic Health Records Using Transfer Learning Bootstrapped Neural Networks

Neural networks (NNs) have become the state of the art in many machine learning applications, especially in image and sound processing [1]. The same, although to a lesser extent [2,3], could be said in natural language processing (NLP) tasks, such as named entity recognition. However, the success of NNs remains dependent on the availability of large labelled datasets, which is a significant hurdle in many important applications. One such case are electronic health records (EHRs), which are arguably the largest source of medical data, most of which lies hidden in natural text [4,5]. Data access is difficult due to data privacy concerns, and therefore annotated datasets are scarce. With scarce data, NNs will likely not be able to extract this hidden information with practical accuracy. In our study, we develop an approach that solves these problems for named entity recognition, obtaining 94.6 F1 score in I2B2 2009 Medical Extraction Challenge [6], 4.3 above the architecture that won the competition. Beyond the official I2B2 challenge, we further achieve 82.4 F1 on extracting relationships between medical terms. To reach this state-of-the-art accuracy, our approach applies transfer learning to leverage on datasets annotated for other I2B2 tasks, and designs and trains embeddings that specially benefit from such transfer.Comment: 11 pages, 4 figures, 8 table

Finite-time decentralized event-triggered feedback control for generalized neural networks with mixed interval time-varying delays and cyber-attacks

This article investigates the finite-time decentralized event-triggered feedback control problem for generalized neural networks (GNNs) with mixed interval time-varying delays and cyber-attacks. A decentralized event-triggered method reduces the network transmission load and decides whether sensor measurements should be sent out. The cyber-attacks that occur at random are described employing Bernoulli distributed variables. By the Lyapunov-Krasovskii stability theory, we apply an integral inequality with an exponential function to estimate the derivative of the Lyapunov-Krasovskii functionals (LKFs). We present new sufficient conditions in the form of linear matrix inequalities. The main objective of this research is to investigate the stochastic finite-time boundedness of GNNs with mixed interval time-varying delays and cyber-attacks by providing a decentralized event-triggered method and feedback controller. Finally, a numerical example is constructed to demonstrate the effectiveness and advantages of the provided control scheme

T-S Fuzzy Bibo Stabilisation of Non-Linear Systems Under Persistent Perturbations Using Fuzzy Lyapunov Functions and Non-PDC Control Laws

[EN] This paper develops an innovative approach for designing non-parallel distributed fuzzy controllers for continuous-time non-linear systems under persistent perturbations. Non-linear systems are represented using Takagi-Sugeno fuzzy models. These non-PDC controllers guarantee bounded input bounded output stabilisation in closed-loop throughout the computation of generalised inescapable ellipsoids. These controllers are computed with linear matrix inequalities using fuzzy Lyapunov functions and integral delayed Lyapunov functions. LMI conditions developed in this paper provide non-PDC controllers with a minimum *-norm (upper bound of the 1-norm) for the T-S fuzzy system under persistent perturbations. The results presented in this paper can be classified into two categories: local methods based on fuzzy Lyapunov functions with guaranteed bounds on the first derivatives of membership functions and global methods based on integral-delayed Lyapunov functions which are independent of the first derivatives of membership functions. The benefits of the proposed results are shown through some illustrative examples.This work has been funded by Ministerio de Economia y Competitividad, Spain (research project RTI2018-096904-B-I00) and Conselleria de Educacion, Cultura y Deporte-Generalitat Valenciana, Spain (research project AICO/2019/055).Salcedo-Romero-De-Ávila, J.; Martínez Iranzo, MA.; Garcia-Nieto, S.; Hilario Caballero, A. (2020). T-S Fuzzy Bibo Stabilisation of Non-Linear Systems Under Persistent Perturbations Using Fuzzy Lyapunov Functions and Non-PDC Control Laws. International Journal of Applied Mathematics and Computer Science (Online). 30(3):529-550. https://doi.org/10.34768/amcs-2020-0039S52955030