125,998 research outputs found
Exploiting Sentence Embedding for Medical Question Answering
Despite the great success of word embedding, sentence embedding remains a
not-well-solved problem. In this paper, we present a supervised learning
framework to exploit sentence embedding for the medical question answering
task. The learning framework consists of two main parts: 1) a sentence
embedding producing module, and 2) a scoring module. The former is developed
with contextual self-attention and multi-scale techniques to encode a sentence
into an embedding tensor. This module is shortly called Contextual
self-Attention Multi-scale Sentence Embedding (CAMSE). The latter employs two
scoring strategies: Semantic Matching Scoring (SMS) and Semantic Association
Scoring (SAS). SMS measures similarity while SAS captures association between
sentence pairs: a medical question concatenated with a candidate choice, and a
piece of corresponding supportive evidence. The proposed framework is examined
by two Medical Question Answering(MedicalQA) datasets which are collected from
real-world applications: medical exam and clinical diagnosis based on
electronic medical records (EMR). The comparison results show that our proposed
framework achieved significant improvements compared to competitive baseline
approaches. Additionally, a series of controlled experiments are also conducted
to illustrate that the multi-scale strategy and the contextual self-attention
layer play important roles for producing effective sentence embedding, and the
two kinds of scoring strategies are highly complementary to each other for
question answering problems.Comment: 8 page
Module Embedding
This paper proposes a code reuse mechanism called module embedding that enables the building of new modules from existing ones through inheritance, overriding of procedures, and overriding of types; the paper also describes an implementation scheme for this mechanism. Module embedding is beneficial when modules and classes are used in combination and need to be extended together, or when modules are more appropriate medium than classes
Generalised Moore spectra in a triangulated category
In this paper we consider a construction in an arbitrary triangulated
category T which resembles the notion of a Moore spectrum in algebraic
topology. Namely, given a compact object C of T satisfying some finite tilting
assumptions, we obtain a functor which "approximates" objects of the module
category of the endomorphism algebra of C in T. This generalises and extends a
construction of Jorgensen in connection with lifts of certain homological
functors of derived categories. We show that this new functor is well-behaved
with respect to short exact sequences and distinguished triangles, and as a
consequence we obtain a new way of embedding the module category in a
triangulated category. As an example of the theory, we recover Keller's
canonical embedding of the module category of a path algebra of a quiver with
no oriented cycles into its u-cluster category for u>1.Comment: 26 pages, improvement to exposition of the proof of Theorem 3.
Improving Multi-Scale Aggregation Using Feature Pyramid Module for Robust Speaker Verification of Variable-Duration Utterances
Currently, the most widely used approach for speaker verification is the deep
speaker embedding learning. In this approach, we obtain a speaker embedding
vector by pooling single-scale features that are extracted from the last layer
of a speaker feature extractor. Multi-scale aggregation (MSA), which utilizes
multi-scale features from different layers of the feature extractor, has
recently been introduced and shows superior performance for variable-duration
utterances. To increase the robustness dealing with utterances of arbitrary
duration, this paper improves the MSA by using a feature pyramid module. The
module enhances speaker-discriminative information of features from multiple
layers via a top-down pathway and lateral connections. We extract speaker
embeddings using the enhanced features that contain rich speaker information
with different time scales. Experiments on the VoxCeleb dataset show that the
proposed module improves previous MSA methods with a smaller number of
parameters. It also achieves better performance than state-of-the-art
approaches for both short and long utterances.Comment: Accepted to Interspeech 202
Highest weight modules and polarized embeddings of shadow spaces
Let Gamma be the K-shadow space of a spherical building Delta. An embedding V
of Gamma is called polarized if it affords all "singular" hyperplanes of Gamma.
Suppose that Delta is associated to a Chevalley group G. Then Gamma can be
embedded into what we call the Weyl module for G of highest weight lambda_K. It
is proved that this module is polarized and that the associated minimal
polarized embedding is precisely the irreducible G-module of highest weight
lambda_K. In addition a number of general results on polarized embeddings of
shadow spaces are proved. The last few sections are devoted to the study of
specific shadow spaces, notably minuscule weight geometries, polar
grassmannians, and projective flag-grassmannians. The paper is in part
expository in nature so as to make this material accessible to a wide audience.Comment: Improvement in exposition of Sections 1-3 and . Notation improved.
References added. Main results unchange
- …