1,367 research outputs found
Self-Paced Multitask Learning with Shared Knowledge
This paper introduces self-paced task selection to multitask learning, where
instances from more closely related tasks are selected in a progression of
easier-to-harder tasks, to emulate an effective human education strategy, but
applied to multitask machine learning. We develop the mathematical foundation
for the approach based on iterative selection of the most appropriate task,
learning the task parameters, and updating the shared knowledge, optimizing a
new bi-convex loss function. This proposed method applies quite generally,
including to multitask feature learning, multitask learning with alternating
structure optimization, etc. Results show that in each of the above
formulations self-paced (easier-to-harder) task selection outperforms the
baseline version of these methods in all the experiments
Understanding language-elicited EEG data by predicting it from a fine-tuned language model
Electroencephalography (EEG) recordings of brain activity taken while
participants read or listen to language are widely used within the cognitive
neuroscience and psycholinguistics communities as a tool to study language
comprehension. Several time-locked stereotyped EEG responses to
word-presentations -- known collectively as event-related potentials (ERPs) --
are thought to be markers for semantic or syntactic processes that take place
during comprehension. However, the characterization of each individual ERP in
terms of what features of a stream of language trigger the response remains
controversial. Improving this characterization would make ERPs a more useful
tool for studying language comprehension. We take a step towards better
understanding the ERPs by fine-tuning a language model to predict them. This
new approach to analysis shows for the first time that all of the ERPs are
predictable from embeddings of a stream of language. Prior work has only found
two of the ERPs to be predictable. In addition to this analysis, we examine
which ERPs benefit from sharing parameters during joint training. We find that
two pairs of ERPs previously identified in the literature as being related to
each other benefit from joint training, while several other pairs of ERPs that
benefit from joint training are suggestive of potential relationships.
Extensions of this analysis that further examine what kinds of information in
the model embeddings relate to each ERP have the potential to elucidate the
processes involved in human language comprehension.Comment: To appear in Proceedings of the 2019 Conference of the North American
Chapter of the Association for Computational Linguistic
Self-Paced Multi-Task Learning
In this paper, we propose a novel multi-task learning (MTL) framework, called
Self-Paced Multi-Task Learning (SPMTL). Different from previous works treating
all tasks and instances equally when training, SPMTL attempts to jointly learn
the tasks by taking into consideration the complexities of both tasks and
instances. This is inspired by the cognitive process of human brain that often
learns from the easy to the hard. We construct a compact SPMTL formulation by
proposing a new task-oriented regularizer that can jointly prioritize the tasks
and the instances. Thus it can be interpreted as a self-paced learner for MTL.
A simple yet effective algorithm is designed for optimizing the proposed
objective function. An error bound for a simplified formulation is also
analyzed theoretically. Experimental results on toy and real-world datasets
demonstrate the effectiveness of the proposed approach, compared to the
state-of-the-art methods
Non-acted multi-view audio-visual dyadic interactions. Project master thesis: multitask learning for facial attributes analysis
Treballs finals del Mà ster de Fonaments de Ciència de Dades, Facultat de matemà tiques, Universitat de Barcelona, Any: 2019, Tutor: Sergio Escalera Guerrero, Cristina Palmero i Julio C. S. Jacques Junior[en] In this thesis we explore the use of Multitask Learning for improving performance in facial attributes tasks such as gender, age and ethnicity prediction. These tasks, along with emotion recognition will be part of a new dyadic interaction dataset which was recorded during the development of this thesis. This work includes the
implementation of two state of the art multitask deep learning models and the discussion of the results obtained from these methods in a preliminary dataset, as well as a first evaluation in a sample of the dyadic interaction dataset. This will serve as a baseline for a future implementation of Multitask Learning methods in the fully
annotated dyadic interaction dataset
- …