28,800 research outputs found
Uncertainty Sentence Sampling by Virtual Adversarial Perturbation
Active learning for sentence understanding attempts to reduce the annotation
cost by identifying the most informative examples. Common methods for active
learning use either uncertainty or diversity sampling in the pool-based
scenario. In this work, to incorporate both predictive uncertainty and sample
diversity, we propose Virtual Adversarial Perturbation for Active Learning
(VAPAL) , an uncertainty-diversity combination framework, using virtual
adversarial perturbation (Miyato et al., 2019) as model uncertainty
representation. VAPAL consistently performs equally well or even better than
the strong baselines on four sentence understanding datasets: AGNEWS, IMDB,
PUBMED, and SST-2, offering a potential option for active learning on sentence
understanding tasks
Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings
Generalizing deep neural networks to new target domains is critical to their
real-world utility. In practice, it may be feasible to get some target data
labeled, but to be cost-effective it is desirable to select a
maximally-informative subset via active learning (AL). We study the problem of
AL under a domain shift, called Active Domain Adaptation (Active DA). We
empirically demonstrate how existing AL approaches based solely on model
uncertainty or diversity sampling are suboptimal for Active DA. Our algorithm,
Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings
(ADA-CLUE), i) identifies target instances for labeling that are both uncertain
under the model and diverse in feature space, and ii) leverages the available
source and target data for adaptation by optimizing a semi-supervised
adversarial entropy loss that is complementary to our active sampling
objective. On standard image classification-based domain adaptation benchmarks,
ADA-CLUE consistently outperforms competing active adaptation, active learning,
and domain adaptation methods across domain shifts of varying severity
- …