13,732 research outputs found
A Domain Agnostic Normalization Layer for Unsupervised Adversarial Domain Adaptation
We propose a normalization layer for unsupervised domain adaption in semantic
scene segmentation. Normalization layers are known to improve convergence and
generalization and are part of many state-of-the-art fully-convolutional neural
networks. We show that conventional normalization layers worsen the performance
of current Unsupervised Adversarial Domain Adaption (UADA), which is a method
to improve network performance on unlabeled datasets and the focus of our
research. Therefore, we propose a novel Domain Agnostic Normalization layer and
thereby unlock the benefits of normalization layers for unsupervised
adversarial domain adaptation. In our evaluation, we adapt from the synthetic
GTA5 data set to the real Cityscapes data set, a common benchmark experiment,
and surpass the state-of-the-art. As our normalization layer is domain agnostic
at test time, we furthermore demonstrate that UADA using Domain Agnostic
Normalization improves performance on unseen domains, specifically on
Apolloscape and Mapillary
Domain Agnostic Internal Distributions for Unsupervised Model Adaptation
We develop an algorithm for sequential adaptation of a classifier that is
trained for a source domain to generalize in a unannotated target domain. We
consider that the model has been trained on the source domain annotated data
and then it needs to be adapted using the target domain unannotated data when
the source domain data is not accessible. We align the distributions of the
source and the target domains in a discriminative embedding space via an
intermediate internal distribution. This distribution is estimated using the
source data representations in the embedding space. We provide theoretical
analysis and conduct extensive experiments on several benchmarks to demonstrate
the proposed method is effective
XML-driven exploitation of combined scalability in scalable H.264/AVC bitstreams
The heterogeneity in the contemporary multimedia environments requires a format-agnostic adaptation framework for the consumption of digital video content. Scalable bitstreams can be used in order to satisfy as many circumstances as possible. In this paper, the scalable extension on the H.264/AVC specification is used to obtain the parent bitstreams. The adaptation along the combined scalability axis of the bitstreams is done in a format-independent manner. Therefore, an abstraction layer of the bitstream is needed. In this paper, XML descriptions are used representing the high-level structure of the bitstreams by relying on the MPEG-21 Bitstream Syntax Description Language standard. The exploitation of the combined scalability is executed in the XML domain by implementing the adaptation process in a Streaming Transformation for XML (STX) stylesheet. The algorithm used in the transformation of the XML description is discussed in detail in this paper. From the performance measurements, one can conclude that the STX transformation in the XML domain and the generation of the corresponding adapted bitstream can be realized in real time
Right for the Right Reason: Training Agnostic Networks
We consider the problem of a neural network being requested to classify
images (or other inputs) without making implicit use of a "protected concept",
that is a concept that should not play any role in the decision of the network.
Typically these concepts include information such as gender or race, or other
contextual information such as image backgrounds that might be implicitly
reflected in unknown correlations with other variables, making it insufficient
to simply remove them from the input features. In other words, making accurate
predictions is not good enough if those predictions rely on information that
should not be used: predictive performance is not the only important metric for
learning systems. We apply a method developed in the context of domain
adaptation to address this problem of "being right for the right reason", where
we request a classifier to make a decision in a way that is entirely 'agnostic'
to a given protected concept (e.g. gender, race, background etc.), even if this
could be implicitly reflected in other attributes via unknown correlations.
After defining the concept of an 'agnostic model', we demonstrate how the
Domain-Adversarial Neural Network can remove unwanted information from a model
using a gradient reversal layer.Comment: Author's original versio
Complementary Domain Adaptation and Generalization for Unsupervised Continual Domain Shift Learning
Continual domain shift poses a significant challenge in real-world
applications, particularly in situations where labeled data is not available
for new domains. The challenge of acquiring knowledge in this problem setting
is referred to as unsupervised continual domain shift learning. Existing
methods for domain adaptation and generalization have limitations in addressing
this issue, as they focus either on adapting to a specific domain or
generalizing to unseen domains, but not both. In this paper, we propose
Complementary Domain Adaptation and Generalization (CoDAG), a simple yet
effective learning framework that combines domain adaptation and generalization
in a complementary manner to achieve three major goals of unsupervised
continual domain shift learning: adapting to a current domain, generalizing to
unseen domains, and preventing forgetting of previously seen domains. Our
approach is model-agnostic, meaning that it is compatible with any existing
domain adaptation and generalization algorithms. We evaluate CoDAG on several
benchmark datasets and demonstrate that our model outperforms state-of-the-art
models in all datasets and evaluation metrics, highlighting its effectiveness
and robustness in handling unsupervised continual domain shift learning
- …