49 research outputs found
Adversarial consistency for single domain generalization in medical image segmentation
7R01HL141813-06 - NIH/National Heart, Lung, and Blood Institute; NIH/National Institutes of HealthFirst author draf
Domain Generalization in Vision: A Survey
Generalization to out-of-distribution (OOD) data is a capability natural to
humans yet challenging for machines to reproduce. This is because most learning
algorithms strongly rely on the i.i.d.~assumption on source/target data, which
is often violated in practice due to domain shift. Domain generalization (DG)
aims to achieve OOD generalization by using only source data for model
learning. Since first introduced in 2011, research in DG has made great
progresses. In particular, intensive research in this topic has led to a broad
spectrum of methodologies, e.g., those based on domain alignment,
meta-learning, data augmentation, or ensemble learning, just to name a few; and
has covered various vision applications such as object recognition,
segmentation, action recognition, and person re-identification. In this paper,
for the first time a comprehensive literature review is provided to summarize
the developments in DG for computer vision over the past decade. Specifically,
we first cover the background by formally defining DG and relating it to other
research fields like domain adaptation and transfer learning. Second, we
conduct a thorough review into existing methods and present a categorization
based on their methodologies and motivations. Finally, we conclude this survey
with insights and discussions on future research directions.Comment: v4: includes the word "vision" in the title; improves the
organization and clarity in Section 2-3; adds future directions; and mor
FedDrive: Generalizing Federated Learning to Semantic Segmentation in Autonomous Driving
Semantic Segmentation is essential to make self-driving vehicles autonomous,
enabling them to understand their surroundings by assigning individual pixels
to known categories. However, it operates on sensible data collected from the
users' cars; thus, protecting the clients' privacy becomes a primary concern.
For similar reasons, Federated Learning has been recently introduced as a new
machine learning paradigm aiming to learn a global model while preserving
privacy and leveraging data on millions of remote devices. Despite several
efforts on this topic, no work has explicitly addressed the challenges of
federated learning in semantic segmentation for driving so far. To fill this
gap, we propose FedDrive, a new benchmark consisting of three settings and two
datasets, incorporating the real-world challenges of statistical heterogeneity
and domain generalization. We benchmark state-of-the-art algorithms from the
federated learning literature through an in-depth analysis, combining them with
style transfer methods to improve their generalization ability. We demonstrate
that correctly handling normalization statistics is crucial to deal with the
aforementioned challenges. Furthermore, style transfer improves performance
when dealing with significant appearance shifts. Official website:
https://feddrive.github.io