3 research outputs found
InDistill: Information flow-preserving knowledge distillation for model compression
In this paper we introduce InDistill, a model compression approach that
combines knowledge distillation and channel pruning in a unified framework for
the transfer of the critical information flow paths from a heavyweight teacher
to a lightweight student. Such information is typically collapsed in previous
methods due to an encoding stage prior to distillation. By contrast, InDistill
leverages a pruning operation applied to the teacher's intermediate layers
reducing their width to the corresponding student layers' width. In that way,
we force architectural alignment enabling the intermediate layers to be
directly distilled without the need of an encoding stage. Additionally, a
curriculum learning-based training scheme is adopted considering the
distillation difficulty of each layer and the critical learning periods in
which the information flow paths are created. The proposed method surpasses
state-of-the-art performance on three standard benchmarks, i.e. CIFAR-10,
CUB-200, and FashionMNIST by 3.08%, 14.27%, and 1% mAP, respectively, as well
as on more challenging evaluation settings, i.e. ImageNet and CIFAR-100 by
1.97% and 5.65% mAP, respectively
Mitigating Viewer Impact from Disturbing Imagery using AI Filters: A User-Study
Exposure to disturbing imagery can significantly impact individuals,
especially professionals who encounter such content as part of their work. This
paper presents a user study, involving 107 participants, predominantly
journalists and human rights investigators, that explores the capability of
Artificial Intelligence (AI)-based image filters to potentially mitigate the
emotional impact of viewing such disturbing content. We tested five different
filter styles, both traditional (Blurring and Partial Blurring) and AI-based
(Drawing, Colored Drawing, and Painting), and measured their effectiveness in
terms of conveying image information while reducing emotional distress. Our
findings suggest that the AI-based Drawing style filter demonstrates the best
performance, offering a promising solution for reducing negative feelings
(-30.38%) while preserving the interpretability of the image (97.19%). Despite
the requirement for many professionals to eventually inspect the original
images, participants suggested potential strategies for integrating AI filters
into their workflow, such as using AI filters as an initial, preparatory step
before viewing the original image. Overall, this paper contributes to the
development of a more ethically considerate and effective visual environment
for professionals routinely engaging with potentially disturbing imagery
FRCSyn Challenge at WACV 2024:Face Recognition Challenge in the Era of Synthetic Data
Despite the widespread adoption of face recognition technology around the
world, and its remarkable performance on current benchmarks, there are still
several challenges that must be covered in more detail. This paper offers an
overview of the Face Recognition Challenge in the Era of Synthetic Data
(FRCSyn) organized at WACV 2024. This is the first international challenge
aiming to explore the use of synthetic data in face recognition to address
existing limitations in the technology. Specifically, the FRCSyn Challenge
targets concerns related to data privacy issues, demographic biases,
generalization to unseen scenarios, and performance limitations in challenging
scenarios, including significant age disparities between enrollment and
testing, pose variations, and occlusions. The results achieved in the FRCSyn
Challenge, together with the proposed benchmark, contribute significantly to
the application of synthetic data to improve face recognition technology.Comment: 10 pages, 1 figure, WACV 2024 Workshop