10 research outputs found
Understanding the Role of Mixup in Knowledge Distillation: An Empirical Study
Mixup is a popular data augmentation technique based on creating new samples
by linear interpolation between two given data samples, to improve both the
generalization and robustness of the trained model. Knowledge distillation
(KD), on the other hand, is widely used for model compression and transfer
learning, which involves using a larger network's implicit knowledge to guide
the learning of a smaller network. At first glance, these two techniques seem
very different, however, we found that "smoothness" is the connecting link
between the two and is also a crucial attribute in understanding KD's interplay
with mixup. Although many mixup variants and distillation methods have been
proposed, much remains to be understood regarding the role of a mixup in
knowledge distillation. In this paper, we present a detailed empirical study on
various important dimensions of compatibility between mixup and knowledge
distillation. We also scrutinize the behavior of the networks trained with a
mixup in the light of knowledge distillation through extensive analysis,
visualizations, and comprehensive experiments on image classification. Finally,
based on our findings, we suggest improved strategies to guide the student
network to enhance its effectiveness. Additionally, the findings of this study
provide insightful suggestions to researchers and practitioners that commonly
use techniques from KD. Our code is available at
https://github.com/hchoi71/MIX-KD.Comment: To be presented at WACV 202
Total Syntheses of Pladienolide-Derived Spliceosome Modulators
Pladienolides, an emerging class of naturally occurring spliceosome modulators, exhibit interesting structural features, such as highly substituted 12-membered macrocycles and epoxide-containing diene side chains. The potential of pladienolides as anti-cancer agents is confirmed by H3B-8800, a synthetic analog of this natural product class, which is currently under Phase I clinical trials. Since its isolation in 2004 and the first total synthesis in 2007, a dozen total syntheses and synthetic approaches toward the pladienolide class have been reported to date. This review focuses on the eight completed total syntheses of naturally occurring pladienolides or their synthetic analogs, in addition to a synthetic approach to the main framework of the natural product