Enhancing Robust Representation in Adversarial Training: Alignment and Exclusion Criteria

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust features, resulting in poor performance of adversarial robustness. To address this issue, we highlight two criteria of robust representation: (1) Exclusion: \emph{the feature of examples keeps away from that of other classes}; (2) Alignment: \emph{the feature of natural and corresponding adversarial examples is close to each other}. These motivate us to propose a generic framework of AT to gain robust representation, by the asymmetric negative contrast and reverse attention. Specifically, we design an asymmetric negative contrast based on predicted probabilities, to push away examples of different classes in the feature space. Moreover, we propose to weight feature by parameters of the linear classifier as the reverse attention, to obtain class-aware feature and pull close the feature of the same class. Empirical evaluations on three benchmark datasets show our methods greatly advance the robustness of AT and achieve state-of-the-art performance.Comment: 10 pages, 9 figures, Submitted to TIF

Vitamin D receptor (VDR) on the cell membrane of mouse macrophages participates in the formation of lipopolysaccharide tolerance: mVDR is related to the effect of artesunate to reverse LPS tolerance

Abstract It is unclear whether membrane vitamin D receptor (mVDR) exists on the macrophage membrane or whether mVDR is associated with lipopolysaccharide (LPS) tolerance. Herein, we report that interfering with caveolae and caveolae-dependent lipid rafts inhibited the formation of LPS tolerance. VDR was detected as co-localized with membrane molecular markers. VDR was detected on the cell membrane and its level was higher in LPS-tolerant cells than that in only LPS treatment cells. Anti-VDR antibodies could abolish the effect of artesunate (AS) to reverse LPS tolerance, and the wild-type peptides (H397 and H305) of VDR, but not the mutant peptide (H397D and H305A), led to the loss of AS’s effect. AS decreased the mVDR level in LPS-tolerant cells. In vivo, AS significantly reduced VDR level in the lung tissue of LPS-tolerant mice. In summary, mVDR exists on the cell membrane of macrophages and is closely associated with the formation of LPS tolerance and the effects of AS. Video Abstrac