Exploring the Benefits of Differentially Private Pre-training and Parameter-Efficient Fine-tuning for Table Transformers

For machine learning with tabular data, Table Transformer (TabTransformer) is a state-of-the-art neural network model, while Differential Privacy (DP) is an essential component to ensure data privacy. In this paper, we explore the benefits of combining these two aspects together in the scenario of transfer learning -- differentially private pre-training and fine-tuning of TabTransformers with a variety of parameter-efficient fine-tuning (PEFT) methods, including Adapter, LoRA, and Prompt Tuning. Our extensive experiments on the ACSIncome dataset show that these PEFT methods outperform traditional approaches in terms of the accuracy of the downstream task and the number of trainable parameters, thus achieving an improved trade-off among parameter efficiency, privacy, and accuracy. Our code is available at github.com/IBM/DP-TabTransformer.Comment: submitted to ICASSP 202

Supervised Collective Classification for Crowdsourcing

Crowdsourcing utilizes the wisdom of crowds for collective classification via information (e.g., labels of an item) provided by labelers. Current crowdsourcing algorithms are mainly unsupervised methods that are unaware of the quality of crowdsourced data. In this paper, we propose a supervised collective classification algorithm that aims to identify reliable labelers from the training data (e.g., items with known labels). The reliability (i.e., weighting factor) of each labeler is determined via a saddle point algorithm. The results on several crowdsourced data show that supervised methods can achieve better classification accuracy than unsupervised methods, and our proposed method outperforms other algorithms.Comment: to appear in IEEE Global Communications Conference (GLOBECOM) Workshop on Networking and Collaboration Issues for the Internet of Everythin

Konsep Demokrasi Politik Dalam Islam

Coexistence of chronic rhinosinusitis (CRS) with asthma appears to impair asthma control. Type-2 innate lymphoid cells (ILC2s) respond to the cytokines of thymic stromal lymphopoietin (TSLP), interleukin (IL)-25 and IL-33, thus contributing to airway diseases such as CRS and asthma. We investigate whether the augmented Th2-cytokines in CRS might be related to sinonasal tract ILC2s corresponding to enhanced IL-25, IL-33 and TSLP release in severe asthmatics, and be involved in asthma control. Twenty-eight asthmatics (12 non-severe and 16 severe) with CRS receiving nasal surgery were enrolled. The predicted FEV1 inversely associated with CRS severity of CT or endoscopy scores. Higher expression of Th2-driven cytokines (IL-4, IL-5, IL-9, and IL-13), TSLP, IL-25 and IL-33 in nasal tissues was observed in severe asthma. Severe asthmatics had higher ILC2 cell counts in their nasal tissues. ILC2 counts were positively correlated with Th2-cytokines. Nasal surgery significantly improved asthma control and lung function decline in severe asthma and CRS. The higher expression of IL-33/ILC2 axis-directed type 2 immune responses in nasal tissue of CRS brought the greater decline of lung function in severe asthma. ILC2-induced the upregulated activity of Th2-related cytokines in asthmatics with CRS may contribute to a recalcitrant status of asthma control

CXCL-8 Regulates Head and Neck Carcinoma Progression through NOD Signalling Pathway

Head and neck squamous cell carcinoma (HNSCC) ranks sixth among the most common cancers in the world. Interlukin-8 (CXCL-8), a major role in inflammatory response and tumor microenvironment, correlates with tumor progression, metastasis and invasion. We explored CXCL-8 promotes tumor progression in different differentiation HNSCC cells. This project would apply to development on biomarker and target in HNSCC as well as provide a basis of early diagnosis and treatment for clinical. CXCL-8, NOD1 (nucleotide-binding oligomerization domain-containing protein 1) and receptor-interacting protein kinase (RIPK2) levels were detected statistically higher in patient tissue with HNSCC than in non-cancerous matched tissue (NCMT) in the microarray and qRT-PCR study, whereas NOD2 was weakly expressed. Similar results were obtained for CXCL-8, NOD1, NOD2 and RIP2 from RT-PCR and western blotting. High CXCL-8, NOD1 and RIP2 expressions were found on HNSCC patient tissue than that of NCMT, whereas NOD2 was weakly expressed. The analytical results indicate that CXCL-8 is required in NOD 1-mediated signalling pathways in HNSCC

Rethinking Backdoor Attacks on Dataset Distillation: A Kernel Method Perspective

Dataset distillation offers a potential means to enhance data efficiency in deep learning. Recent studies have shown its ability to counteract backdoor risks present in original training samples. In this study, we delve into the theoretical aspects of backdoor attacks and dataset distillation based on kernel methods. We introduce two new theory-driven trigger pattern generation methods specialized for dataset distillation. Following a comprehensive set of analyses and experiments, we show that our optimization-based trigger design framework informs effective backdoor attacks on dataset distillation. Notably, datasets poisoned by our designed trigger prove resilient against conventional backdoor attack detection and mitigation methods. Our empirical results validate that the triggers developed using our approaches are proficient at executing resilient backdoor attacks.Comment: 19 pages, 4 figure

InGaN-based light-emitting diodes with an embedded conical air-voids structure

The conical air-void structure of an InGaN light-emitting diode (LEDs) was formed at the GaN/sapphire interface to increase the light extraction efficiency. The fabrication process of the conical air-void structure consisted of a dry process and a crystallographic wet etching process on an undoped GaN layer, followed by a re-growth process for the InGaN LED structure. A higher light output power (1.54 times) and a small divergent angle (120o) were observed, at a 20mA operation current, on the treated LED structure when compared to a standard LED without the conical air-void structure. In this electroluminescence spectrum, the emission intensity and the peak wavelength varied periodically by corresponding to the conical air-void patterns that were measured through a 100nm-optical-aperture fiber probe. The conical air-void structure reduced the compressed strain at the GaN/sapphire interface by inducing the wavelength blueshift phenomenon and the higher internal quantum efficiency of the photoluminescence spectra for the treated LED structure