Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective

Pre-training is known to generate universal representations for downstream tasks in large-scale deep learning such as large language models. Existing literature, e.g., \cite{kim2020adversarial}, empirically observe that the downstream tasks can inherit the adversarial robustness of the pre-trained model. We provide theoretical justifications for this robustness inheritance phenomenon. Our theoretical results reveal that feature purification plays an important role in connecting the adversarial robustness of the pre-trained model and the downstream tasks in two-layer neural networks. Specifically, we show that (i) with adversarial training, each hidden node tends to pick only one (or a few) feature; (ii) without adversarial training, the hidden nodes can be vulnerable to attacks. This observation is valid for both supervised pre-training and contrastive learning. With purified nodes, it turns out that clean training is enough to achieve adversarial robustness in downstream tasks.Comment: To appear in AISTATS202

Targeting CBLB as a potential therapeutic approach for disseminated candidiasis

We thank J.M. Penninger (University of Toronto) for providing Cblb−/− mice, Y. Iwakura (Tokyo University of Science) for providing Clec4n−/− mice, S. Lipkowitz (National Cancer Institute, US National Institutes of Health) for providing Cblb constructs, X. Lin (MD Anderson Cancer Center) for providing the antibody to mouse dectin-3 and Card9−/− bone marrow cells, P.R. Sundstrom (Dartmouth University) for providing the C. albicans cap1 mutant, and L.D. Chaves (University at Buffalo) for flow cytometric analysis of myeloid cells in the kidneys. We also thank A. Lovett-Racke (Ohio State University) for her advice on in vivo Cblb-knockdown experiments. This work was supported by the US National Institutes of Health (grants R01 AI090901, R01 AI123253, and R21 AI117547; all to J.Z.), the American Heart Association (AHA Great Rivers Associate Grant-in-Aid grant 16GRNT26990004; J.Z.), a start-up fund from the Ohio State University College of Medicine (J.Z.), and the Wellcome Trust (G.D.B.).Peer reviewedPostprin

Prevalence, associated factors and outcomes of pressure injuries in adult intensive care unit patients: the DecubICUs study

Funder: European Society of Intensive Care Medicine; doi: http://dx.doi.org/10.13039/501100013347Funder: Flemish Society for Critical Care NursesAbstract: Purpose: Intensive care unit (ICU) patients are particularly susceptible to developing pressure injuries. Epidemiologic data is however unavailable. We aimed to provide an international picture of the extent of pressure injuries and factors associated with ICU-acquired pressure injuries in adult ICU patients. Methods: International 1-day point-prevalence study; follow-up for outcome assessment until hospital discharge (maximum 12 weeks). Factors associated with ICU-acquired pressure injury and hospital mortality were assessed by generalised linear mixed-effects regression analysis. Results: Data from 13,254 patients in 1117 ICUs (90 countries) revealed 6747 pressure injuries; 3997 (59.2%) were ICU-acquired. Overall prevalence was 26.6% (95% confidence interval [CI] 25.9–27.3). ICU-acquired prevalence was 16.2% (95% CI 15.6–16.8). Sacrum (37%) and heels (19.5%) were most affected. Factors independently associated with ICU-acquired pressure injuries were older age, male sex, being underweight, emergency surgery, higher Simplified Acute Physiology Score II, Braden score 3 days, comorbidities (chronic obstructive pulmonary disease, immunodeficiency), organ support (renal replacement, mechanical ventilation on ICU admission), and being in a low or lower-middle income-economy. Gradually increasing associations with mortality were identified for increasing severity of pressure injury: stage I (odds ratio [OR] 1.5; 95% CI 1.2–1.8), stage II (OR 1.6; 95% CI 1.4–1.9), and stage III or worse (OR 2.8; 95% CI 2.3–3.3). Conclusion: Pressure injuries are common in adult ICU patients. ICU-acquired pressure injuries are associated with mainly intrinsic factors and mortality. Optimal care standards, increased awareness, appropriate resource allocation, and further research into optimal prevention are pivotal to tackle this important patient safety threat

Correction to: Prevalence, associated factors and outcomes of pressure injuries in adult intensive care unit patients: the DecubICUs study

The original version of this article unfortunately contained a mistake

Prevalence, associated factors and outcomes of pressure injuries in adult intensive care unit patients: the DecubICUs study

Funder: European Society of Intensive Care Medicine; doi: http://dx.doi.org/10.13039/501100013347Funder: Flemish Society for Critical Care NursesAbstract: Purpose: Intensive care unit (ICU) patients are particularly susceptible to developing pressure injuries. Epidemiologic data is however unavailable. We aimed to provide an international picture of the extent of pressure injuries and factors associated with ICU-acquired pressure injuries in adult ICU patients. Methods: International 1-day point-prevalence study; follow-up for outcome assessment until hospital discharge (maximum 12 weeks). Factors associated with ICU-acquired pressure injury and hospital mortality were assessed by generalised linear mixed-effects regression analysis. Results: Data from 13,254 patients in 1117 ICUs (90 countries) revealed 6747 pressure injuries; 3997 (59.2%) were ICU-acquired. Overall prevalence was 26.6% (95% confidence interval [CI] 25.9–27.3). ICU-acquired prevalence was 16.2% (95% CI 15.6–16.8). Sacrum (37%) and heels (19.5%) were most affected. Factors independently associated with ICU-acquired pressure injuries were older age, male sex, being underweight, emergency surgery, higher Simplified Acute Physiology Score II, Braden score 3 days, comorbidities (chronic obstructive pulmonary disease, immunodeficiency), organ support (renal replacement, mechanical ventilation on ICU admission), and being in a low or lower-middle income-economy. Gradually increasing associations with mortality were identified for increasing severity of pressure injury: stage I (odds ratio [OR] 1.5; 95% CI 1.2–1.8), stage II (OR 1.6; 95% CI 1.4–1.9), and stage III or worse (OR 2.8; 95% CI 2.3–3.3). Conclusion: Pressure injuries are common in adult ICU patients. ICU-acquired pressure injuries are associated with mainly intrinsic factors and mortality. Optimal care standards, increased awareness, appropriate resource allocation, and further research into optimal prevention are pivotal to tackle this important patient safety threat

The minimum cost-cycle expansion law of urban spatial morphology: A case study of Kunming in China

The evolution of urban morphology is the changing pattern of urban land use.It is the external morphological outcome of the internal impetus of minimum cost on urban land use model.This paper argues that the process of morphology evolution is the result of alternant pattern of external expansion and internal infilling of land use in urban areas,which is the aufheben conducted by the interweaving behavior between concentration and dissimilation,as well as by the process of embedment and re-embedment of socio-economic action. Based on the above hypothesis,we select the(remote sensing) images of Kunming in temporal serial from 1909 to 2006,using morphological perspective to analyze the changes of urban spatial pattern and explore the evolution of urban morphology.The results are revealed that:(1) from the view of the rational micro-process and macro-process,in general,the evolution of urban morphology follows the pattern of the minimum cost-cyclic expansion in the statistics;(2) based on the minimum cost-cyclic expansion model,the core mechanism that drives the morphology of periodic changes is based on the impact between alternant pro-growth infrastructure investment and pro-consumption public investment infrastructure changes,as well as factor substitution effects in each spatial phase

A study on cause related marketing in Singapore

An increasing number of companies are adopting Cause-related marketing (CRM) campaigns in pursuit of the benefits that CRM can bring about – higher revenue from higher brand awareness, improved brand image, increased brand preference and many more. A major concern for companies joining the bandwagon will be how to form a good impression and attract consumers to make a cause-related purchase. In this research, we aim to investigate whether Cause-brand alliance attributes and product packaging attributes have an impact on consumers’ perception towards the cause-related brand or product. We also aim to find out if consumers’ perception will influence their intention to purchase. We test our hypotheses using questionnaire survey data gathered through convenience sampling. A total of 124 valid responses were obtained. Frequency count and correlation analysis was used to test our hypotheses. Results showed that both Cause-brand alliance attributes and product packaging attributes are positively associated with consumers’ perception of a cause-related brand or product. However, results also showed that consumers’ perception has insignificant correlation to their intention to purchase. This suggests that there are other potentially more important factors that affect consumers’ purchase intention and companies should conduct a further research to better understand their targeted consumers.BUSINES

DynaMaR: Dynamic Prompt with Mask Token Representation

Recent research has shown that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. Typically when adapting these language models to downstream tasks, like a classification or regression task, we employ a fine-tuning paradigm in which the sentence representation from the language model is input to a task-specific head; the model is then fine-tuned end-to-end. However, with the emergence of models like GPT-3, prompt-based fine-tuning has been proven to be a successful approach for few-shot tasks. Inspired by this work, we study discrete prompt technologies in practice. There are two issues that arise with the standard prompt approach. First, it can overfit on the prompt template. Second, it requires manual effort to formulate the downstream task as a language model problem. In this paper, we propose an improvement to prompt-based fine-tuning that addresses these two issues. We refer to our approach as DynaMaR -- Dynamic Prompt with Mask Token Representation. Results show that DynaMaR can achieve an average improvement of 10% in few-shot settings and improvement of 3.7% in data-rich settings over the standard fine-tuning approach on four e-commerce applications