SemRoDe: Macro Adversarial Training to Learn Representations That are Robust to Word-Level Attacks

Language models (LMs) are indispensable tools for natural language processing tasks, but their vulnerability to adversarial attacks remains a concern. While current research has explored adversarial training techniques, their improvements to defend against word-level attacks have been limited. In this work, we propose a novel approach called Semantic Robust Defence (SemRoDe), a Macro Adversarial Training strategy to enhance the robustness of LMs. Drawing inspiration from recent studies in the image domain, we investigate and later confirm that in a discrete data setting such as language, adversarial samples generated via word substitutions do indeed belong to an adversarial domain exhibiting a high Wasserstein distance from the base domain. Our method learns a robust representation that bridges these two domains. We hypothesize that if samples were not projected into an adversarial domain, but instead to a domain with minimal shift, it would improve attack robustness. We align the domains by incorporating a new distance-based objective. With this, our model is able to learn more generalized representations by aligning the model's high-level output features and therefore better handling unseen adversarial samples. This method can be generalized across word embeddings, even when they share minimal overlap at both vocabulary and word-substitution levels. To evaluate the effectiveness of our approach, we conduct experiments on BERT and RoBERTa models on three datasets. The results demonstrate promising state-of-the-art robustness.Comment: Published in NAACL 2024 (Main Track

Augmented reality for nDimensional building information modelling contextualization, customization and curation

This paper presents an experimental method and apparatus of augmented reality (AR) for nDimensional (nD) building information modeling (BIM). BIM allows nD information to be visualized simultaneously by architects, engineers and constructors to gain a synchronized understanding viewing from different perspectives. However, BIM is conventionally being operated on a desktop-based computer which makes collaboration less flexible, and it also creates an isolation gap between the model and reality. This isolation gap does not severely affect experienced and skilled professionals, as they can bridge the isolation gap with their intuition developed over the years. Nevertheless, users who are lack of such experience will feel the isolation gap between the digital realm and practicable reality, which could be the hurdle in project participation and decision making. AR allows virtual content to be mixed with real environment for user experience. In the context of our study, AR is functional to present the nD information of BIM, at the same time retaining users’ connection with the reality. It is not just being utilized solely for presentation, but also to maximize the potential for communication, interaction and experience. This pilot study investigates effective technological approach of using AR as an effective collaboration technology combining with BIM through proposed key aspects of contextualization, customization and curation. Contextualization is significant to enable users to understand the AR content by making the presented information meaningful to the target audience, implemented thru the means of 2D annotations, animations and options comparison. This study compares both AR BIM with and without contextualization. Customization can generate unique virtual environment and content for different level of users tailored to their needs and preference to create intuitive interaction with AR BIM. Curation is crucial to provide users with a reliable experience, and to formulate a continually improving AR BIM thru log data and users’ feedback. All in all, this paper explores the major aspects of contextualization, customization and curation, to distinguish effective approach in the currently “free for all” AR BIM development. Finally, an implication is provided for future study in terms of balance in information sufficiency and complexity for AR BIM

Fair yet Asymptotically Equal Collaborative Learning

In collaborative learning with streaming data, nodes (e.g., organizations) jointly and continuously learn a machine learning (ML) model by sharing the latest model updates computed from their latest streaming data. For the more resourceful nodes to be willing to share their model updates, they need to be fairly incentivized. This paper explores an incentive design that guarantees fairness so that nodes receive rewards commensurate to their contributions. Our approach leverages an explore-then-exploit formulation to estimate the nodes' contributions (i.e., exploration) for realizing our theoretically guaranteed fair incentives (i.e., exploitation). However, we observe a "rich get richer" phenomenon arising from the existing approaches to guarantee fairness and it discourages the participation of the less resourceful nodes. To remedy this, we additionally preserve asymptotic equality, i.e., less resourceful nodes achieve equal performance eventually to the more resourceful/"rich" nodes. We empirically demonstrate in two settings with real-world streaming data: federated online incremental learning and federated reinforcement learning, that our proposed approach outperforms existing baselines in fairness and learning performance while remaining competitive in preserving equality.Comment: Accepted to 40th International Conference on Machine Learning (ICML 2023), 37 page

Visibility diagrams and experimental stripe structure in the quantum Hall effect

We analyze various properties of the visibility diagrams that can be used in the context of modular symmetries and confront them to some recent experimental developments in the Quantum Hall Effect. We show that a suitable physical interpretation of the visibility diagrams which permits one to describe successfully the observed architecture of the Quantum Hall states gives rise naturally to a stripe structure reproducing some of the experimental features that have been observed in the study of the quantum fluctuations of the Hall conductance. Furthermore, we exhibit new properties of the visibility diagrams stemming from the structure of subgroups of the full modular group.Comment: 8 pages in plain TeX, 7 figures in a single postscript fil

Quantum Oscillations from Networked Topological Interfaces in a Weyl Semimetal

Layered transition metal chalcogenides are promising hosts of electronic Weyl nodes and topological superconductivity. MoTe2 is a striking example that harbors both noncentrosymmetric Td and centrosymmetric T\u27 phases, both of which have been identified as topologically nontrivial. Applied pressure tunes the structural transition separating these phases to zero temperature, stabilizing a mixed Td–T\u27 matrix that entails a network of interfaces between the two nontrivial topological phases. Here, we show that this critical pressure range is characterized by distinct coherent quantum oscillations, indicating that the difference in topology between topologically nonvtrivial Td and T\u27 phases gives rise to an emergent electronic structure: a network of topological interfaces. A rare combination of topologically nontrivial electronic structures and locked-in transformation barriers leads to this counterintuitive situation, wherein quantum oscillations can be observed in a structurally inhomogeneous material. These results further open the possibility of stabilizing multiple topological phases coexisting with superconductivity

Memory Impairment and Plasma BDNF Correlates of the BDNF Val66Met Polymorphism in Patients With Bipolar II Disorder

Studies suggest that a functional polymorphism of brain-derived neurotrophic factor (BDNF), polymorphism BDNF Val66Met affects cognitive functions, however, the effect is unclear in bipolar II (BD-II) disorder. We used the Wechsler Memory Scale-third edition (WMS-III), the presence of the BDNF Val66Met polymorphism, and plasma concentrations of BDNF to investigate the association between memory impairment and BDNF in BD-II disorder. We assessed the memory functions of 228 BD-II patients and 135 healthy controls (HCs). BD-II patients had significantly lower scores on five of the eight WMS-III subscales. In addition to education, the BDNF polymorphism were associated with the following subscales of WMS-III, auditory delayed memory, auditory delayed recognition memory and general memory scores in BD-II patients, but not in HC. Moreover, BD-II patients with the Val-homozygote scored significantly higher on the visual immediate memory subscale than did those with the Met/Met and Val/Met polymorphisms. The significantly positive effect of the Val-homozygote did not have a significantly positive effect on memory in the HC group, however. We found no significant association between BDNF polymorphisms and plasma concentrations of BDNF. The plasma BDNF was more likely to be associated with clinical characteristics than it was with memory indices in the BD-II group. The impaired memory function in BD-II patients might be dependent upon the association between the BDNF Val66Met polymorphism and peripheral BDNF levels

Urate-lowering treatment and risk of total joint replacement in patients with gout

Objectives: To examine whether gout is an independent risk factor for total joint replacement (TJR) and whether urate-lowering treatment (ULT) reduces this risk. Methods: Using the Taiwan National Health Insurance database and the UK Clinical Practice Research Datalink, 74 560 Taiwan patients and 34 505 UK patients with incident gout were identified and age and sex matched to people without gout. Cox proportional hazards models and condition logistic regression were used to examine the risk of TJR in gout patients and the association between cumulative defined daily dose (cDDD) of ULT and TJR.Results: The prevalence rates of TJR in the patients at the time of diagnosis of gout and in people without gout were 1.16% vs 0.82% in Taiwan and 2.61% vs 1.76% in the UK. After a gout diagnosis, the incidence of TJR was higher in the patients with gout compared with those without (3.23 vs 1.91 cases/1000 person-years in Taiwan and 6.87 vs 4.61 cases/1000 person-years in the UK), with adjusted HRs of 1.56 (95% CI 1.45, 1.68) in Taiwan and 1.14 (1.05, 1.22) in the UK. Compared with patients with gout with 180 cDDD ULT in Taiwan. In the UK, the respective ORs were 1.09 (0.83, 1.42), 0.93 (0.68, 1.27) and 1.08 (0.94, 1.24).Conclusion: This population-based study provides evidence from two nation populations that gout confers significant TJR risk, which was not reduced by current ULT

Direct Oral Anticoagulants in Atrial Fibrillation Patients With Concomitant Hyperthyroidism

Objective Patients with hyperthyroidism were excluded from randomized clinical trials of direct oral anticoagulants(DOACs) for stroke prevention in patients with non-valvular atrial fibrillation (NVAF). Methods We performed a nationwide retrospective cohort study using data from the Taiwan National Health Insurance Research Database. We enrolled 3,213 and 1,181 NVAF patients with hyperthyroidism taking DOACs and warfarin, respectively, from June 1, 2012 to December 31, 2017. We also enrolled 53,591 and 16,564 NVAF patients without hyperthyroidism taking DOACs and warfarin, respectively. We used propensity score-based stabilized weights (PSSWs) to balance covariates across the study groups. We also used 1:4 matching on both taking DOACs, with (n=3,213) and without hyperthyroidism (n=12,852); and both taking warfarin, with (n=1,181) and without hyperthyroidism (n=4,724). Results After PSSW, DOAC had a comparable risk of ischemic stroke/systemic embolism (IS/SE) and a lower risk of major bleeding (hazard ratio (HR):0.65; [95% confidential interval (CI):0.44-0.96]; P=0.0295) than warfarin among patients with hyperthyroidism. There were comparable risks of IS/SE and major bleeding between those patients with and without hyperthyroidism. However, patients taking warfarin with hyperthyroidism had a lower risk of IS/SE than those without hyperthyroidism (HR:0.61; [95%CI:0.43-0.86]; P=0.0050). Conclusion Among NVAF Asian patients with concomitant hyperthyroidism, DOACs may be an effective and safer alternative to warfarin. Thromboprophylaxis with DOACs may be considered for such patients, and it is important to validate this finding in further prospective study.Supplemental materials (figures and tables) for the article of "Direct Oral Anticoagulants in Atrial Fibrillation Patients with Concomitant Hyperthyroidism" Funding provided by: Chang Gung Memorial HospitalCrossref Funder Registry ID: http://dx.doi.org/10.13039/100012553Award Number: CMRPG3G1371-3Funding provided by: Chang Gung Memorial HospitalCrossref Funder Registry ID: http://dx.doi.org/10.13039/100012553Award Number: CMRPG3F0991-3Funding provided by: Chang Gung Memorial HospitalCrossref Funder Registry ID: http://dx.doi.org/10.13039/100012553Award Number: CMRPD1K0031Funding provided by: Chang Gung Memorial HospitalCrossref Funder Registry ID: http://dx.doi.org/10.13039/100012553Award Number: CMRPG3K0021We performed a nationwide retrospective cohort study using data from the Taiwan National Health Insurance Research Database. We enrolled 3,213 and 1,181 NVAF patients with hyperthyroidism taking DOACs and warfarin, respectively, from June 1, 2012 to December 31, 2017

Lentiviral hematopoietic stem cell gene therapy for X-linked severe combined immunodeficiency

-linked severe combined immunodeficiency (SCID-X1) is a profound deficiency of T, B, and natural killer (NK) cell immunity caused by mutations in IL2RG encoding the common chain (γc) of several interleukin receptors. Gamma-retroviral (γRV) gene therapy of SCID-X1 infants without conditioning restores T cell immunity without B or NK cell correction, but similar treatment fails in older SCID-X1 children. We used a lentiviral gene therapy approach to treat five SCID-X1 patients with persistent immune dysfunction despite haploidentical hematopoietic stem cell (HSC) transplant in infancy. Follow-up data from two older patients demonstrate that lentiviral vector γc transduced autologous HSC gene therapy after nonmyeloablative busulfan conditioning achieves selective expansion of gene-marked T, NK, and B cells, which is associated with sustained restoration of humoral responses to immunization and clinical improvement at 2 to 3 years after treatment. Similar gene marking levels have been achieved in three younger patients, albeit with only 6 to 9 months of follow-up. Lentiviral gene therapy with reduced-intensity conditioning appears safe and can restore humoral immune function to posthaploidentical transplant older patients with SCID-X1