Mental Arithmetic across Three Language Groups

Mental arithmetic performance was investigated among three language groups (English monolinguals, Chinese-English bilinguals, and Spanish-English bilinguals). Participants solved both small and large numerosity arithmetic problems in addition and multiplication and reported their solution strategies. All groups performed better in small problems than in large ones and better in addition than in multiplication, especially for a large size set. The results revealed all three groups performed equally well in solving problems correctly. Spanish-English bilinguals were equivalent to their English monolingual peers. However, Chinese-English bilinguals outperformed the other two groups in solution speed, especially when problems consisted of large numbers. No group differences were found in the frequency of using retrieval strategies to solve problems. Linguistic influence and other possible factors were discussed to explain the mental arithmetic advantage for Chinese-English bilinguals relative to other groups

Assessment of novel distributed control techniques to address network constraints with demand side management

The development of sustainable generation, a reliable electricity supply and affordable tariffs are the primary requirements to address the uncertainties in different future energy scenarios. Due to the predicted increase in Distributed Generation (DG) and load profile changes in future scenarios, there are significant operational and planning challenges facing netwrok operators. These changes in the power system distribution network require a new Active Network Management (ANM) control system to manage distribution constraint issues such as thermal rating, voltage, and fault levels. The future smart grid focuses on harnessing the control potential from demand side via bidirectional power flow, transparent information communication, and contractual customer participation. Demand Side Management (DSM) is considered as one of the effective solutions to defer network capacity reinforcement, increase energy efficiency, facilitate renewable access, and implement low carbon energy strategy. From the Distribution Network Operator's (DNO) perspective, the control opportunity from Demand Response (DR) and Decentralized Energy Resource (DER) contributes on capacity investment reduction, energy efficiency, and enable low carbon technologies. This thesis develops a new decentralized control system for dealing effectively with the constraint issues in the Medium Voltage (MV) distribution network. In the decentralized control system, two novel control approaches are proposed to autonomously relieve the network thermal constraint via DNO's direct control of the real power in network components during the operation period. The first approach, Demand Response for Power Flow Management (DR-PFM), implements the DSM peak clipping control of Active Demand (AD), whilst the second approach, Hybrid Control for Power Flow Management (HC-PFM), implements the hybrid control of both AD and DER. The novelty of these two new control algorithms consists in the application of a Constraint Satisfaction Problem (CSP) based programming model on decision making of the real power curtailment to relieve the network thermal overload. In the Constraint Programming (CP) model, three constraints are identified: a preference constraint, and a network constraint. The control approaches effectively solve the above constraint problem in the CSP model within 5 seconds' time response. The control performance is influenced by the pre-determined variable, domain and constraint settings. These novel control approaches take advantages on flexible control, fast response and demand participation enabling in the future smart grid.The development of sustainable generation, a reliable electricity supply and affordable tariffs are the primary requirements to address the uncertainties in different future energy scenarios. Due to the predicted increase in Distributed Generation (DG) and load profile changes in future scenarios, there are significant operational and planning challenges facing netwrok operators. These changes in the power system distribution network require a new Active Network Management (ANM) control system to manage distribution constraint issues such as thermal rating, voltage, and fault levels. The future smart grid focuses on harnessing the control potential from demand side via bidirectional power flow, transparent information communication, and contractual customer participation. Demand Side Management (DSM) is considered as one of the effective solutions to defer network capacity reinforcement, increase energy efficiency, facilitate renewable access, and implement low carbon energy strategy. From the Distribution Network Operator's (DNO) perspective, the control opportunity from Demand Response (DR) and Decentralized Energy Resource (DER) contributes on capacity investment reduction, energy efficiency, and enable low carbon technologies. This thesis develops a new decentralized control system for dealing effectively with the constraint issues in the Medium Voltage (MV) distribution network. In the decentralized control system, two novel control approaches are proposed to autonomously relieve the network thermal constraint via DNO's direct control of the real power in network components during the operation period. The first approach, Demand Response for Power Flow Management (DR-PFM), implements the DSM peak clipping control of Active Demand (AD), whilst the second approach, Hybrid Control for Power Flow Management (HC-PFM), implements the hybrid control of both AD and DER. The novelty of these two new control algorithms consists in the application of a Constraint Satisfaction Problem (CSP) based programming model on decision making of the real power curtailment to relieve the network thermal overload. In the Constraint Programming (CP) model, three constraints are identified: a preference constraint, and a network constraint. The control approaches effectively solve the above constraint problem in the CSP model within 5 seconds' time response. The control performance is influenced by the pre-determined variable, domain and constraint settings. These novel control approaches take advantages on flexible control, fast response and demand participation enabling in the future smart grid

DHGE: Dual-View Hyper-Relational Knowledge Graph Embedding for Link Prediction and Entity Typing

In the field of representation learning on knowledge graphs (KGs), a hyper-relational fact consists of a main triple and several auxiliary attribute-value descriptions, which is considered more comprehensive and specific than a triple-based fact. However, currently available hyper-relational KG embedding methods in a single view are limited in application because they weaken the hierarchical structure that represents the affiliation between entities. To overcome this limitation, we propose a dual-view hyper-relational KG structure (DH-KG) that contains a hyper-relational instance view for entities and a hyper-relational ontology view for concepts that are abstracted hierarchically from the entities. This paper defines link prediction and entity typing tasks on DH-KG for the first time and constructs two DH-KG datasets, JW44K-6K, extracted from Wikidata, and HTDM based on medical data. Furthermore, we propose DHGE, a DH-KG embedding model based on GRAN encoders, HGNNs, and joint learning. DHGE outperforms baseline models on DH-KG, according to experimental results. Finally, we provide an example of how this technology can be used to treat hypertension. Our model and new datasets are publicly available.Comment: Accepted by AAAI 202

Short Text Pre-training with Extended Token Classification for E-commerce Query Understanding

E-commerce query understanding is the process of inferring the shopping intent of customers by extracting semantic meaning from their search queries. The recent progress of pre-trained masked language models (MLM) in natural language processing is extremely attractive for developing effective query understanding models. Specifically, MLM learns contextual text embedding via recovering the masked tokens in the sentences. Such a pre-training process relies on the sufficient contextual information. It is, however, less effective for search queries, which are usually short text. When applying masking to short search queries, most contextual information is lost and the intent of the search queries may be changed. To mitigate the above issues for MLM pre-training on search queries, we propose a novel pre-training task specifically designed for short text, called Extended Token Classification (ETC). Instead of masking the input text, our approach extends the input by inserting tokens via a generator network, and trains a discriminator to identify which tokens are inserted in the extended input. We conduct experiments in an E-commerce store to demonstrate the effectiveness of ETC

NQE: N-ary Query Embedding for Complex Query Answering over Hyper-relational Knowledge Graphs

Complex query answering (CQA) is an essential task for multi-hop and logical reasoning on knowledge graphs (KGs). Currently, most approaches are limited to queries among binary relational facts and pay less attention to n-ary facts (n>=2) containing more than two entities, which are more prevalent in the real world. Moreover, previous CQA methods can only make predictions for a few given types of queries and cannot be flexibly extended to more complex logical queries, which significantly limits their applications. To overcome these challenges, in this work, we propose a novel N-ary Query Embedding (NQE) model for CQA over hyper-relational knowledge graphs (HKGs), which include massive n-ary facts. The NQE utilizes a dual-heterogeneous Transformer encoder and fuzzy logic theory to satisfy all n-ary FOL queries, including existential quantifiers, conjunction, disjunction, and negation. We also propose a parallel processing algorithm that can train or predict arbitrary n-ary FOL queries in a single batch, regardless of the kind of each query, with good flexibility and extensibility. In addition, we generate a new CQA dataset WD50K-NFOL, including diverse n-ary FOL queries over WD50K. Experimental results on WD50K-NFOL and other standard CQA datasets show that NQE is the state-of-the-art CQA method over HKGs with good generalization capability. Our code and dataset are publicly available.Comment: Accepted by the 37th AAAI Conference on Artificial Intelligence (AAAI-2023

On the Security Risks of Knowledge Graph Reasoning

Knowledge graph reasoning (KGR) -- answering complex logical queries over large knowledge graphs -- represents an important artificial intelligence task, entailing a range of applications (e.g., cyber threat hunting). However, despite its surging popularity, the potential security risks of KGR are largely unexplored, which is concerning, given the increasing use of such capability in security-critical domains. This work represents a solid initial step towards bridging the striking gap. We systematize the security threats to KGR according to the adversary's objectives, knowledge, and attack vectors. Further, we present ROAR, a new class of attacks that instantiate a variety of such threats. Through empirical evaluation in representative use cases (e.g., medical decision support, cyber threat hunting, and commonsense reasoning), we demonstrate that ROAR is highly effective to mislead KGR to suggest pre-defined answers for target queries, yet with negligible impact on non-target ones. Finally, we explore potential countermeasures against ROAR, including filtering of potentially poisoning knowledge and training with adversarially augmented queries, which leads to several promising research directions.Comment: In proceedings of USENIX Security'23. Codes: https://github.com/HarrialX/security-risk-KG-reasonin

MoWE: Mixture of Weather Experts for Multiple Adverse Weather Removal

Currently, most adverse weather removal tasks are handled independently, such as deraining, desnowing, and dehazing. However, in autonomous driving scenarios, the type, intensity, and mixing degree of the weather are unknown, so the separated task setting cannot deal with these complex conditions well. Besides, the vision applications in autonomous driving often aim at high-level tasks, but existing weather removal methods neglect the connection between performance on perceptual tasks and signal fidelity. To this end, in upstream task, we propose a novel \textbf{Mixture of Weather Experts(MoWE)} Transformer framework to handle complex weather removal in a perception-aware fashion. We design a \textbf{Weather-aware Router} to make the experts targeted more relevant to weather types while without the need for weather type labels during inference. To handle diverse weather conditions, we propose \textbf{Multi-scale Experts} to fuse information among neighbor tokens. In downstream task, we propose a \textbf{Label-free Perception-aware Metric} to measure whether the outputs of image processing models are suitable for high level perception tasks without the demand for semantic labels. We collect a syntactic dataset \textbf{MAW-Sim} towards autonomous driving scenarios to benchmark the multiple weather removal performance of existing methods. Our MoWE achieves SOTA performance in upstream task on the proposed dataset and two public datasets, i.e. All-Weather and Rain/Fog-Cityscapes, and also have better perceptual results in downstream segmentation task compared to other methods. Our codes and datasets will be released after acceptance

Analysis of infiltrated immune cells in left atriums from patients with atrial fibrillation and identification of circRNA biomarkers for postoperative atrial fibrillation

Background: Atrial fibrillation (AF) increases the risk of stroke and heart failure. Postoperative AF (POAF) increases the risk of mortality after cardiac surgery. This study aims to explore mechanisms underlying AF, analyze infiltration of immune cells in left atrium (LA) from patients with AF, and identify potential circular RNA (circRNA) biomarkers for POAF.Methods: Raw data of GSE797689, GSE115574, and GSE97455 were downloaded and processed. AF-related gene co-expression network was constructed using weighted gene correlation network analysis and enrichment analysis of genes in relevant module was conducted. Gene set enrichment analysis (GSEA) and gene set variation analysis (GSVA) were applied to investigate pathways significantly enriched in AF group. Infiltration of immune cells was analyzed using single-sample GSEA. Differentially expressed genes (DEGs) between patients with or without AF were identified and competing endogenous RNA (ceRNA) networks of DEGs were constructed. To screen biomarkers for POAF, differentially expressed circRNAs (DEcircRNAs) between patients with or without POAF were identified. Intersection between DEcircRNAs and circRNAs in ceRNA networks of DEGs were extracted and circRNAs in the intersection were further screened using support vector machine, random forest, and neural network to identify biomarkers for POAF.Results: Three modules were found to be relevant with AF and enrichment analysis indicated that genes in these modules were enriched in synthesis of extracellular matrix and inflammatory response. The results of GSEA and GSVA suggested that inflammatory response-related pathways were significantly enriched in AF group. Immune cells like macrophages, mast cells, and neutrophils were significantly infiltrated in LA tissues from patients with AF. The expression levels of immune genes such as CHGB, HLA-DRA, LYZ, IGKV1-17 and TYROBP were significantly upregulated in patients with AF, which were correlated with infiltration of immune cells. ceRNA networks of DEGs were constructed and has_circ_0006314 and hsa_circ_0055387 were found to have potential predictive values for POAF.Conclusion: Synthesis of extracellular matrix and inflammatory response were main processes involved in development and progression of AF. Infiltration of immune cells was significantly different between patients with or without AF. Has_circ_0006314 and hsa_circ_0055387 were found to have potential predictive values for POAF