AutoAttention: Automatic Field Pair Selection for Attention in User Behavior Modeling

In Click-through rate (CTR) prediction models, a user's interest is usually represented as a fixed-length vector based on her history behaviors. Recently, several methods are proposed to learn an attentive weight for each user behavior and conduct weighted sum pooling. However, these methods only manually select several fields from the target item side as the query to interact with the behaviors, neglecting the other target item fields, as well as user and context fields. Directly including all these fields in the attention may introduce noise and deteriorate the performance. In this paper, we propose a novel model named AutoAttention, which includes all item/user/context side fields as the query, and assigns a learnable weight for each field pair between behavior fields and query fields. Pruning on these field pairs via these learnable weights lead to automatic field pair selection, so as to identify and remove noisy field pairs. Though including more fields, the computation cost of AutoAttention is still low due to using a simple attention function and field pair selection. Extensive experiments on the public dataset and Tencent's production dataset demonstrate the effectiveness of the proposed approach.Comment: Accepted by ICDM 202

FaaSwap: SLO-Aware, GPU-Efficient Serverless Inference via Model Swapping

The dynamic request patterns of machine learning (ML) inference workloads have driven an increasing trend towards exploiting serverless computing for scalable ML model serving. However, today's serverless platforms lack efficient support for GPUs -- provisioning functions on GPUs incurs extremely high overhead, forcing them to keep long-running even when idling for reduced cold starts. This leads to significant resource waste to perform ML inference and hinders the pay-per-use billing for GPUs. In this paper, we present FaaSwap, a serverless platform enabling fine-grained, request-level GPU sharing for resource-efficient ML inference. FaaSwap leverages model swapping to support fast inference execution at low resource cost. It keeps models in a host which has a large amount of cheap memory and quickly swaps models to GPUs when requested, reducing per-function keep-alive cost and enabling efficient GPU sharing across much more functions. FaaSwap also supports swapping models between GPUs for load balancing and improved inference performance. In FaaSwap, we design sophisticated request scheduling and memory management algorithms that efficiently exploit model swapping to reduce GPU cost and meet latency service-level objectives (SLOs) for all inference functions. We have implemented and integrated FaaSwap into Alibaba Cloud Function Compute (FC), one of the world's largest commercial serverless platform. Evaluation results show that FaaSwap can achieve low-latency model swapping, efficiently share a GPU across hundreds of functions, and satisfy per-function latency SLOs at scale

Stress-Induced Epinephrine Enhances Lactate Dehydrogenase A and Promotes Breast Cancer Stem-Like Cells

Chronic stress triggers activation of the sympathetic nervous system and drives malignancy. Using an immunodeficient murine system, we showed that chronic stress–induced epinephrine promoted breast cancer stem-like properties via lactate dehydrogenase A–dependent (LDHA-dependent) metabolic rewiring. Chronic stress–induced epinephrine activated LDHA to generate lactate, and the adjusted pH directed USP28-mediated deubiquitination and stabilization of MYC. The SLUG promoter was then activated by MYC, which promoted development of breast cancer stem-like traits. Using a drug screen that targeted LDHA, we found that a chronic stress–induced cancer stem-like phenotype could be reversed by vitamin C. These findings demonstrated the critical importance of psychological factors in promoting stem-like properties in breast cancer cells. Thus, the LDHA-lowering agent vitamin C can be a potential approach for combating stress-associated breast cancer

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Scanning electron microscopy (SEM) is indispensable in diverse applications ranging from microelectronics to food processing because it provides large depth-of-field images with a resolution beyond the optical diffraction limit. However, the technology requires coating conductive films on insulator samples and a vacuum environment. We use deep learning to obtain the mapping relationship between optical super-resolution (OSR) images and SEM domain images, which enables the transformation of OSR images into SEM-like large depth-of-field images. Our custom-built scanning superlens microscopy (SSUM) system, which requires neither coating samples by conductive films nor a vacuum environment, is used to acquire the OSR images with features down to ~80 nm. The peak signal-to-noise ratio (PSNR) and structural similarity index measure values indicate that the deep learning method performs excellently in image-to-image translation, with a PSNR improvement of about 0.74 dB over the optical super-resolution images. The proposed method provides a high level of detail in the reconstructed results, indicating that it has broad applicability to chip-level defect detection, biological sample analysis, forensics, and various other fields.Comment: 13 pages,7 figure

Clinical and immunological features of an APLAID patient caused by a novel mutation in PLCG2

BackgroundThe APLAID syndrome is a rare primary immunodeficiency caused by gain-of-function mutations in the PLCG2 gene. We present a 7-year-old APLAID patient who has recurrent blistering skin lesions, skin infections in the perineum, a rectal perineal fistula, and inflammatory bowel disease.MethodsTo determine the genetic cause of our patient, WES and bioinformatics analysis were performed. Flow cytometry was used for phenotyping immune cell populations in peripheral blood. Cytokines released into plasma were analyzed using protein chip technology. The PBMCs of patient and a healthy child were subjected to single-cell RNA-sequencing analysis.ResultsThe patient carried a novel de novo missense mutation c.2534T>C in exon 24 of the PLCG2 gene that causes a leucine to serine amino acid substitution (p.Leu845Ser). Bioinformatics analysis revealed that this mutation had a negative impact on the structure of the PLCγ2 protein, which is highly conserved in many other species. Immunophenotyping by flow cytometry revealed that in addition to the typical decrease in circulating memory B cells, the levels of myeloid dendritic cells (mDCs) in the children’s peripheral blood were significantly lower, as were the CD4+ effector T cells induced by their activation. Single-cell sequencing revealed that the proportion of different types of cells in the peripheral blood of the APLAID patient changed.ConclusionsWe present the first case of APLAID with severely reduced myeloid dendritic cells carrying a novel PLCG2 mutation, and conducted a comprehensive analysis of immunological features in the ALPAID patient, which has not been mentioned in previous reports. This study expands the spectrum of APLAID-associated immunophenotype and genotype. The detailed immune analyses in this patient may provide a basis for the development of targeted therapies for this severe autoinflammatory disease

The impact of intraarterial, intravenous, and combined tirofiban on endovascular treatment for acute intracranial atherosclerotic occlusion

Background and purposeAdjunctive tirofiban administration in patients undergoing endovascular treatment (EVT) for acute large vessel occlusion (LVO) has been investigated in several studies. However, the findings are conflict. This study aimed to compare the effect of different administration pathways of tirofiban on patients undergoing EVT for acute LVO with intracranial atherosclerotic disease (ICAD).MethodsPatients were selected from the ANGEL-ACT Registry (Endovascular Treatment Key Technique and Emergency Workflow Improvement of Acute Ischemic Stroke: A Prospective Multicenter Registry Study) and divided into four groups: intra-arterial (IA), intravenous (IV), and intra-arterial plus intravenous (IA+IV) and non-tirofiban. The primary outcome was 90-day ordinal modified Rankin Scale (mRS) score, and the secondary outcomes included the rates of mRS 0–1, 0–2, and 0–3 at 90-day, successful recanalization. The safety outcomes were symptomatic intracranial hemorrhage (sICH) and other safety endpoints. The multivariable logistic regression models adjusting for potential baseline confounders were performed to compare the outcomes. A propensity score matching (PSM) with a 1:1:1:1 ratio was conducted among four groups, and the outcomes were then compared in the post-matched population.ResultsA total of 502 patients were included, 80 of which were in the IA-tirofiban group, 73 in IV-tirofiban, 181 in (IA+IV)-tirofiban group, and 168 in the non-tirofiban group. The median (IQR) 90-day mRS score in the four groups of IA, IV, IA+IV, and non-tirofiban was, respectively 3(0–5) vs. 1(0–4) vs. 1(0–4) vs. 3(0–5). The adjusted common odds ratio (OR) for 90-day ordinal modified Rankin Scale distribution with IA-tirofiban vs. non-tirofiban was 0.77 (95% CI, 0.45–1.30, P = 0.330), with IV-tirofiban vs. non-tirofiban was 1.36 (95% CI, 0.78–2.36, P = 0.276), and with (IA+IV)-tirofiban vs. non-tirofiban was 1.03 (95% CI, 0.64–1.64, P = 0.912). The adjusted OR for mRS 0–1 and mRS 0–2 at 90-day with IA-tirofiban vs. non-tirofiban was, respectively 0.51 (95% CI, 0.27–0.98, P = 0.042) and 0.50 (95% CI, 0.26–0.94, P = 0.033). The other outcomes of each group were similar with non-tirofiban group, all P was >0.05. After PSM, the common odds ratio (OR) for 90-day ordinal modified Rankin Scale distribution with IA-tirofiban vs. non-tirofiban was 0.41 (95% CI, 0.18–0.94, P = 0.036), and the OR for mRS 0–1 and mRS 0–2 at 90-day with IA-tirofiban vs. non-tirofiban was, respectively 0.28 (95% CI, 0.11–0.74, P = 0.011) and 0.25 (95% CI, 0.09–0.67, P = 0.006).ConclusionsIntra-arterial administration of tirofiban was associated with worse outcome than non-tirofiban, which suggested that intra-arterial tirofiban had a harmful effect on patients undergoing EVT for ICAD-LVO.Clinical trial registrationhttp://www.clinicaltrials.gov, Unique identifier: NCT03370939

Optimization of finite-sized modular coils for advanced stellarators

To date, almost all coil-design codes, e.g. NESCOIL, COILOPT, FOCUS codes, etc, have been primarily attributed to the optimization of filament coils for stellarators. However, evolving to a practical/finite-sized coil from a filament coil, the finite-size effect of coils significantly constrains the fabrication tolerances of a coil system. This paper presents a novel approach that emphasizes the optimization of practical modular coils to reduce sensitivity to fabrication tolerances and to achieve the expected magnetic configurations precisely. A new evaluation parameter, surface twist, is defined in this paper and applied to the optimization sequence in addition to the practical coil line torsion and curvature. The approach has been applied to the framework of the filament coil scheme in the Chinese first quasi-axisymmetric stellarator. This practical coil system without surface twists has been accomplished. Compared to the original finite-sized coil design, the new result is a more considerable simplification of coil shapes, such that in a certain direction view each finite-sized coil becomes a planar-like one. Moreover, this method can also be implemented for the estimation of stochastic deviations of practical coils during the fabrication and assembly of the coil system

Local axisymmetry-breaking–induced transition of trapped-particle orbit and loss channels in quasi-axisymmetric stellarators

The transition of trapped-particle orbit topologies has been investigated in quasi-axisymmetric (QA) configurations, such as the Chinese First Quasi-axisymmetric Stellarator (CFQS). It is found that the axisymmetry-breaking phenomenon in QA configurations is of great significance at some specific locations, which could easily induce blocked particles to transit into localized particles. A novel aspect is presented to interpret the transition mechanism of trapped-particle orbit topologies in this paper, i.e., as the amplitudes of non-axisymmetric field increase along the radius direction, the region of large toroidal inhomogeneity is gradually generated, which makes the length of the trapped-particle trajectory substantially short, and hence, may restrict particles to a single helical field period. Meanwhile, at such locations the "pseudo-axisymmetric" field results in coupling of the maximum radial drift and the minimum poloidal drift, which enables the transition of trapped-particle orbit topologies considerably and forms specific loss channels, degrading plasma confinement. These results may shed light on the optimization of QA configurations via avoidance of such coupling with respect to energetic particle confinement. Moreover, this work is also relevant to the generation of inhomogeneity of particle flux deposition on the devertor plates