Ensembled CTR Prediction via Knowledge Distillation

Recently, deep learning-based models have been widely studied for click-through rate (CTR) prediction and lead to improved prediction accuracy in many industrial applications. However, current research focuses primarily on building complex network architectures to better capture sophisticated feature interactions and dynamic user behaviors. The increased model complexity may slow down online inference and hinder its adoption in real-time applications. Instead, our work targets at a new model training strategy based on knowledge distillation (KD). KD is a teacher-student learning framework to transfer knowledge learned from a teacher model to a student model. The KD strategy not only allows us to simplify the student model as a vanilla DNN model but also achieves significant accuracy improvements over the state-of-the-art teacher models. The benefits thus motivate us to further explore the use of a powerful ensemble of teachers for more accurate student model training. We also propose some novel techniques to facilitate ensembled CTR prediction, including teacher gating and early stopping by distillation loss. We conduct comprehensive experiments against 12 existing models and across three industrial datasets. Both offline and online A/B testing results show the effectiveness of our KD-based training strategy.Comment: Published in CIKM'202

Genome-Wide Association Study Identifies Candidate Genes Related to Seed Oil Composition and Protein Content in Gossypium hirsutum L.

Cotton (Gossypium spp.) is a leading natural fiber crop and an important source of vegetable protein and oil for humans and livestock. To investigate the genetic architecture of seed nutrients in upland cotton, a genome-wide association study (GWAS) was conducted in a panel of 196 germplasm resources under three environments using a CottonSNP80K chip of 77,774 loci. Relatively high genetic diversity (average gene diversity being 0.331) and phenotypic variation (coefficient of variation, CV, exceeding 3.9%) were detected in this panel. Correlation analysis revealed that the well-documented negative association between seed protein (PR) and oil may be to some extent attributable to the negative correlation between oleic acid (OA) and PR. Linkage disequilibrium (LD) was unevenly distributed among chromosomes and subgenomes. It ranged from 0.10–0.20 Mb (Chr19) to 5.65–5.75 Mb (Chr25) among the chromosomes and the range of Dt-subgenomes LD decay distances was smaller than At-subgenomes. This panel was divided into two subpopulations based on the information of 41,815 polymorphic single-nucleotide polymorphism (SNP) markers. The mixed linear model considering both Q-matrix and K-matrix [MLM(Q+K)] was employed to estimate the association between the SNP markers and the seed nutrients, considering the false positives caused by population structure and the kinship. A total of 47 SNP markers and 28 candidate quantitative trait loci (QTLs) regions were found to be significantly associated with seven cottonseed nutrients, including protein, total fatty acid, and five main fatty acid compositions. In addition, the candidate genes in these regions were analyzed, which included three genes, Gh_D12G1161, Gh_D12G1162, and Gh_D12G1165 that were most likely involved in the control of cottonseed protein concentration. These results improved our understanding of the genetic control of cottonseed nutrients and provided potential molecular tools to develop cultivars with high protein and improved fatty acid compositions in cotton breeding programs through marker-assisted selection

Cigarette Smoking in Male Patients with Chronic Schizophrenia in a Chinese Population: Prevalence and Relationship to Clinical Phenotypes

The high prevalence of smoking in schizophrenia of European background may be related to smoking's reducing clinical symptoms and medication side effects. Because smoking prevalence and its associations with clinical phenotypes are less well characterized in Chinese than European patients with schizophrenia, we assessed these smoking behaviors using clinician-administered questionnaires and the Fagerstrom Test for Nicotine Dependence (FTND) in 776 Chinese male schizophrenia and 560 control subjects. Patients also were rated on the Positive and Negative Symptom Scale (PANSS), the Simpson and Angus Extrapyramidal Symptom Rating Scale (SAES), and the Abnormal Involuntary Movement Scale (AIMS). We found that the schizophrenia patients had a higher lifetime incidence of smoking (79% vs 63%), were more likely to be heavy smokers (61% vs 31%), and had lower smoking cessation rates (4% vs 9%) (all p<0.0001) than controls. Among the schizophrenia patients smoking prevalence increased with age, with the largest difference from controls in the age cohort of 55–75 years: 75% vs 46% (p<0.0001). Among the schizophrenia smokers 73% started to smoke before the onset of their illness by an average of 7.6 years. The patients with schizophrenia who were current smokers scored significantly lower on the PANSS negative symptom subscore (p<0.005), and on the SAES symptom scale (p<0.04; Bonferroni corrected p>0.05) than the non-smoking patients. These results suggest that Chinese males with schizophrenia smoke more frequently than the general population. Further, smokers with schizophrenia may display fewer negative symptoms and possibly less parkinsonism than non-smokers with schizophrenia

ETS proto-oncogene 1 modulates PTP1B expression to participate in high glucose-mediated endothelial inflammation

Hyperglycemia-induced endothelial inflammation participates in the pathogenesis of cardiovascular complications in diabetics. Previous studies showed that protein tyrosine phosphatase 1B (PTP1B) and ETS proto-oncogene 1 (ets1) are involved in hyperglycemia-induced endothelial inflammation. In this study, we hypothesized that ets1 modulates PTP1B expression, thus playing a crucial role in hyperglycemia-induced vascular endothelial inflammation. Our results indicated that high glucose increases monocyte/endothelial adhesion, vascular cell adhesion molecule-1 (VCAM-1) expression and p65 phosphorylation in human umbilical vein endothelial cells (HUVECs). Moreover, high glucose-mediated endothelial inflammation is reversed by PTP1B silencing. In addition, high glucose increases ets1 expression in HUVECs. Ets1 silencing reverses high glucose-mediated endothelial inflammation. Furthermore, the effect of ets1 overexpression is similar to that of high glucose treatment, which is counteracted by si-PTP1B. The results from ChIP assays indicated that ets1 occupies the PTP1B promoter region. Ets1 overexpression enhances PTP1B promoter activity, which is disappeared after specific binding site mutation. In vivo experiments demonstrated that the expressions of VCAM-1, PTP1B, and ets1, as well as the phosphorylation of p65 are augmented in the aorta of diabetic rats. In conclusion, ets1 contributes to hyperglycemia-mediated endothelial inflammation via upregulation of PTP1B expression

Recent developments in main group metal complexes catalyzed/initiated polymerization of lactides and related cyclic esters

This review describes recent development of ring-opening polymerization of lactides and related cyclic esters using main group metal complexes as catalysts/initiators. The complexes described here are classified according to metal groups. Most attention is devoted to the well-defined metal complexes

Effect of <i>Aspergillus flavus</i> Fungal Elicitor on the Production of Terpenoid Indole Alkaloids in <i>Catharanthus roseus</i> Cambial Meristematic Cells

This study reported the inducing effect of Aspergillus flavus fungal elicitor on biosynthesis of terpenoid indole alkaloids (TIAs) in Catharanthus roseus cambial meristematic cells (CMCs) and its inducing mechanism. According to the results determined by HPLC and HPLC-MS/MS, the optimal condition of the A. flavus elicitor was as follows: after suspension culture of C. roseus CMCs for 6 day, 25 mg/L A. flavus mycelium elicitor were added, and the CMC suspensions were further cultured for another 48 h. In this condition, the contents of vindoline, catharanthine, and ajmaline were 1.45-, 3.29-, and 2.14-times as high as those of the control group, respectively. Transcriptome analysis showed that D4H, G10H, GES, IRS, LAMT, SGD, STR, TDC, and ORCA3 were involved in the regulation of this induction process. The results of qRT-PCR indicated that the increasing accumulations of vindoline, catharanthine, and ajmaline in C. roseus CMCs were correlated with the increasing expression of the above genes. Therefore, A. flavus fungal elicitor could enhance the TIA production of C. roseus CMCs, which might be used as an alternative biotechnological resource for obtaining bioactive alkaloids

Relationship between sandstone architecture and remaining oil distribution pattern: A case of the Kumkol South oilfield in South Turgay Basin, Kazakstan

Taking the Kumkol South oilfield in South Turgay Basin, Kazakstan as an example, this article summarizes the controlling pattern of different types of sandstone architecture on remaining oil distribution through examining architecture characteristics, development effect and remaining oil distribution characteristics of meandering river sandstone, braided river sandstone and delta sandstone. The braided river sandstone has simple architecture which is extensive connecting body with horizontal mud-interlayers. The water flooding sweeps evenly and the edge-bottom water drives quickly in braid river sandstone. And the remaining oil distribution pattern of braid river sandstone is the vertical blocking pattern controlled by the horizontal mud-interlayers at the high water cut stage. The meandering river sandstone is a half connecting body with abandoned channels and the lateral accretion mud-interlayers, so the injected water sweeps through the middle and lower parts of point bar sandstone, and its remaining oil distribution pattern is the horizontal blocking pattern controlled by abandoned channels and the lateral accretion mud-interlayers. The delta sandstone has a complex architecture of mosaic structure with abundant horizontal and vertical mud-interlayers and mud-interbeds, in which the injected water sweeps along preferential path, with low sweeping efficiency, and the remaining oil distribution pattern is the complex blocking pattern controlled by horizontal and vertical mud-interlayers and mud-interbeds. The results show that different techniques should be used to enhance the remaining oil recovery because of the different remaining oil distribution patterns in different kind of sand bodies. Key words: delta sand body, meandering river sand body, braided river sand body, sandstone architecture, water flooding development effect, remaining oil distribution, remaining oil development, South Turgay Basi

On-chip sub-terahertz surface plasmon polariton transmission lines with mode converter in CMOS

An on-chip low-loss and high conversion efficiency plasmonic waveguide converter is demonstrated at sub-THz in CMOS. By introducing a subwavelength periodic corrugated structure onto the transmission line (T-line) implemented by a top-layer metal, surface plasmon polaritons (SPP) are established to propagate signals with strongly localized surface-wave. To match both impedance and momentum of other on-chip components with TEM-wave propagation, a mode converter structure featured by a smooth bridge between the Ground coplanar waveguide (GCPW) with 50 Ω impedance and SPP T-line is proposed. To further reduce area, the converter is ultimately simplified to a gradual increment of groove with smooth gradient. The proposed SPP T-lines with the converter is designed and fabricated in the standard 65 nm CMOS process. Both near-field simulation and measurement results show excellent conversion efficiency from quasi-TEM to SPP modes in a broadband frequency range. The converter achieves wideband impedance matching (<−9 dB) with excellent transmission efficiency (averagely −1.9 dB) from 110 GHz–325 GHz. The demonstrated compact and wideband SPP T-lines with mode converter have shown great potentials to replace existing waveguides as future on-chip THz interconnects. To the best of the author’s knowledge, this is the first time to demonstrate the (sub)-THz surface mode conversion on-chip in CMOS technology.Published versio