Deep Landscape Forecasting for Real-time Bidding Advertising

The emergence of real-time auction in online advertising has drawn huge attention of modeling the market competition, i.e., bid landscape forecasting. The problem is formulated as to forecast the probability distribution of market price for each ad auction. With the consideration of the censorship issue which is caused by the second-price auction mechanism, many researchers have devoted their efforts on bid landscape forecasting by incorporating survival analysis from medical research field. However, most existing solutions mainly focus on either counting-based statistics of the segmented sample clusters, or learning a parameterized model based on some heuristic assumptions of distribution forms. Moreover, they neither consider the sequential patterns of the feature over the price space. In order to capture more sophisticated yet flexible patterns at fine-grained level of the data, we propose a Deep Landscape Forecasting (DLF) model which combines deep learning for probability distribution forecasting and survival analysis for censorship handling. Specifically, we utilize a recurrent neural network to flexibly model the conditional winning probability w.r.t. each bid price. Then we conduct the bid landscape forecasting through probability chain rule with strict mathematical derivations. And, in an end-to-end manner, we optimize the model by minimizing two negative likelihood losses with comprehensive motivations. Without any specific assumption for the distribution form of bid landscape, our model shows great advantages over previous works on fitting various sophisticated market price distributions. In the experiments over two large-scale real-world datasets, our model significantly outperforms the state-of-the-art solutions under various metrics.Comment: KDD 2019. The reproducible code and dataset link is https://github.com/rk2900/DL

Reversible Deep Neural Network Watermarking:Matching the Floating-point Weights

Static deep neural network (DNN) watermarking embeds watermarks into the weights of DNN model by irreversible methods, but this will cause permanent damage to watermarked model and can not meet the requirements of integrity authentication. For these reasons, reversible data hiding (RDH) seems more attractive for the copyright protection of DNNs. This paper proposes a novel RDH-based static DNN watermarking method by improving the non-reversible quantization index modulation (QIM). Targeting the floating-point weights of DNNs, the idea of our RDH method is to add a scaled quantization error back to the cover object. Two schemes are designed to realize the integrity protection and legitimate authentication of DNNs. Simulation results on training loss and classification accuracy justify the superior feasibility, effectiveness and adaptability of the proposed method over histogram shifting (HS).Comment: 21 page

Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction

User response prediction, which models the user preference w.r.t. the presented items, plays a key role in online services. With two-decade rapid development, nowadays the cumulated user behavior sequences on mature Internet service platforms have become extremely long since the user's first registration. Each user not only has intrinsic tastes, but also keeps changing her personal interests during lifetime. Hence, it is challenging to handle such lifelong sequential modeling for each individual user. Existing methodologies for sequential modeling are only capable of dealing with relatively recent user behaviors, which leaves huge space for modeling long-term especially lifelong sequential patterns to facilitate user modeling. Moreover, one user's behavior may be accounted for various previous behaviors within her whole online activity history, i.e., long-term dependency with multi-scale sequential patterns. In order to tackle these challenges, in this paper, we propose a Hierarchical Periodic Memory Network for lifelong sequential modeling with personalized memorization of sequential patterns for each user. The model also adopts a hierarchical and periodical updating mechanism to capture multi-scale sequential patterns of user interests while supporting the evolving user behavior logs. The experimental results over three large-scale real-world datasets have demonstrated the advantages of our proposed model with significant improvement in user response prediction performance against the state-of-the-arts.Comment: SIGIR 2019. Reproducible codes and datasets: https://github.com/alimamarankgroup/HPM

CoRide: Joint Order Dispatching and Fleet Management for Multi-Scale Ride-Hailing Platforms

How to optimally dispatch orders to vehicles and how to tradeoff between immediate and future returns are fundamental questions for a typical ride-hailing platform. We model ride-hailing as a large-scale parallel ranking problem and study the joint decision-making task of order dispatching and fleet management in online ride-hailing platforms. This task brings unique challenges in the following four aspects. First, to facilitate a huge number of vehicles to act and learn efficiently and robustly, we treat each region cell as an agent and build a multi-agent reinforcement learning framework. Second, to coordinate the agents from different regions to achieve long-term benefits, we leverage the geographical hierarchy of the region grids to perform hierarchical reinforcement learning. Third, to deal with the heterogeneous and variant action space for joint order dispatching and fleet management, we design the action as the ranking weight vector to rank and select the specific order or the fleet management destination in a unified formulation. Fourth, to achieve the multi-scale ride-hailing platform, we conduct the decision-making process in a hierarchical way where a multi-head attention mechanism is utilized to incorporate the impacts of neighbor agents and capture the key agent in each scale. The whole novel framework is named as CoRide. Extensive experiments based on multiple cities real-world data as well as analytic synthetic data demonstrate that CoRide provides superior performance in terms of platform revenue and user experience in the task of city-wide hybrid order dispatching and fleet management over strong baselines.Comment: CIKM 201

Tetraploidy in Citrus wilsonii Enhances Drought Tolerance via Synergistic Regulation of Photosynthesis, Phosphorylation, and Hormonal Changes

Polyploidy varieties have been reported to exhibit higher stress tolerance relative to their diploid relatives, however, the underlying molecular and physiological mechanisms remain poorly understood. In this study, a batch of autotetraploid Citrus wilsonii were identified from a natural seedling population, and these tetraploid seedlings exhibited greater tolerance to drought stress than their diploids siblings. A global transcriptome analysis revealed that a large number of genes involved in photosynthesis response were enriched in tetraploids under drought stress, which was consistent with the changes in photosynthetic indices including Pn, gs, Tr, Ci, and chlorophyll contents. Compared with diploids, phosphorylation was also modified in the tetraploids after drought stress, as detected through tandem mass tag (TMT)-labeled proteomics. Additionally, tetraploids prioritized the regulation of plant hormone signal transduction at the transcriptional level after drought stress, which was also demonstrated by increased levels of IAA, ABA, and SA and reduced levels of GA3 and JA. Collectively, our results confirmed that the synergistic regulation of photosynthesis response, phosphorylation modification and plant hormone signaling resulted in drought tolerance of autotetraploid C. wilsonii germplasm

Local Diffusion Homogeneity Provides Supplementary Information in T2DM-Related WM Microstructural Abnormality Detection

Objectives: We aimed to investigate whether an inter-voxel diffusivity metric (local diffusion homogeneity, LDH), can provide supplementary information to traditional intra-voxel metrics (i.e., fractional anisotropy, FA) in white matter (WM) abnormality detection for type 2 diabetes mellitus (T2DM).Methods: Diffusion tensor imaging was acquired from 34 T2DM patients and 32 healthy controls. Voxel-based group-difference comparisons based on LDH and FA, as well as the association between the diffusion metrics and T2DM risk factors [i.e., body mass index (BMI) and systolic blood pressure (SBP)], were conducted, with age, gender and education level controlled.Results: Compared to the controls, T2DM patients had higher LDH in the pons and left temporal pole, as well as lower FA in the left superior corona radiation (p < 0.05, corrected). In T2DM, there were several overlapping WM areas associated with BMI as revealed by both LDH and FA, including right temporal lobe and left inferior parietal lobe; but the unique areas revealed only by using LDH included left inferior temporal lobe, right supramarginal gyrus, left pre- and post-central gyrus (at the semiovale center), and right superior radiation. Overlapping WM areas that associated with SBP were found with both LDH and FA, including right temporal pole, bilateral orbitofrontal area (rectus gyrus), the media cingulum bundle, and the right cerebellum crus I. However, the unique areas revealed only by LDH included right inferior temporal lobe, right inferior occipital lobe, and splenium of corpus callosum.Conclusion: Inter- and intra-voxel diffusivity metrics may have different sensitivity in the detection of T2DM-related WM abnormality. We suggested that LDH could provide supplementary information and reveal additional underlying brain changes due to diabetes

Comparative analysis of sequencing technologies for single-cell transcriptomics.

Single-cell RNA-seq technologies require library preparation prior to sequencing. Here, we present the first report to compare the cheaper BGISEQ-500 platform to the Illumina HiSeq platform for scRNA-seq. We generate a resource of 468 single cells and 1297 matched single cDNA samples, performing SMARTer and Smart-seq2 protocols on two cell lines with RNA spike-ins. We sequence these libraries on both platforms using single- and paired-end reads. The platforms have comparable sensitivity and accuracy in terms of quantification of gene expression, and low technical variability. Our study provides a standardized scRNA-seq resource to benchmark new scRNA-seq library preparation protocols and sequencing platforms