114 research outputs found
Rec4Ad: A Free Lunch to Mitigate Sample Selection Bias for Ads CTR Prediction in Taobao
Click-Through Rate (CTR) prediction serves as a fundamental component in
online advertising. A common practice is to train a CTR model on advertisement
(ad) impressions with user feedback. Since ad impressions are purposely
selected by the model itself, their distribution differs from the inference
distribution and thus exhibits sample selection bias (SSB) that affects model
performance. Existing studies on SSB mainly employ sample re-weighting
techniques which suffer from high variance and poor model calibration. Another
line of work relies on costly uniform data that is inadequate to train
industrial models. Thus mitigating SSB in industrial models with a
uniform-data-free framework is worth exploring. Fortunately, many platforms
display mixed results of organic items (i.e., recommendations) and sponsored
items (i.e., ads) to users, where impressions of ads and recommendations are
selected by different systems but share the same user decision rationales.
Based on the above characteristics, we propose to leverage recommendations
samples as a free lunch to mitigate SSB for ads CTR model (Rec4Ad). After
elaborating data augmentation, Rec4Ad learns disentangled representations with
alignment and decorrelation modules for enhancement. When deployed in Taobao
display advertising system, Rec4Ad achieves substantial gains in key business
metrics, with a lift of up to +6.6\% CTR and +2.9\% RPM
Joint Optimization of Ranking and Calibration with Contextualized Hybrid Model
Despite the development of ranking optimization techniques, pointwise loss
remains the dominating approach for click-through rate prediction. It can be
attributed to the calibration ability of the pointwise loss since the
prediction can be viewed as the click probability. In practice, a CTR
prediction model is also commonly assessed with the ranking ability. To
optimize the ranking ability, ranking loss (e.g., pairwise or listwise loss)
can be adopted as they usually achieve better rankings than pointwise loss.
Previous studies have experimented with a direct combination of the two losses
to obtain the benefit from both losses and observed an improved performance.
However, previous studies break the meaning of output logit as the
click-through rate, which may lead to sub-optimal solutions. To address this
issue, we propose an approach that can Jointly optimize the Ranking and
Calibration abilities (JRC for short). JRC improves the ranking ability by
contrasting the logit value for the sample with different labels and constrains
the predicted probability to be a function of the logit subtraction. We further
show that JRC consolidates the interpretation of logits, where the logits model
the joint distribution. With such an interpretation, we prove that JRC
approximately optimizes the contextualized hybrid discriminative-generative
objective. Experiments on public and industrial datasets and online A/B testing
show that our approach improves both ranking and calibration abilities. Since
May 2022, JRC has been deployed on the display advertising platform of Alibaba
and has obtained significant performance improvements.Comment: Accepted at KDD 202
COPR: Consistency-Oriented Pre-Ranking for Online Advertising
Cascading architecture has been widely adopted in large-scale advertising
systems to balance efficiency and effectiveness. In this architecture, the
pre-ranking model is expected to be a lightweight approximation of the ranking
model, which handles more candidates with strict latency requirements. Due to
the gap in model capacity, the pre-ranking and ranking models usually generate
inconsistent ranked results, thus hurting the overall system effectiveness. The
paradigm of score alignment is proposed to regularize their raw scores to be
consistent. However, it suffers from inevitable alignment errors and error
amplification by bids when applied in online advertising. To this end, we
introduce a consistency-oriented pre-ranking framework for online advertising,
which employs a chunk-based sampling module and a plug-and-play rank alignment
module to explicitly optimize consistency of ECPM-ranked results. A -based weighting mechanism is adopted to better distinguish the importance
of inter-chunk samples in optimization. Both online and offline experiments
have validated the superiority of our framework. When deployed in Taobao
display advertising system, it achieves an improvement of up to +12.3\% CTR and
+5.6\% RPM
Bridging event-related potentials with behavioral studies in motor learning
Behavioral approaches and electrophysiology in understanding human sensorimotor systems have both yielded substantial advancements in past decades. In fact, behavioral neuroscientists have found that motor learning involves the two distinct processes of the implicit and the explicit. Separately, they have also distinguished two kinds of errors that drive motor learning: sensory prediction error and task error. Scientists in electrophysiology, in addition, have discovered two motor-related, event-related potentials (ERPs): error-related negativity (ERN), and feedback-related negativity (FRN). However, there has been a lack of interchange between the two lines of research. This article, therefore, will survey through the literature in both directions, attempting to establish a bridge between these two fruitful lines of research
The Genomes of Oryza sativa: A History of Duplications
We report improved whole-genome shotgun sequences for the genomes of indica and japonica rice, both with multimegabase contiguity, or almost 1,000-fold improvement over the drafts of 2002. Tested against a nonredundant collection of 19,079 full-length cDNAs, 97.7% of the genes are aligned, without fragmentation, to the mapped super-scaffolds of one or the other genome. We introduce a gene identification procedure for plants that does not rely on similarity to known genes to remove erroneous predictions resulting from transposable elements. Using the available EST data to adjust for residual errors in the predictions, the estimated gene count is at least 38,000–40,000. Only 2%–3% of the genes are unique to any one subspecies, comparable to the amount of sequence that might still be missing. Despite this lack of variation in gene content, there is enormous variation in the intergenic regions. At least a quarter of the two sequences could not be aligned, and where they could be aligned, single nucleotide polymorphism (SNP) rates varied from as little as 3.0 SNP/kb in the coding regions to 27.6 SNP/kb in the transposable elements. A more inclusive new approach for analyzing duplication history is introduced here. It reveals an ancient whole-genome duplication, a recent segmental duplication on Chromosomes 11 and 12, and massive ongoing individual gene duplications. We find 18 distinct pairs of duplicated segments that cover 65.7% of the genome; 17 of these pairs date back to a common time before the divergence of the grasses. More important, ongoing individual gene duplications provide a never-ending source of raw material for gene genesis and are major contributors to the differences between members of the grass family
Fstl1 Antagonizes BMP Signaling and Regulates Ureter Development
Bone morphogenetic protein (BMP) signaling pathway plays important roles in urinary tract development although the detailed regulation of its activity in this process remains unclear. Here we report that follistatin-like 1 (Fstl1), encoding a secreted extracellular glycoprotein, is expressed in developing ureter and antagonizes BMP signaling activity. Mouse embryos carrying disrupted Fstl1 gene displayed prominent hydroureter arising from proximal segment and ureterovesical junction defects. These defects were associated with significant reduction in ureteric epithelial cell proliferation at E15.5 and E16.5 as well as absence of subepithelial ureteral mesenchymal cells in the urinary tract at E16.5 and E18.5. At the molecular level, increased BMP signaling was found in Fstl1 deficient ureters, indicated by elevated pSmad1/5/8 activity. In vitro study also indicated that Fstl1 can directly bind to ALK6 which is specifically expressed in ureteric epithelial cells in developing ureter. Furthermore, Sonic hedgehog (SHH) signaling, which is crucial for differentiation of ureteral subepithelial cell proliferation, was also impaired in Fstl1-/- ureter. Altogether, our data suggest that Fstl1 is essential in maintaining normal ureter development by antagonizing BMP signaling
Finishing the euchromatic sequence of the human genome
The sequence of the human genome encodes the genetic instructions for human physiology, as well as rich information about human evolution. In 2001, the International Human Genome Sequencing Consortium reported a draft sequence of the euchromatic portion of the human genome. Since then, the international collaboration has worked to convert this draft into a genome sequence with high accuracy and nearly complete coverage. Here, we report the result of this finishing process. The current genome sequence (Build 35) contains 2.85 billion nucleotides interrupted by only 341 gaps. It covers ∼99% of the euchromatic genome and is accurate to an error rate of ∼1 event per 100,000 bases. Many of the remaining euchromatic gaps are associated with segmental duplications and will require focused work with new methods. The near-complete sequence, the first for a vertebrate, greatly improves the precision of biological analyses of the human genome including studies of gene number, birth and death. Notably, the human enome seems to encode only 20,000-25,000 protein-coding genes. The genome sequence reported here should serve as a firm foundation for biomedical research in the decades ahead
- …