In large-scale industrial e-commerce, the efficiency of an online
recommendation system is crucial in delivering highly relevant item/content
advertising that caters to diverse business scenarios. However, most existing
studies focus solely on item advertising, neglecting the significance of
content advertising. This oversight results in inconsistencies within the
multi-entity structure and unfair retrieval. Furthermore, the challenge of
retrieving top-k advertisements from multi-entity advertisements across
different domains adds to the complexity. Recent research proves that
user-entity behaviors within different domains exhibit characteristics of
differentiation and homogeneity. Therefore, the multi-domain matching models
typically rely on the hybrid-experts framework with domain-invariant and
domain-specific representations. Unfortunately, most approaches primarily focus
on optimizing the combination mode of different experts, failing to address the
inherent difficulty in optimizing the expert modules themselves. The existence
of redundant information across different domains introduces interference and
competition among experts, while the distinct learning objectives of each
domain lead to varying optimization challenges among experts. To tackle these
issues, we propose robust representation learning for the unified online top-k
recommendation. Our approach constructs unified modeling in entity space to
ensure data fairness. The robust representation learning employs domain
adversarial learning and multi-view wasserstein distribution learning to learn
robust representations. Moreover, the proposed method balances conflicting
objectives through the homoscedastic uncertainty weights and orthogonality
constraints. Various experiments validate the effectiveness and rationality of
our proposed method, which has been successfully deployed online to serve real
business scenarios.Comment: 14 pages, 6 figures, submitted to ICD