22,864 research outputs found
Controlling Fairness and Bias in Dynamic Learning-to-Rank
Rankings are the primary interface through which many online platforms match
users to items (e.g. news, products, music, video). In these two-sided markets,
not only the users draw utility from the rankings, but the rankings also
determine the utility (e.g. exposure, revenue) for the item providers (e.g.
publishers, sellers, artists, studios). It has already been noted that
myopically optimizing utility to the users, as done by virtually all
learning-to-rank algorithms, can be unfair to the item providers. We,
therefore, present a learning-to-rank approach for explicitly enforcing
merit-based fairness guarantees to groups of items (e.g. articles by the same
publisher, tracks by the same artist). In particular, we propose a learning
algorithm that ensures notions of amortized group fairness, while
simultaneously learning the ranking function from implicit feedback data. The
algorithm takes the form of a controller that integrates unbiased estimators
for both fairness and utility, dynamically adapting both as more data becomes
available. In addition to its rigorous theoretical foundation and convergence
guarantees, we find empirically that the algorithm is highly practical and
robust.Comment: First two authors contributed equally. In Proceedings of the 43rd
International ACM SIGIR Conference on Research and Development in Information
Retrieval 202
Incorporating System-Level Objectives into Recommender Systems
One of the most essential parts of any recommender system is
personalization-- how acceptable the recommendations are from the user's
perspective. However, in many real-world applications, there are other
stakeholders whose needs and interests should be taken into account. In this
work, we define the problem of multistakeholder recommendation and we focus on
finding algorithms for a special case where the recommender system itself is
also a stakeholder. In addition, we will explore the idea of incremental
incorporation of system-level objectives into recommender systems over time to
tackle the existing problems in the optimization techniques which only look for
optimizing the individual users' lists.Comment: arXiv admin note: text overlap with arXiv:1901.0755
Dynamic Poisson Factorization
Models for recommender systems use latent factors to explain the preferences
and behaviors of users with respect to a set of items (e.g., movies, books,
academic papers). Typically, the latent factors are assumed to be static and,
given these factors, the observed preferences and behaviors of users are
assumed to be generated without order. These assumptions limit the explorative
and predictive capabilities of such models, since users' interests and item
popularity may evolve over time. To address this, we propose dPF, a dynamic
matrix factorization model based on the recent Poisson factorization model for
recommendations. dPF models the time evolving latent factors with a Kalman
filter and the actions with Poisson distributions. We derive a scalable
variational inference algorithm to infer the latent factors. Finally, we
demonstrate dPF on 10 years of user click data from arXiv.org, one of the
largest repository of scientific papers and a formidable source of information
about the behavior of scientists. Empirically we show performance improvement
over both static and, more recently proposed, dynamic recommendation models. We
also provide a thorough exploration of the inferred posteriors over the latent
variables.Comment: RecSys 201
ICMRec: Item Cluster-Wise Multi-Objective Optimization for Unbiased Recommendation
The traditional observed data used to train the recommender model suffers
from severe bias issues (e.g., exposure bias, popularity bias). Interactions of
a small fraction of head items account for almost the whole training data. The
normal training paradigm from such biased data tends to repetitively generate
recommendations from the head items, which further exacerbates the biases and
affects the exploration of potentially interesting items from the niche set. In
this work, distinct from existing methods, we innovatively explore the central
theme of unbiased recommendation from an item cluster-wise multi-objective
optimization perspective. Aiming to balance the learning on various item
clusters that differ in popularity during the training process, we characterize
the recommendation task as an item cluster-wise multi-objective optimization
problem. To this end, we propose a model-agnostic framework namely Item
Cluster-Wise Multi-Objective Recommendation (ICMRec) for unbiased
recommendation. In detail, we define our item cluster-wise optimization target
that the recommender model should balance all item clusters that differ in
popularity. Thus we set the model learning on each item cluster as a unique
optimization objective. To achieve this goal, we first explore items'
popularity levels from a novel causal reasoning perspective. Then, we devise
popularity discrepancy-based bisecting clustering to separate the discriminated
item clusters. Next, we adaptively find the overall harmonious gradient
direction for multiple item cluster-wise optimization objectives from a
Pareto-efficient solver. Finally, in the prediction stage, we perform
counterfactual inference to further eliminate the impact of user conformity.
Extensive experimental results demonstrate the superiorities of ICMRec on
overall recommendation performance and biases elimination. Codes will be
open-source upon acceptance
New debiasing strategies in collaborative filtering recommender systems: modeling user conformity, multiple biases, and causality.
Recommender Systems are widely used to personalize the user experience in a diverse set of online applications ranging from e-commerce and education to social media and online entertainment. These State of the Art AI systems can suffer from several biases that may occur at different stages of the recommendation life-cycle. For instance, using biased data to train recommendation models may lead to several issues, such as the discrepancy between online and offline evaluation, decreasing the recommendation performance, and hurting the user experience. Bias can occur during the data collection stage where the data inherits the user-item interaction biases, such as selection and exposure bias. Bias can also occur in the training stage, where popular items tend to be recommended much more frequently given that they received more interactions to start with. The closed feedback loop nature of online recommender systems will further amplify the latter biases as well. In this dissertation, we study the bias in the context of Collaborative Filtering recommender system, and propose a new Popularity Correction Matrix Factorization (PCMF) that aims to improve the recommender system performance as well as decrease popularity bias and increase the diversity of items in the recommendation lists. PCMF mitigates popularity bias by disentangling relevance and conformity and by learning a user-personalized bias vector to capture the users\u27 individual conformity levels along a full spectrum of conformity bias. One shortcoming of the proposed PCMF debiasing approach, is its assumption that the recommender system is affected by only popularity bias. However in the real word, different types of bias do occur simultaneously and interact with one another. We therefore relax the latter assumption and propose a multi-pronged approach that can account for two biases simultaneously, namely popularity and exposure bias. our experimental results show that accounting for multiple biases does improve the results in terms of providing more accurate and less biased results. Finally, we propose a novel two-stage debiasing approach, inspired from the proximal causal inference framework. Unlike the existing causal IPS approach that corrects for observed confounders, our proposed approach corrects for both observed and potential unobserved confounders. The approach relies on a pair of negative control variables to adjust for the bias in the potential ratings. Our proposed approach outperforms state of the art causal approaches, proving that accounting for unobserved confounders can improve the recommendation system\u27s performance
- …