5 research outputs found
Rankers, Rankees, & Rankings: Peeking into the Pandora's Box from a Socio-Technical Perspective
Algorithmic rankers have a profound impact on our increasingly data-driven
society. From leisurely activities like the movies that we watch, the
restaurants that we patronize; to highly consequential decisions, like making
educational and occupational choices or getting hired by companies -- these are
all driven by sophisticated yet mostly inaccessible rankers. A small change to
how these algorithms process the rankees (i.e., the data items that are ranked)
can have profound consequences. For example, a change in rankings can lead to
deterioration of the prestige of a university or have drastic consequences on a
job candidate who missed out being in the list of the preferred top-k for an
organization. This paper is a call to action to the human-centered data science
research community to develop principled methods, measures, and metrics for
studying the interactions among the socio-technical context of use,
technological innovations, and the resulting consequences of algorithmic
rankings on multiple stakeholders. Given the spate of new legislations on
algorithmic accountability, it is imperative that researchers from social
science, human-computer interaction, and data science work in unison for
demystifying how rankings are produced, who has agency to change them, and what
metrics of socio-technical impact one must use for informing the context of
use.Comment: Accepted for Interrogating Human-Centered Data Science workshop at
CHI'2
Most Expected Winner: An Interpretation of Winners over Uncertain Voter Preferences
It remains an open question how to determine the winner of an election when
voter preferences are incomplete or uncertain. One option is to assume some
probability space over the voting profile and select the Most Probable Winner
(MPW) -- the candidate or candidates with the best chance of winning. In this
paper, we propose an alternative winner interpretation, selecting the Most
Expected Winner (MEW) according to the expected performance of the candidates.
We separate the uncertainty in voter preferences into the generation step and
the observation step, which gives rise to a unified voting profile combining
both incomplete and probabilistic voting profiles. We use this framework to
establish the theoretical hardness of \mew over incomplete voter preferences,
and then identify a collection of tractable cases for a variety of voting
profiles, including those based on the popular Repeated Insertion Model (RIM)
and its special case, the Mallows model. We develop solvers customized for
various voter preference types to quantify the candidate performance for the
individual voters, and propose a pruning strategy that optimizes computation.
The performance of the proposed solvers and pruning strategy is evaluated
extensively on real and synthetic benchmarks, showing that our methods are
practical.Comment: This is the technical report of the following paper: Haoyue Ping and
Julia Stoyanovich. 2023. Most Expected Winner: An Interpretation of Winners
over Uncertain Voter Preferences. Proc. ACM Manag. Data, 1, N1, Article 22
(May 2023), 33 pages. https://doi.org/10.1145/358870