Commercial Content Moderation: An opaque maze for freedom of expression and customers’ opinions

Abstract: The present work analyses Content Moderation, focusing on ethical concerns and cognitive effects. Starting from a general description and history of the moderation process, it stresses some ethical problems: quality of moderation, transparency, and the working conditions of human moderators. Using some of Facebook leaked slides offering examples of moderation, we define some controversial rules and principles for Commercial Content Moderation. These examples highlight a general lack of coherency and transparency, which has the potential to affect users’ cognitive attitudes, their perception of reality, and their freedom of speech. Such effects are studied in comparison to other well-known online cognitive phenomena (bubbles and echo chambers) and in relation to the most recent dedicated legislation in EU countries. The current Content Moderation scheme leaves users at risk of specific cognitive distortions, highlighting the urgent need for greater transparency throughout the moderation process and better working conditions for moderators.Keywords: Content Moderation; Freedom of Speech; Epistemic Bubble; Technology EthicsCommercial Content Moderation: un oscuro labirinto per la libertà d’espressione e le opinioni degli utentiRiassunto: Il presente lavoro offre un’analisi approfondita della moderazione di contenuti, concentrandosi sulle problematiche etiche e sugli effetti cognitivi. A partire da una introduzione ai concetti chiave e alla storia della moderazione di contenuti online, si concentra su alcuni problemi etici primari: la qualità della moderazione, la sua trasparenza e le condizioni di lavoro dei lavoratori. Utilizzando dei documenti formativi interni di Facebook, pubblicati da un quotidiano e dagli esempi in essi contenuti, definiremo le controverse regole e i principi della Commercial Content Moderation. Ne emerge una generale mancanza di coerenza organizzativa e di trasparenza nel processo, che mostra potenziali effetti dannosi sulle attitudini degli utenti, sulla loro percezione della realtà e la loro libertà di parola. Tali effetti saranno studiati in confronto con i più conosciuti effetti cognitivi del mondo dei social (epistemic bubble, filter bubble, echo chamber) ed in relazione alle più recenti disposizioni di leggi europee in merito. Gli schemi attualmente in uso producono degli specifici effetti di distorsione cognitiva e conseguentemente mostrano l’importanza di una maggiore attenzione alla trasparenza del processo e alle condizioni di lavoro dei moderatori.Parole chiave: Moderazione di contenuti; Libertà di parola; Bolla epistemica; Etica della tecnologi

How to Do Things with Information Online. A Conceptual Framework for Evaluating Social Networking Platforms as Epistemic Environments

This paper proposes a conceptual framework for evaluating how social networking platforms fare as epistemic environments for human users. I begin by proposing a situated concept of epistemic agency as fundamental for evaluating epistemic environments. Next, I show that algorithmic personalisation of information makes social networking platforms problematic for users’ epistemic agency because these platforms do not allow users to adapt their behaviour sufficiently. Using the tracing principle inspired by the ethics of self-driving cars, I operationalise it here and identify three requirements that automated epistemic environments need to fulfil: (a) the users need to be afforded a range of skilled actions; (b) users need to be sensitive to the possibility to use their skills; (c) the habits built when adapting to the platform should not undermine the user’s pre-existing skills. I then argue that these requirements are almost impossible to fulfil all at the same time on current SN platforms; yet nevertheless, we need to pay attention to these whenever we evaluate an epistemic environment with automatic features. Finally, as an illustration, I show how Twitter, a popular social networking platform, will fare regarding these requirements

The Diffusion of Ignorance in On-Line Communities

This article aims to investigate how information-sharing mechanisms in online communities favor activities of ignorance distribution on their platforms, such as fake data, biased beliefs, and inaccurate statements. In brief, the authors claim that online communities provide more ways to connect the users to one another rather than to control the quality of the data they share and receive. This, in turn, diminishes the value of fact-checking mechanisms in online news-consumption. The authors contend that while digital environments can stimulate the interest of groups of students and amateurs in scientific and political topics, the diffusion of false, poor, and un-validated data through digital media contributes to the formation of bubbles of shallow understanding in the digitally informed public. In brief, the present article is a philosophical research that applies the virtual niche construction theory to the cognitive behavior of internet users, as it is described by the current psychological, sociological, and anthropological literature