Fully Automated Fact Checking Using External Sources

Given the constantly growing proliferation of false claims online in recent years, there has been also a growing research interest in automatically distinguishing false rumors from factually true claims. Here, we propose a general-purpose framework for fully-automatic fact checking using external sources, tapping the potential of the entire Web as a knowledge source to confirm or reject a claim. Our framework uses a deep neural network with LSTM text encoding to combine semantic kernels with task-specific embeddings that encode a claim together with pieces of potentially-relevant text fragments from the Web, taking the source reliability into account. The evaluation results show good performance on two different tasks and datasets: (i) rumor detection and (ii) fact checking of the answers to a question in community question answering forums.Comment: RANLP-201

Dimensions of web site credibility and their relation to active trust and behavioural impact

This paper discusses two trends that threaten to undermine the effectiveness of online social marketing interventions: growing mistrust and competition. As a solution, this paper examines the relationships between Web site credibility, target audiences’ active trust and behaviour. Using structural equation modelling to evaluate two credibility models, this study concludes that Web site credibility is best considered a three-dimensional construct composed of expertise, trustworthiness and visual appeal, and that trust plays a partial mediating role between Web site credibility and behavioural impacts. The paper examines theoretical implications of conceptualizing Web sites according to a human credibility model, and factoring trust into Internet-based behavioural change interventions. Practical guidelines suggest ways to address these findings when planning online social marketing interventions

Online Misinformation: Challenges and Future Directions

Misinformation has become a common part of our digital media environments and it is compromising the ability of our societies to form informed opinions. It generates misperceptions, which have affected the decision making processes in many domains, including economy, health, environment, and elections, among others. Misinformation and its generation, propagation, impact, and management is being studied through a variety of lenses (computer science, social science, journalism, psychology, etc.) since it widely affects multiple aspects of society. In this paper we analyse the phenomenon of misinformation from a technological point of view.We study the current socio-technical advancements towards addressing the problem, identify some of the key limitations of current technologies, and propose some ideas to target such limitations. The goal of this position paper is to reflect on the current state of the art and to stimulate discussions on the future design and development of algorithms, methodologies, and applications

Credibility of Health Information and Digital Media: New Perspectives and Implications for Youth

Part of the Volume on Digital Media, Youth, and Credibility. This chapter considers the role of Web technologies on the availability and consumption of health information. It argues that young people are largely unfamiliar with trusted health sources online, making credibility particularly germane when considering this type of information. The author suggests that networked digital media allow for humans and technologies act as "apomediaries" that can be used to steer consumers to high quality health information, thereby empowering health information seekers of all ages

NELA-GT-2018: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articles

In this paper, we present a dataset of 713k articles collected between 02/2018-11/2018. These articles are collected directly from 194 news and media outlets including mainstream, hyper-partisan, and conspiracy sources. We incorporate ground truth ratings of the sources from 8 different assessment sites covering multiple dimensions of veracity, including reliability, bias, transparency, adherence to journalistic standards, and consumer trust. The NELA-GT-2018 dataset can be found at https://doi.org/10.7910/DVN/ULHLCB.Comment: Published at ICWSM 201

Checking the fact-checkers in 2008: predicting political ad scrutiny and assessing consistency

Which types of political ads are most likely to draw criticism from fact-checkers? Are fact-checkers consistent in their evaluations of political ads? Examining general election television ads from the 2008 U.S. presidential race, and based upon the evaluations of FactCheck.org, PolitiFact.com, and the Washington Post's Fact Checker, this study demonstrates it was the attack ads from candidates that were most likely to draw scrutiny from the fact-checkers. Most importantly, a high level of agreement between the fact-checkers indicates their success at selecting political claims that can be consistently evaluated. While political advertisers are increasingly using evidence to support their claims, what may be more critical in drawing evaluations from fact-checkers is the verifiability of a claim. The implications of consistent fact-checking on the public, political actors, journalism and democracy are discussed. With the revelation that fact-checking can be consistently practiced, localized efforts at fact-checking need encouragement, particularly as political TV ads increasingly drown out other potential sources of information for the public and increasingly are used in downballot races, local initiatives, referendums and judicial races

A Health Plan Work in Progress: Hospital-Physician Price and Quality Transparency

Assesses health plans' efforts to provide consumers with price and quality comparisons on hospitals and doctors in twelve metropolitan areas. Looks at the plans' motives and strategies, as well as the limitations, risks, and challenges of transparency