79 research outputs found

    On the feasibility of predicting volumes of fake news- the Spanish case

    Get PDF
    The growing amount of news shared on the Internet makes it hard to verify them in real-time. Malicious actors take advantage of this situation by spreading fake news to impact society through misinformation. An estimation of future fake news would help to focus the detection and verification efforts. Unfortunately, no previous work has addressed this issue yet. Therefore, this work measures the feasibility of predicting the volume of future fake news in a particular context—Spanish contents related to Spain. The approach involves different artificial intelligence (AI) mechanisms on a dataset of 298k real news and 8.9k fake news in the period 2019–2022. Results show that very accurate predictions can be reached. In general words, the use of long short-term memory (LSTM) with attention mechanisms offers the best performance, being headlines useful when a small amount of days is taken as input. In the best cases, when predictions are made for periods, an error of 10.3% is made considering the mean of fake news. This error raises to 28.7% when predicting a single day in the future.This work was supported in part by the Universidad Carlos III de Madrid (UC3M) and the Government of Madrid [Community of Madrid (CAM)] under Grant DEPROFAKE-CM-UC3M; in part by the CAM through the Project CYNAMON, co-funded by the European Research Development Fund (ERDF), under Grant P2018/TCS-4566-CM; and in part by the Spanish Ministry of Science and Innovation (MICINN) of Spain under Grant PID2019-111429RB-C2

    Understanding peace through the world news

    Get PDF
    Peace is a principal dimension of well-being and is the way out of inequity and violence. Thus, its measurement has drawn the attention of researchers, policymakers, and peacekeepers. During the last years, novel digital data streams have drastically changed the research in this field. The current study exploits information extracted from a new digital database called Global Data on Events, Location, and Tone (GDELT) to capture peace through the Global Peace Index (GPI). Applying predictive machine learning models, we demonstrate that news media attention from GDELT can be used as a proxy for measuring GPI at a monthly level. Additionally, we use explainable AI techniques to obtain the most important variables that drive the predictions. This analysis highlights each country’s profile and provides explanations for the predictions, and particularly for the errors and the events that drive these errors. We believe that digital data exploited by researchers, policymakers, and peacekeepers, with data science tools as powerful as machine learning, could contribute to maximizing the societal benefits and minimizing the risks to peace.Peace is a principal dimension of well-being and is the way out of inequity and violence. Thus, its measurement has drawn the attention of researchers, policymakers, and peacekeepers. During the last years, novel digital data streams have drastically changed the research in this field. The current study exploits information extracted from a new digital database called Global Data on Events, Location, and Tone (GDELT) to capture peace through the Global Peace Index (GPI). Applying predictive machine learning models, we demonstrate that news media attention from GDELT can be used as a proxy for measuring GPI at a monthly level. Additionally, we use explainable AI techniques to obtain the most important variables that drive the predictions. This analysis highlights each country’s profile and provides explanations for the predictions, and particularly for the errors and the events that drive these errors. We believe that digital data exploited by researchers, policymakers, and peacekeepers, with data science tools as powerful as machine learning, could contribute to maximizing the societal benefits and minimizing the risks to peace

    Creating an Agglomerative Clustering Approach Using GDELT

    Get PDF
    GDELT is a project with a large scale, continuously updated databank that provides a real-time image of the global news picture by outputting these as files that can be downloaded and used by anyone. However, this data is of low granularity, and each source of data does not provide much information on its own. This thesis attempts to leverage the large amount of data available by utilizing a Hierarchical Agglomerative Cluster method to identify news articles that report about the same real life event. To do this, the thesis also explores if the GDELT data is granular enough to be used without extensive preprocessing, and if a distance metric for the cluster algorithm can be created. The findings show promising results when regarded with qualitative measures, but the quantitative measures are not yet optimized. Inherent flaws in GDELT and clustering algorithms are a hurdle to be overcome before the real potential of GDELT’s data can be unleashed, and this thesis will explore some of these difficulties and make recommendations for how to circumvent them in future works.Masteroppgave i informasjonsvitenskapINFO390MASV-INF

    Predicting Social Unrest Events with Hidden Markov Models Using GDELT

    Get PDF
    Proactive handling of social unrest events which are common happenings in both democracies and authoritarian regimes requires that the risk of upcoming social unrest event is continuously assessed. Most existing approaches comparatively pay little attention to considering the event development stages. In this paper, we use autocoded events dataset GDELT (Global Data on Events, Location, and Tone) to build a Hidden Markov Models (HMMs) based framework to predict indicators associated with country instability. The framework utilizes the temporal burst patterns in GDELT event streams to uncover the underlying event development mechanics and formulates the social unrest event prediction as a sequence classification problem based on Bayes decision. Extensive experiments with data from five countries in Southeast Asia demonstrate the effectiveness of this framework, which outperforms the logistic regression method by 7% to 27% and the baseline method 34% to 62% for various countries

    Analysis of Social Unrest Events using Spatio-Temporal Data Clustering and Agent-Based Modelling

    Get PDF
    Social unrest such as appeals, protests, conflicts, fights and mass violence can result from a wide ranging of diverse factors making the analysis of causal relationships challenging, with high complexity and uncertainty. Unrest events can result in significant changes in a society ranging from new policies and regulations to regime change. Widespread unrest often arises through a process of feedback and cascading of a collection of past events over time, in regions that are close to each other. Understanding the dynamics of these social events and extrapolating their future growth will enable analysts to detect or forecast major societal events. The study and prediction of social unrest has primarily been done through case-studies and study of social media messaging using various natural language processing techniques. The grouping of related events is often done by subject matter experts that create profiles for countries or locations. We propose two approaches in understanding and modelling social unrest data: (1) spatio-temporal data clustering, and (2) agent-based modelling. We apply the clustering solution to real-world unrest events with socioeconomic and infrastructure factors. We also present a framework of an agent-based model where unrest events act as intelligent agents that continuously study their environment and perform actions. We run simulations of the agent-based model under varying conditions and evaluate the results in comparison to real-world data. Our results show the viability of our proposed solutions. Adviser: Leen-Kiat Soh and Ashok Sama

    The Role of Emerging Predictive IT Tools in Effective Migration Governance

    Get PDF
    Predicting mass migration is one of the main challenges for policymakers and NGOs working with migrants worldwide. Recently there has been a considerable increase in the use of computational techniques to predict migration flows, and advances have allowed for application of improved algorithms in the field. However, given the rapid pace of technological development facilitating these new predictive tools and methods for migration, it is important to address the extent to which such instruments and techniques engage with and impact migration governance. This study provides an in-depth examination of selected existing predictive tools in the migration field and their impact on the governance of migratory flows. It focuses on a comparative qualitative examination of these tools’ scope, as well as how these characteristics link to their respective underlying migration theory, research question, or objective. It overviews how several organisations have developed tools to predict short- or longer-term migration patterns, or to assess and estimate migration uncertainties. At the same time, it demonstrates how and why these instruments continue to face limitations that in turn affect migration management, especially as it relates to increasing EU institutional and stakeholder efforts to forecast or predict mixed migration. The main predictive migration tools in use today cover different scopes and uses, and as such are equally valid in shaping the requirements for a future, fully comprehensive predictive migration tool. This article provides clarity on the requirements and features for such a tool and draws conclusions as to the risks and opportunities any such tool could present for the future of EU migration governance

    Forecasting asylum-related migration flows with machine learning and data at scale

    Full text link
    The effects of the so-called "refugee crisis" of 2015-16 continue to dominate the political agenda in Europe. Migration flows were sudden and unexpected, leaving governments unprepared and exposing significant shortcomings in the field of migration forecasting. Migration is a complex system typified by episodic variation, underpinned by causal factors that are interacting, highly context dependent and short-lived. Correspondingly, migration monitoring relies on scattered data, while approaches to forecasting focus on specific migration flows and often have inconsistent results that are difficult to generalise at the regional or global levels. Here we show that adaptive machine learning algorithms that integrate official statistics and non-traditional data sources at scale can effectively forecast asylum-related migration flows. We focus on asylum applications lodged in countries of the European Union (EU) by nationals of all countries of origin worldwide; the same approach can be applied in any context provided adequate migration or asylum data are available. We exploit three tiers of data - geolocated events and internet searches in countries of origin, detections of irregular crossings at the EU border, and asylum recognition rates in countries of destination - to effectively forecast individual asylum-migration flows up to four weeks ahead with high accuracy. Uniquely, our approach a) monitors potential drivers of migration in countries of origin to detect changes early onset; b) models individual country-to-country migration flows separately and on moving time windows; c) estimates the effects of individual drivers, including lagged effects; d) provides forecasts of asylum applications up to four weeks ahead; e) assesses how patterns of drivers shift over time to describe the functioning and change of migration systems

    The Role of emerging predictive IT tools in effective Mmigration governance

    Get PDF
    Predicting mass migration is one of the main challenges for policymakers and NGOs working with migrants worldwide. Recently there has been a considerable increase in the use of computational techniques to predict migration flows, and advances have allowed for application of improved algorithms in the field. However, given the rapid pace of technological development facilitating these new predictive tools and methods for migration, it is important to address the extent to which such instruments and techniques engage with and impact migration governance. This study provides an in-depth examination of selected existing predictive tools in the migration field and their impact on the governance of migratory flows. It focuses on a comparative qualitative examination of these tools' scope, as well as how these characteristics link to their respective underlying migration theory, research question, or objective. It overviews how several organisations have developed tools to predict short- or longer-term migration patterns, or to assess and estimate migration uncertain- ties. At the same time, it demonstrates how and why these instruments continue to face limitations that in turn affect migration management, especially as it relates to increasing EU institutional and stakeholder efforts to forecast or predict mixed migration. The main predictive migration tools in use today cover different scopes and uses, and as such are equally valid in shaping the requirements for a future, fully comprehensive predictive migration tool. This article provides clarity on the requirements and features for such a tool and draws conclusions as to the risks and opportunities any such tool could present for the future of EU migration governance
    • …
    corecore