From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction

Visual multimedia have become an inseparable part of our digital social lives, and they often capture moments tied with deep affections. Automated visual sentiment analysis tools can provide a means of extracting the rich feelings and latent dispositions embedded in these media. In this work, we explore how Convolutional Neural Networks (CNNs), a now de facto computational machine learning tool particularly in the area of Computer Vision, can be specifically applied to the task of visual sentiment prediction. We accomplish this through fine-tuning experiments using a state-of-the-art CNN and via rigorous architecture analysis, we present several modifications that lead to accuracy improvements over prior art on a dataset of images from a popular social media platform. We additionally present visualizations of local patterns that the network learned to associate with image sentiment for insight into how visual positivity (or negativity) is perceived by the model.Comment: Accepted for publication in Image and Vision Computing. Models and source code available at https://github.com/imatge-upc/sentiment-201

From individual behaviour to an evaluation of the collective evolution of crowds along footbridges

This paper proposes a crowd dynamic macroscopic model grounded on microscopic phenomenological observations which are upscaled by means of a formal mathematical procedure. The actual applicability of the model to real world problems is tested by considering the pedestrian traffic along footbridges, of interest for Structural and Transportation Engineering. The genuinely macroscopic quantitative description of the crowd flow directly matches the engineering need of bulk results. However, three issues beyond the sole modelling are of primary importance: the pedestrian inflow conditions, the numerical approximation of the equations for non trivial footbridge geometries, and the calibration of the free parameters of the model on the basis of in situ measurements currently available. These issues are discussed and a solution strategy is proposed.Comment: 23 pages, 10 figures in J. Engrg. Math., 201