Machine Vision and Social Media Images: Why Hashtags Matter

Studying images in social media poses specific methodological challenges, which in turn have directed scholarly attention toward the computational interpretation of visual data. When analyzing large numbers of images, both traditional content analysis as well as cultural analytics have proven valuable. However, these techniques do not take into account the contextualization of images within a socio-technical environment. As the meaning of social media images is co-created by online publics, bound through networked practices, these visuals should be analyzed on the level of their networked contextualization. Although machine vision is increasingly adept at recognizing faces and features, its performance in grasping the meaning of social media images remains limited. Combining automated analyses of images with platform data opens up the possibility to study images in the context of their resonance within and across online discursive spaces. This article explores the capacities of hashtags and retweet counts to complement the automated assessment of social media images, doing justice to both the visual elements of an image and the contextual elements encoded through the hashtag practices of networked publics

Regimes of visibility and the affective affordances of Twitter

Online social networks produce a visuality that reflects the attention economy governing this space. What is seen becomes elevated into prominence by networked publics that ‘perform’ affective expressions within platform affordances. We mapped Twitter images of refugees in two language spaces - English and Arabic. Using automated analysis and qualitative visual analysis, we found similar images circulating both spaces. However, photographs generating higher retweet counts were distinct. This highlights the impact of affective affordances of Twitter — in this case retweeting — on regimes of visibility in disparate spheres. Representations of refugees in the English language space were characterized by personalized, positive imagery, emphasizing solidarity for refugees contributing to their host country or stipulating innocence. Resonating images in the Arabic space were less personalized and depicted a more localized visuality of life in refugee camps, with an emphasis on living conditions in refugee camps and the efforts of aid organizations