Deng J.

Fard M. A.

Hu Y.

Layne R.

Reed S.

Simonyan K.

Sukhbaatar S.

arXiv

Rich, J

Haddadi, H

Hospedales, TM

Queen Mary Research Online

Towards Bottom-Up Analysis of Social Food

Jaclyn Rich

Hamed Haddadi

Timothy M. Hospedales

Crossref

Social media provide a wealth of information for research into public health by providing a rich mix of personal data, location, hashtags, and social network information. Among these, Instagram has been recently the subject of many computational social science studies. However despite Instagram’s focus on image sharing, most studies have exclusively focused on the hashtag and social network structure. In this paper we perform the first large scale content analysis of Instagram posts, addressing both the image and the associated hashtags, aiming to understand the content of partially labelled images taken in-the-wild and the relationship with hashtags that individuals use as noisy labels. In particular, we explore the possibility of learning to recognise food image content in a data driven way, discovering both the categories of food, and how to recognise them, purely from social network data. Notably, we demonstrate that our approach to food recognition can often achieve accuracies greater than 70% in recognising popular food-related image categories, despite using no manual annotation. We highlight the current capabilities and future challenges and opportunities for such data-driven analysis of image content and the relation to hashtags

Rich, Jaclyn

Haddad, Hamed

Hospedales, Timothy

Edinburgh Research Explorer

English

Towards Bottom-Up Analysis of Social Food.

https://qmro.qmul.ac.uk/xmlui/bitstream/handle/123456789/12139/Haddidi%20Towards%20Bottom-Up%20Analysis%20of%20Social%20Food%202016%20Accepted.pdf?sequence=1

Towards Bottom-Up Analysis of Social Food

Abstract

Similar works

Full text

Available Versions

Queen Mary Research Online

Crossref

Edinburgh Research Explorer

Queen Mary Research Online

Edinburgh Research Explorer