3 research outputs found
Knowledge-rich Image Gist Understanding Beyond Literal Meaning
We investigate the problem of understanding the message (gist) conveyed by
images and their captions as found, for instance, on websites or news articles.
To this end, we propose a methodology to capture the meaning of image-caption
pairs on the basis of large amounts of machine-readable knowledge that has
previously been shown to be highly effective for text understanding. Our method
identifies the connotation of objects beyond their denotation: where most
approaches to image understanding focus on the denotation of objects, i.e.,
their literal meaning, our work addresses the identification of connotations,
i.e., iconic meanings of objects, to understand the message of images. We view
image understanding as the task of representing an image-caption pair on the
basis of a wide-coverage vocabulary of concepts such as the one provided by
Wikipedia, and cast gist detection as a concept-ranking problem with
image-caption pairs as queries. To enable a thorough investigation of the
problem of gist understanding, we produce a gold standard of over 300
image-caption pairs and over 8,000 gist annotations covering a wide variety of
topics at different levels of abstraction. We use this dataset to
experimentally benchmark the contribution of signals from heterogeneous
sources, namely image and text. The best result with a Mean Average Precision
(MAP) of 0.69 indicate that by combining both dimensions we are able to better
understand the meaning of our image-caption pairs than when using language or
vision information alone. We test the robustness of our gist detection approach
when receiving automatically generated input, i.e., using automatically
generated image tags or generated captions, and prove the feasibility of an
end-to-end automated process
caso da WYSIWYG
O presente trabalho retrata um estágio curricular realizado na organização WYSIWYG, de forma a concluir o Mestrado em Marketing e Comunicação da Escola Superior de Educação de Coimbra e da Escola Superior de Tecnologia e Gestão de Oliveira do Hospital.
Ao longo do relatório estão descritas as atividades realizadas na WYSIWYG, durante dos quatro meses de estágio, envolvendo a temática Marketing Digital e respetivas ferramentas. Estas atividades envolvem a Gestão de Redes Sociais e do Website, a Criação de Conteúdo, a Edição de Imagem e a Divulgação de Eventos. O objetivo final é dar solução ao problema organizacional, detetado pela empresa.
De uma forma sumária, os resultados obtidos através destas atividades promoveram a criação de conteúdo e o aumento da interação e dos “gostos” nas diversas redes sociais da marca On Centro.N/