11,566 research outputs found
Temporal Cross-Media Retrieval with Soft-Smoothing
Multimedia information have strong temporal correlations that shape the way
modalities co-occur over time. In this paper we study the dynamic nature of
multimedia and social-media information, where the temporal dimension emerges
as a strong source of evidence for learning the temporal correlations across
visual and textual modalities. So far, cross-media retrieval models, explored
the correlations between different modalities (e.g. text and image) to learn a
common subspace, in which semantically similar instances lie in the same
neighbourhood. Building on such knowledge, we propose a novel temporal
cross-media neural architecture, that departs from standard cross-media
methods, by explicitly accounting for the temporal dimension through temporal
subspace learning. The model is softly-constrained with temporal and
inter-modality constraints that guide the new subspace learning task by
favouring temporal correlations between semantically similar and temporally
close instances. Experiments on three distinct datasets show that accounting
for time turns out to be important for cross-media retrieval. Namely, the
proposed method outperforms a set of baselines on the task of temporal
cross-media retrieval, demonstrating its effectiveness for performing temporal
subspace learning.Comment: To appear in ACM MM 201
DancingLines: An Analytical Scheme to Depict Cross-Platform Event Popularity
Nowadays, events usually burst and are propagated online through multiple
modern media like social networks and search engines. There exists various
research discussing the event dissemination trends on individual medium, while
few studies focus on event popularity analysis from a cross-platform
perspective. Challenges come from the vast diversity of events and media,
limited access to aligned datasets across different media and a great deal of
noise in the datasets. In this paper, we design DancingLines, an innovative
scheme that captures and quantitatively analyzes event popularity between
pairwise text media. It contains two models: TF-SW, a semantic-aware popularity
quantification model, based on an integrated weight coefficient leveraging
Word2Vec and TextRank; and wDTW-CD, a pairwise event popularity time series
alignment model matching different event phases adapted from Dynamic Time
Warping. We also propose three metrics to interpret event popularity trends
between pairwise social platforms. Experimental results on eighteen real-world
event datasets from an influential social network and a popular search engine
validate the effectiveness and applicability of our scheme. DancingLines is
demonstrated to possess broad application potentials for discovering the
knowledge of various aspects related to events and different media
Quantifying the Effect of Sentiment on Information Diffusion in Social Media
Social media have become the main vehicle of information production and
consumption online. Millions of users every day log on their Facebook or
Twitter accounts to get updates and news, read about their topics of interest,
and become exposed to new opportunities and interactions. Although recent
studies suggest that the contents users produce will affect the emotions of
their readers, we still lack a rigorous understanding of the role and effects
of contents sentiment on the dynamics of information diffusion. This work aims
at quantifying the effect of sentiment on information diffusion, to understand:
(i) whether positive conversations spread faster and/or broader than negative
ones (or vice-versa); (ii) what kind of emotions are more typical of popular
conversations on social media; and, (iii) what type of sentiment is expressed
in conversations characterized by different temporal dynamics. Our findings
show that, at the level of contents, negative messages spread faster than
positive ones, but positive ones reach larger audiences, suggesting that people
are more inclined to share and favorite positive contents, the so-called
positive bias. As for the entire conversations, we highlight how different
temporal dynamics exhibit different sentiment patterns: for example, positive
sentiment builds up for highly-anticipated events, while unexpected events are
mainly characterized by negative sentiment. Our contribution is a milestone to
understand how the emotions expressed in short texts affect their spreading in
online social ecosystems, and may help to craft effective policies and
strategies for content generation and diffusion.Comment: 10 pages, 5 figure
- …