171 research outputs found
Hierarchical Transformer with Spatio-Temporal Context Aggregation for Next Point-of-Interest Recommendation
Next point-of-interest (POI) recommendation is a critical task in
location-based social networks, yet remains challenging due to a high degree of
variation and personalization exhibited in user movements. In this work, we
explore the latent hierarchical structure composed of multi-granularity
short-term structural patterns in user check-in sequences. We propose a
Spatio-Temporal context AggRegated Hierarchical Transformer (STAR-HiT) for next
POI recommendation, which employs stacked hierarchical encoders to recursively
encode the spatio-temporal context and explicitly locate subsequences of
different granularities. More specifically, in each encoder, the global
attention layer captures the spatio-temporal context of the sequence, while the
local attention layer performed within each subsequence enhances subsequence
modeling using the local context. The sequence partition layer infers positions
and lengths of subsequences from the global context adaptively, such that
semantics in subsequences can be well preserved. Finally, the subsequence
aggregation layer fuses representations within each subsequence to form the
corresponding subsequence representation, thereby generating a new sequence of
higher-level granularity. The stacking of encoders captures the latent
hierarchical structure of the check-in sequence, which is used to predict the
next visiting POI. Extensive experiments on three public datasets demonstrate
that the proposed model achieves superior performance whilst providing
explanations for recommendations. Codes are available at
https://github.com/JennyXieJiayi/STAR-HiT
Deep Learning based Recommender System: A Survey and New Perspectives
With the ever-growing volume of online information, recommender systems have
been an effective strategy to overcome such information overload. The utility
of recommender systems cannot be overstated, given its widespread adoption in
many web applications, along with its potential impact to ameliorate many
problems related to over-choice. In recent years, deep learning has garnered
considerable interest in many research fields such as computer vision and
natural language processing, owing not only to stellar performance but also the
attractive property of learning feature representations from scratch. The
influence of deep learning is also pervasive, recently demonstrating its
effectiveness when applied to information retrieval and recommender systems
research. Evidently, the field of deep learning in recommender system is
flourishing. This article aims to provide a comprehensive review of recent
research efforts on deep learning based recommender systems. More concretely,
we provide and devise a taxonomy of deep learning based recommendation models,
along with providing a comprehensive summary of the state-of-the-art. Finally,
we expand on current trends and provide new perspectives pertaining to this new
exciting development of the field.Comment: The paper has been accepted by ACM Computing Surveys.
https://doi.acm.org/10.1145/328502
Toward Point-of-Interest Recommendation Systems: A Critical Review on Deep-Learning Approaches
In recent years, location-based social networks (LBSNs) that allow members to share their location and provide related services, and point-of-interest (POIs) recommendations which suggest attractive places to visit, have become noteworthy and useful for users, research areas, industries, and advertising companies. The POI recommendation system combines different information sources and creates numerous research challenges and questions. New research in this field utilizes deep-learning techniques as a solution to the issues because it has the ability to represent the nonlinear relationship between users and items more effectively than other methods. Despite all the obvious improvements that have been made recently, this field still does not have an updated and integrated view of the types of methods, their limitations, features, and future prospects. This paper provides a systematic review focusing on recent research on this topic. First, this approach prepares an overall view of the types of recommendation methods, their challenges, and the various influencing factors that can improve model performance in POI recommendations, then it reviews the traditional machine-learning methods and deep-learning techniques employed in the POI recommendation and analyzes their strengths and weaknesses. The recently proposed models are categorized according to the method used, the dataset, and the evaluation metrics. It found that these articles give priority to accuracy in comparison with other dimensions of quality. Finally, this approach introduces the research trends and future orientations, and it realizes that POI recommender systems based on deep learning are a promising future work
Decentralized Collaborative Learning Framework for Next POI Recommendation
Next Point-of-Interest (POI) recommendation has become an indispensable
functionality in Location-based Social Networks (LBSNs) due to its
effectiveness in helping people decide the next POI to visit. However, accurate
recommendation requires a vast amount of historical check-in data, thus
threatening user privacy as the location-sensitive data needs to be handled by
cloud servers. Although there have been several on-device frameworks for
privacy-preserving POI recommendations, they are still resource-intensive when
it comes to storage and computation, and show limited robustness to the high
sparsity of user-POI interactions. On this basis, we propose a novel
decentralized collaborative learning framework for POI recommendation (DCLR),
which allows users to train their personalized models locally in a
collaborative manner. DCLR significantly reduces the local models' dependence
on the cloud for training, and can be used to expand arbitrary centralized
recommendation models. To counteract the sparsity of on-device user data when
learning each local model, we design two self-supervision signals to pretrain
the POI representations on the server with geographical and categorical
correlations of POIs. To facilitate collaborative learning, we innovatively
propose to incorporate knowledge from either geographically or semantically
similar users into each local model with attentive aggregation and mutual
information maximization. The collaborative learning process makes use of
communications between devices while requiring only minor engagement from the
central server for identifying user groups, and is compatible with common
privacy preservation mechanisms like differential privacy. We evaluate DCLR
with two real-world datasets, where the results show that DCLR outperforms
state-of-the-art on-device frameworks and yields competitive results compared
with centralized counterparts.Comment: 21 Pages, 3 figures, 4 table
Context-aware multi-head self-attentional neural network model for next location prediction
Accurate activity location prediction is a crucial component of many mobility
applications and is particularly required to develop personalized, sustainable
transportation systems. Despite the widespread adoption of deep learning
models, next location prediction models lack a comprehensive discussion and
integration of mobility-related spatio-temporal contexts. Here, we utilize a
multi-head self-attentional (MHSA) neural network that learns location
transition patterns from historical location visits, their visit time and
activity duration, as well as their surrounding land use functions, to infer an
individual's next location. Specifically, we adopt point-of-interest data and
latent Dirichlet allocation for representing locations' land use contexts at
multiple spatial scales, generate embedding vectors of the spatio-temporal
features, and learn to predict the next location with an MHSA network. Through
experiments on two large-scale GNSS tracking datasets, we demonstrate that the
proposed model outperforms other state-of-the-art prediction models, and reveal
the contribution of various spatio-temporal contexts to the model's
performance. Moreover, we find that the model trained on population data
achieves higher prediction performance with fewer parameters than
individual-level models due to learning from collective movement patterns. We
also reveal mobility conducted in the recent past and one week before has the
largest influence on the current prediction, showing that learning from a
subset of the historical mobility is sufficient to obtain an accurate location
prediction result. We believe that the proposed model is vital for
context-aware mobility prediction. The gained insights will help to understand
location prediction models and promote their implementation for mobility
applications.Comment: updated Discussion section; accepted by Transportation Research Part
- …