20 research outputs found
A Determinantal Point Process Latent Variable Model for Inhibition in Neural Spiking Data
Point processes are popular models of neural spiking behavior as they provide a statistical distribution over temporal sequences of spikes and help to reveal the complexities underlying a series of recorded action potentials. However, the most common neural point process models, the Poisson process and the gamma renewal process, do not capture interactions and correlations that are critical to modeling populations of neurons. We develop a novel model based on a determinantal point process over latent embeddings of neurons that effectively captures and helps visualize complex inhibitory and competitive interaction. We show that this model is a natural extension of the popular generalized linear model to sets of interacting neurons. The model is extended to incorporate gain control or divisive normalization, and the modulation of neural spiking based on periodic phenomena. Applied to neural spike recordings from the rat hippocampus, we see that the model captures inhibitory relationships, a dichotomy of classes of neurons, and a periodic modulation by the theta rhythm known to be present in the data.Engineering and Applied Science
Query-Focused Video Summarization: Dataset, Evaluation, and A Memory Network Based Approach
Recent years have witnessed a resurgence of interest in video summarization.
However, one of the main obstacles to the research on video summarization is
the user subjectivity - users have various preferences over the summaries. The
subjectiveness causes at least two problems. First, no single video summarizer
fits all users unless it interacts with and adapts to the individual users.
Second, it is very challenging to evaluate the performance of a video
summarizer.
To tackle the first problem, we explore the recently proposed query-focused
video summarization which introduces user preferences in the form of text
queries about the video into the summarization process. We propose a memory
network parameterized sequential determinantal point process in order to attend
the user query onto different video frames and shots. To address the second
challenge, we contend that a good evaluation metric for video summarization
should focus on the semantic information that humans can perceive rather than
the visual features or temporal overlaps. To this end, we collect dense
per-video-shot concept annotations, compile a new dataset, and suggest an
efficient evaluation method defined upon the concept annotations. We conduct
extensive experiments contrasting our video summarizer to existing ones and
present detailed analyses about the dataset and the new evaluation method
Graph Convolutional Neural Networks with Diverse Negative Samples via Decomposed Determinant Point Processes
Graph convolutional networks (GCNs) have achieved great success in graph
representation learning by extracting high-level features from nodes and their
topology. Since GCNs generally follow a message-passing mechanism, each node
aggregates information from its first-order neighbour to update its
representation. As a result, the representations of nodes with edges between
them should be positively correlated and thus can be considered positive
samples. However, there are more non-neighbour nodes in the whole graph, which
provide diverse and useful information for the representation update. Two
non-adjacent nodes usually have different representations, which can be seen as
negative samples. Besides the node representations, the structural information
of the graph is also crucial for learning. In this paper, we used
quality-diversity decomposition in determinant point processes (DPP) to obtain
diverse negative samples. When defining a distribution on diverse subsets of
all non-neighbouring nodes, we incorporate both graph structure information and
node representations. Since the DPP sampling process requires matrix eigenvalue
decomposition, we propose a new shortest-path-base method to improve
computational efficiency. Finally, we incorporate the obtained negative samples
into the graph convolution operation. The ideas are evaluated empirically in
experiments on node classification tasks. These experiments show that the newly
proposed methods not only improve the overall performance of standard
representation learning but also significantly alleviate over-smoothing
problems.Comment: Accepted by IEEE TNNLS on 30-Aug-2023. arXiv admin note: text overlap
with arXiv:2210.0072