157,987 research outputs found
Transfer learning for radio galaxy classification
In the context of radio galaxy classification, most state-of-the-art neural
network algorithms have been focused on single survey data. The question of
whether these trained algorithms have cross-survey identification ability or
can be adapted to develop classification networks for future surveys is still
unclear. One possible solution to address this issue is transfer learning,
which re-uses elements of existing machine learning models for different
applications. Here we present radio galaxy classification based on a 13-layer
Deep Convolutional Neural Network (DCNN) using transfer learning methods
between different radio surveys. We find that our machine learning models
trained from a random initialization achieve accuracies comparable to those
found elsewhere in the literature. When using transfer learning methods, we
find that inheriting model weights pre-trained on FIRST images can boost model
performance when re-training on lower resolution NVSS data, but that inheriting
pre-trained model weights from NVSS and re-training on FIRST data impairs the
performance of the classifier. We consider the implication of these results in
the context of future radio surveys planned for next-generation radio
telescopes such as ASKAP, MeerKAT, and SKA1-MID
Neural Distributed Autoassociative Memories: A Survey
Introduction. Neural network models of autoassociative, distributed memory
allow storage and retrieval of many items (vectors) where the number of stored
items can exceed the vector dimension (the number of neurons in the network).
This opens the possibility of a sublinear time search (in the number of stored
items) for approximate nearest neighbors among vectors of high dimension. The
purpose of this paper is to review models of autoassociative, distributed
memory that can be naturally implemented by neural networks (mainly with local
learning rules and iterative dynamics based on information locally available to
neurons). Scope. The survey is focused mainly on the networks of Hopfield,
Willshaw and Potts, that have connections between pairs of neurons and operate
on sparse binary vectors. We discuss not only autoassociative memory, but also
the generalization properties of these networks. We also consider neural
networks with higher-order connections and networks with a bipartite graph
structure for non-binary data with linear constraints. Conclusions. In
conclusion we discuss the relations to similarity search, advantages and
drawbacks of these techniques, and topics for further research. An interesting
and still not completely resolved question is whether neural autoassociative
memories can search for approximate nearest neighbors faster than other index
structures for similarity search, in particular for the case of very high
dimensional vectors.Comment: 31 page
Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey
Dynamic networks are used in a wide range of fields, including social network
analysis, recommender systems, and epidemiology. Representing complex networks
as structures changing over time allow network models to leverage not only
structural but also temporal patterns. However, as dynamic network literature
stems from diverse fields and makes use of inconsistent terminology, it is
challenging to navigate. Meanwhile, graph neural networks (GNNs) have gained a
lot of attention in recent years for their ability to perform well on a range
of network science tasks, such as link prediction and node classification.
Despite the popularity of graph neural networks and the proven benefits of
dynamic network models, there has been little focus on graph neural networks
for dynamic networks. To address the challenges resulting from the fact that
this research crosses diverse fields as well as to survey dynamic graph neural
networks, this work is split into two main parts. First, to address the
ambiguity of the dynamic network terminology we establish a foundation of
dynamic networks with consistent, detailed terminology and notation. Second, we
present a comprehensive survey of dynamic graph neural network models using the
proposed terminologyComment: 28 pages, 9 figures, 8 table
- …