8,778 research outputs found
Geometric deep learning: going beyond Euclidean data
Many scientific fields study data with an underlying structure that is a
non-Euclidean space. Some examples include social networks in computational
social sciences, sensor networks in communications, functional networks in
brain imaging, regulatory networks in genetics, and meshed surfaces in computer
graphics. In many applications, such geometric data are large and complex (in
the case of social networks, on the scale of billions), and are natural targets
for machine learning techniques. In particular, we would like to use deep
neural networks, which have recently proven to be powerful tools for a broad
range of problems from computer vision, natural language processing, and audio
analysis. However, these tools have been most successful on data with an
underlying Euclidean or grid-like structure, and in cases where the invariances
of these structures are built into networks used to model them. Geometric deep
learning is an umbrella term for emerging techniques attempting to generalize
(structured) deep neural models to non-Euclidean domains such as graphs and
manifolds. The purpose of this paper is to overview different examples of
geometric deep learning problems and present available solutions, key
difficulties, applications, and future research directions in this nascent
field
An Emergent Space for Distributed Data with Hidden Internal Order through Manifold Learning
Manifold-learning techniques are routinely used in mining complex
spatiotemporal data to extract useful, parsimonious data
representations/parametrizations; these are, in turn, useful in nonlinear model
identification tasks. We focus here on the case of time series data that can
ultimately be modelled as a spatially distributed system (e.g. a partial
differential equation, PDE), but where we do not know the space in which this
PDE should be formulated. Hence, even the spatial coordinates for the
distributed system themselves need to be identified - to emerge from - the data
mining process. We will first validate this emergent space reconstruction for
time series sampled without space labels in known PDEs; this brings up the
issue of observability of physical space from temporal observation data, and
the transition from spatially resolved to lumped (order-parameter-based)
representations by tuning the scale of the data mining kernels. We will then
present actual emergent space discovery illustrations. Our illustrative
examples include chimera states (states of coexisting coherent and incoherent
dynamics), and chaotic as well as quasiperiodic spatiotemporal dynamics,
arising in partial differential equations and/or in heterogeneous networks. We
also discuss how data-driven spatial coordinates can be extracted in ways
invariant to the nature of the measuring instrument. Such gauge-invariant data
mining can go beyond the fusion of heterogeneous observations of the same
system, to the possible matching of apparently different systems
Gait Recognition from Motion Capture Data
Gait recognition from motion capture data, as a pattern classification
discipline, can be improved by the use of machine learning. This paper
contributes to the state-of-the-art with a statistical approach for extracting
robust gait features directly from raw data by a modification of Linear
Discriminant Analysis with Maximum Margin Criterion. Experiments on the CMU
MoCap database show that the suggested method outperforms thirteen relevant
methods based on geometric features and a method to learn the features by a
combination of Principal Component Analysis and Linear Discriminant Analysis.
The methods are evaluated in terms of the distribution of biometric templates
in respective feature spaces expressed in a number of class separability
coefficients and classification metrics. Results also indicate a high
portability of learned features, that means, we can learn what aspects of walk
people generally differ in and extract those as general gait features.
Recognizing people without needing group-specific features is convenient as
particular people might not always provide annotated learning data. As a
contribution to reproducible research, our evaluation framework and database
have been made publicly available. This research makes motion capture
technology directly applicable for human recognition.Comment: Preprint. Full paper accepted at the ACM Transactions on Multimedia
Computing, Communications, and Applications (TOMM), special issue on
Representation, Analysis and Recognition of 3D Humans. 18 pages. arXiv admin
note: substantial text overlap with arXiv:1701.00995, arXiv:1609.04392,
arXiv:1609.0693
Move ordering and communities in complex networks describing the game of go
We analyze the game of go from the point of view of complex networks. We
construct three different directed networks of increasing complexity, defining
nodes as local patterns on plaquettes of increasing sizes, and links as actual
successions of these patterns in databases of real games. We discuss the
peculiarities of these networks compared to other types of networks. We explore
the ranking vectors and community structure of the networks and show that this
approach enables to extract groups of moves with common strategic properties.
We also investigate different networks built from games with players of
different levels or from different phases of the game. We discuss how the study
of the community structure of these networks may help to improve the computer
simulations of the game. More generally, we believe such studies may help to
improve the understanding of human decision process.Comment: 14 pages, 21 figure
Hubungan gaya pembelajaran dengan pencapaian akademik pelajar aliran vokasional
Analisis keputusan Sijil Pelajaran Malaysia (SPM) 2011 menunjukkan penurunan
pencapaian bagi Sekolah Menengah Vokasional. Oleh itu, kajian ini dilaksanakan
bertujuan untuk mengkaji hubungan di antara gaya pembelajaran dengan pencapaian
akademik pelajar. Kajian ini juga ingin mengenalpasti gaya pembelajaran paling
dominan yang diamalkan oleh pelajar serta melihat perbezaan gaya pembelajaran
dengan jantina pelajar. Seramai 131 orang Pelajar Tingkatan Empat Kursus
Vokasional Di Sekolah Menengah Vokasional Segamat di Johor telah terlibat dalam
kajian ini. Soal selidik Index of Learning Style (ILS) yang dibangunkan oleh Felder
dan Silverman (1991) yang mengandungi 44 soalan telah digunakan untukh
menjalankan kajian ini. Gaya pembelajaran pelajar dapat dilihat melalui empat
dimensi gaya pembelajaran yang terdiri dari dua sub-skala yang bertentangan iaitu
dimensi pelajar Aktif dan Reflektif, dimensi pelajar Konkrit dan Intuitif, dimensi
pelajar Verbal dan Visual, serta dimensi pelajar Tersusun dan Global. Data yang
diperolehi dianalisis dengan menggunakan perisian Statistical Package for Social
Science for WINDOW release 20.0 (SPSS.20.0). Ujian Korelasi Pearson digunakan
untuk menganalisis data dalam mengkaji hubungan gaya pembelajaran dengan
pencapaian akademik pelajar. Nilai pekali p yang diperolehi di antara gaya
pembelajaran dengan pencapaian pelajar adalah (p=0.1 hingga 0.4). Ini menunjukkan
tidak terdapat hubungan yang signifikan di antara dua pembolehubah tersebut. Kajian
ini juga mendapati bahawa gaya pembelajaran yang menjadi amalan pelajar ialah
gaya pembelajaran Tersusun. Hasil kajian juga mendapati bahawa tidak terdapat
perbezaan yang signifikan di antara gaya pembelajaran dengan jantina pelajar
Blind source separation using temporal predictability
A measure of temporal predictability is defined and used to separate linear mixtures of signals. Given any set of statistically independent source signals, it is conjectured here that a linear mixture of those signals has the following property: the temporal predictability of any signal mixture is less than (or equal to) that of any of its component source signals.
It is shown that this property can be used to recover source signals from a set of linear mixtures of those signals by finding an un-mixing matrix that maximizes a measure of temporal predictability for each recovered signal. This matrix is obtained as the solution to a generalized eigenvalue problem; such problems have scaling characteristics of O (N3), where N is the number of signal mixtures. In contrast to independent component analysis, the temporal predictability method requires minimal assumptions regarding the probability density functions of source signals. It is demonstrated that the method can separate signal mixtures in which each mixture is a linear combination of source signals with supergaussian, sub-gaussian, and gaussian probability density functions and on mixtures of voices and music
DCTNet : A Simple Learning-free Approach for Face Recognition
PCANet was proposed as a lightweight deep learning network that mainly
leverages Principal Component Analysis (PCA) to learn multistage filter banks
followed by binarization and block-wise histograming. PCANet was shown worked
surprisingly well in various image classification tasks. However, PCANet is
data-dependence hence inflexible. In this paper, we proposed a
data-independence network, dubbed DCTNet for face recognition in which we adopt
Discrete Cosine Transform (DCT) as filter banks in place of PCA. This is
motivated by the fact that 2D DCT basis is indeed a good approximation for high
ranked eigenvectors of PCA. Both 2D DCT and PCA resemble a kind of modulated
sine-wave patterns, which can be perceived as a bandpass filter bank. DCTNet is
free from learning as 2D DCT bases can be computed in advance. Besides that, we
also proposed an effective method to regulate the block-wise histogram feature
vector of DCTNet for robustness. It is shown to provide surprising performance
boost when the probe image is considerably different in appearance from the
gallery image. We evaluate the performance of DCTNet extensively on a number of
benchmark face databases and being able to achieve on par with or often better
accuracy performance than PCANet.Comment: APSIPA ASC 201
- …