6,017 research outputs found
Post-training discriminative pruning for RBMs
One of the major challenges in the area of artificial neural networks is the identification of a suitable architecture for a specific problem. Choosing an unsuitable topology can exponentially increase the training cost, and even hinder network convergence. On the other hand, recent research indicates that larger or deeper nets can map the problem features into a more appropriate space, and thereby improve the classification process, thus leading to an apparent dichotomy. In this regard, it is interesting to inquire whether independent measures, such as mutual information, could provide a clue to finding the most discriminative neurons in a network. In the present work we explore this question in the context of Restricted Boltzmann Machines, by employing different measures to realize post-training pruning. The neurons which are determined by each measure to be the most discriminative, are combined and a classifier is applied to the ensuing network to determine its usefulness. We find that two measures in particular seem to be good indicators of the most discriminative neurons, producing savings of generally more than 50% of the neurons, while maintaining an acceptable error rate. Further, it is borne out that starting with a larger network architecture and then pruning is more advantageous than using a smaller network to begin with. Finally, a quantitative index is introduced which can provide information on choosing a suitable pruned network.Fil: Sánchez Gutiérrez, Máximo. Universidad Autónoma Metropolitana; MéxicoFil: Albornoz, Enrique Marcelo. Consejo Nacional de Investigaciones CientÃficas y Técnicas. Centro CientÃfico Tecnológico Conicet - Santa Fe. Instituto de Investigación en Señales, Sistemas e Inteligencia Computacional. Universidad Nacional del Litoral. Facultad de IngenierÃa y Ciencias HÃdricas. Instituto de Investigación en Señales, Sistemas e Inteligencia Computacional; ArgentinaFil: Rufiner, Hugo Leonardo. Consejo Nacional de Investigaciones CientÃficas y Técnicas. Centro CientÃfico Tecnológico Conicet - Santa Fe. Instituto de Investigación en Señales, Sistemas e Inteligencia Computacional. Universidad Nacional del Litoral. Facultad de IngenierÃa y Ciencias HÃdricas. Instituto de Investigación en Señales, Sistemas e Inteligencia Computacional; Argentina. Universidad Nacional de Entre RÃos; ArgentinaFil: Close, John Goddard. Universidad Autónoma Metropolitana; Méxic
A Likelihood-Ratio Based Forensic Voice Comparison in Standard Thai
This research uses a likelihood ratio (LR) framework to assess
the discriminatory power of a range of acoustic parameters
extracted from speech samples produced by male speakers of
Standard Thai. The thesis aims to answer two main questions: 1)
to what extent the tested linguistic-phonetic segments of
Standard Thai perform in forensic voice comparison (FVC); and 2)
how such linguistic-phonetic segments are profitably combined
through logistic regression using the FoCal Toolkit (Brümmer,
2007). The segments focused on in this study are the four
consonants /s, ʨh, n, m/ and the two diphthongs [ɔi, ai].
First of all, using the alveolar fricative /s/, two different
sets of features were compared in terms of their performance in
FVC. The first comprised the spectrum-based distributional
features of four spectral moments, namely mean, variance, skew
and kurtosis; the second consisted of the coefficients of the
Discrete Cosine Transform (DCTs) applied to a spectrum. As DCTs
were found to perform better, they were subsequently used to
model the consonant spectrum of the remaining consonants. The
consonant spectrum was extracted at the center point of the /s,
ʨh, n, m/ consonants with a Hamming window of 31.25 msec.
For the diphthongs [ɔi] - [nɔi L] and [ai] - [mai HL], the
cubic polynomials fitted to the F2 and F1-F3 formants were tested
separately. The quadratic polynomials fitted to the tonal F0
contours of [ɔi] - [nɔi L] and [ai] - [mai HL] were tested as
well. Long-term F0 distribution (LTF0) was also trialed.
The results show the promising discriminatory power of the
Standard Thai acoustic features and segments tested in this
thesis. The main findings are as follows.
1. The fricative /s/ performed better with the DCTs (Cllr = 0.70)
than with the spectral moments (Cllr = 0.92).
2. The nasals /n, m/ (Cllr = 0.47) performed better than the
affricate /tɕh/ (Cllr = 0.54) and the fricative /s/ (Cllr =
0.70) when their DCT coefficients were parameterized.
3. F1-F3 trajectories (Cllr = 0.42 and Cllr = 0.49) outperformed
F2 trajectory (Cllr = 0.69 and Cllr = 0.67) for both diphthongs
[ɔi] and [ai].
4. F1-F3 trajectories of the diphthong [ɔi] (Cllr = 0.42)
outperformed those of [ai] (Cllr = 0.49).
5. Tonal F0 (Cllr = 0.52) outperformed LTF0 (Cllr = 0.74).
6. Overall, better results were obtained when DCTs of /n/ - [na:
HL] and /n/ - [nɔi L] were fused. (Cllr = 0.40 with the largest
consistent-with-fact SSLog10LR = 2.53).
In light of the findings, we can conclude that Standard Thai is
generally amenable to FVC, especially when linguistic-phonetic
segments are being combined; it is recommended that the latter
procedure be followed when dealing with forensically realistic
casework
Store Working Memory Networks for Storage and Recall of Arbitrary Temporal Sequences
Neural network models of working memory, called Sustained Temporal Order REcurrent (STORE) models, are described. They encode the invariant temporal order of sequential events in short term memory (STM) in a way that mimics cognitive data about working memory, including primacy, recency, and bowed order and error gradients. As new items are presented, the pattern of previously stored items is invariant in the sense that, relative activations remain constant through time. This invariant temporal order code enables all possible groupings of sequential events to be stably learned and remembered in real time, even as new events perturb the system. Such a competence is needed to design self-organizing temporal recognition and planning systems in which any subsequence of events may need to be categorized in order to to control and predict future behavior or external events. STORE models show how arbitrary event sequences may be invariantly stored, including repeated events. A preprocessor interacts with the working memory to represent event repeats in spatially separate locations. It is shown why at least two processing levels are needed to invariantly store events presented with variable durations and interstimulus intervals. It is also shown how network parameters control the type and shape of primacy, recency, or bowed temporal order gradients that will be stored.Air Force Office of Scientific Research (90-0128, F49620-92-J-0225); Office of Naval Research (N00014-91-J-4100, N00014-92-J-1309); British Petroleum (89A-1204); Advanced Research Projects Agency (90-0083, N00014-92-J-4015); National Science Foundation (IRI-90-00539
Methods for Analysing Endothelial Cell Shape and Behaviour in Relation to the Focal Nature of Atherosclerosis
The aim of this thesis is to develop automated methods for the analysis of the
spatial patterns, and the functional behaviour of endothelial cells, viewed under
microscopy, with applications to the understanding of atherosclerosis.
Initially, a radial search approach to segmentation was attempted in order to
trace the cell and nuclei boundaries using a maximum likelihood algorithm; it
was found inadequate to detect the weak cell boundaries present in the available
data. A parametric cell shape model was then introduced to fit an equivalent
ellipse to the cell boundary by matching phase-invariant orientation fields of the
image and a candidate cell shape. This approach succeeded on good quality
images, but failed on images with weak cell boundaries. Finally, a support
vector machines based method, relying on a rich set of visual features, and a
small but high quality training dataset, was found to work well on large numbers
of cells even in the presence of strong intensity variations and imaging noise.
Using the segmentation results, several standard shear-stress dependent parameters
of cell morphology were studied, and evidence for similar behaviour
in some cell shape parameters was obtained in in-vivo cells and their nuclei.
Nuclear and cell orientations around immature and mature aortas were broadly
similar, suggesting that the pattern of flow direction near the wall stayed approximately
constant with age. The relation was less strong for the cell and
nuclear length-to-width ratios.
Two novel shape analysis approaches were attempted to find other properties
of cell shape which could be used to annotate or characterise patterns, since a
wide variability in cell and nuclear shapes was observed which did not appear
to fit the standard parameterisations. Although no firm conclusions can yet be
drawn, the work lays the foundation for future studies of cell morphology.
To draw inferences about patterns in the functional response of cells to flow,
which may play a role in the progression of disease, single-cell analysis was performed
using calcium sensitive florescence probes. Calcium transient rates were
found to change with flow, but more importantly, local patterns of synchronisation
in multi-cellular groups were discernable and appear to change with flow.
The patterns suggest a new functional mechanism in flow-mediation of cell-cell
calcium signalling
Polyfolds: A First and Second Look
Polyfold theory was developed by Hofer-Wysocki-Zehnder by finding
commonalities in the analytic framework for a variety of geometric elliptic
PDEs, in particular moduli spaces of pseudoholomorphic curves. It aims to
systematically address the common difficulties of compactification and
transversality with a new notion of smoothness on Banach spaces, new local
models for differential geometry, and a nonlinear Fredholm theory in the new
context. We shine meta-mathematical light on the bigger picture and core ideas
of this theory. In addition, we compiled and condensed the core definitions and
theorems of polyfold theory into a streamlined exposition, and outline their
application at the example of Morse theory.Comment: 62 pages, 2 figures. Example 2.1.3 has been modified. Final version,
to appear in the EMS Surv. Math. Sc
- …