4,798 research outputs found
Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees
Deep Reinforcement Learning (DRL) has achieved impressive success in many
applications. A key component of many DRL models is a neural network
representing a Q function, to estimate the expected cumulative reward following
a state-action pair. The Q function neural network contains a lot of implicit
knowledge about the RL problems, but often remains unexamined and
uninterpreted. To our knowledge, this work develops the first mimic learning
framework for Q functions in DRL. We introduce Linear Model U-trees (LMUTs) to
approximate neural network predictions. An LMUT is learned using a novel
on-line algorithm that is well-suited for an active play setting, where the
mimic learner observes an ongoing interaction between the neural net and the
environment. Empirical evaluation shows that an LMUT mimics a Q function
substantially better than five baseline methods. The transparent tree structure
of an LMUT facilitates understanding the network's learned knowledge by
analyzing feature influence, extracting rules, and highlighting the
super-pixels in image inputs.Comment: This paper is accepted by ECML-PKDD 201
Microminiaturized, biopotential conditioning system (MBCS)
Multichannel, medical monitoring system allows almost complete freedom of movement for subject during monitoring periods. System comprises monitoring unit (biobelt), transmission line, and data acquisition unit. Belt, made of polybenzimidizole fabric, is wrapped around individual's waist and held in place by overlapping sections of Velcro closure material
Australian Aboriginal perspectives of attention deficit hyperactivity disorder
[Extract] The diagnosis of attention deficit hyperactivity disorder (ADHD) has been based on a western concept of health, a concern when considering a non-western culture such as Australian Aboriginal and Torres Strait Islander peoples. The lack of statistical data on the extent of ADHD in the Aboriginal community is another concern, a situation similar to many other mental health problems in the Indigenous population. Furthermore, no Australian studies have mentioned specific information on the prevalence of ADHD in Aboriginal communities. The WA Aboriginal Child Health Survey, however, reported that Aboriginal children had a higher risk of hyperactivity problems (15.8%) when compared to 9.7% for non-Aboriginal children (Zubrick et al., 2005)
Theory of monolayers with boundaries: Exact results and Perturbative analysis
Domains and bubbles in tilted phases of Langmuir monolayers contain a class
of textures knows as boojums. The boundaries of such domains and bubbles may
display either cusp-like features or indentations. We derive analytic
expressions for the textures within domains and surrounding bubbles, and for
the shapes of the boundaries of these regions. The derivation is perturbative
in the deviation of the bounding curve from a circle. This method is not
expected to be accurate when the boundary suffers large distortions, but it
does provide important clues with regard to the influence of various energetic
terms on the order-parameter texture and the shape of the domain or bubble
bounding curve. We also look into the effects of thermal fluctuations, which
include a sample-size-dependent effective line tension.Comment: replaced with published version, 21 pages, 16 figures include
A Constrained Path Quantum Monte Carlo Method for Fermion Ground States
We propose a new quantum Monte Carlo algorithm to compute fermion
ground-state properties. The ground state is projected from an initial
wavefunction by a branching random walk in an over-complete basis space of
Slater determinants. By constraining the determinants according to a trial
wavefunction , we remove the exponential decay of
signal-to-noise ratio characteristic of the sign problem. The method is
variational and is exact if is exact. We report results on the
two-dimensional Hubbard model up to size , for various electron
fillings and interaction strengths.Comment: uuencoded compressed postscript file. 5 pages with 1 figure. accepted
by PRL
Characterisation of alpha-dystrobrevin in muscle
Dystrophin-related and associated proteins are important for the formation and maintenance of the mammalian neuromuscular junction. Initial studies in the electric organ of Torpedo californica showed that the dystrophin-related protein dystrobrevin (87K) co-purifies with the acetylcholine receptors and other postsynaptic proteins. Dystrobrevin is also a major phosphotyrosine-containing protein in the postsynaptic membrane. Since inhibitors of tyrosine protein phosphorylation block acetylcholine receptor clustering in cultured muscle cells, we examined the role of alpha-dystrobrevin during synapse formation and in response to agrin. Using specific antibodies, we show that C2 myoblasts and early myotubes only produce alpha-dystrobrevin-1, the mammalian orthologue of Torpedo dystrobrevin, whereas mature skeletal muscle expresses three distinct alpha-dystrobrevin isoforms. In myotubes, alpha-dystrobrevin-1 is found on the cell surface and also in acetylcholine receptor-rich domains. Following agrin stimulation, alpha-dystrobrevin-1 becomes re-localised beneath the cell surface into macroclusters that contain acetylcholine receptors and another dystrophin-related protein, utrophin. This redistribution is not associated with tyrosine phosphorylation of alpha-dystrobrevin-1 by agrin. Furthermore, we show that alpha-dystrobrevin-1 is associated with both utrophin in C2 cells and dystrophin in mature skeletal muscle. Thus alpha-dystrobrevin-1 is a component of two protein complexes in muscle, one with utrophin at the neuromuscular junction and the other with dystrophin at the sarcolemma. These results indicate that alpha-dystrobrevin-1 is not involved in the phosphorylation-dependent, early stages of receptor clustering, but rather in the stabilisation and maturation of clusters, possibly via an interaction with utrophin
Cryptotomography: reconstructing 3D Fourier intensities from randomly oriented single-shot diffraction patterns
We reconstructed the 3D Fourier intensity distribution of mono-disperse
prolate nano-particles using single-shot 2D coherent diffraction patterns
collected at DESY's FLASH facility when a bright, coherent, ultrafast X-ray
pulse intercepted individual particles of random, unmeasured orientations. This
first experimental demonstration of cryptotomography extended the
Expansion-Maximization-Compression (EMC) framework to accommodate unmeasured
fluctuations in photon fluence and loss of data due to saturation or background
scatter. This work is an important step towards realizing single-shot
diffraction imaging of single biomolecules.Comment: 4 pages, 4 figure
Temperature Derivative of the Superfluid Density in the Attractive Hubbard model
Based on extensions of the grand-canonical Quantum Monte-Carlo algorithm to
incorporate magnetic fields, we provide numerical data confirming the existence
of a Kosterlitz-Thouless transition in the attractive Hubbard model. Here, we
calculate the temperature derivative of the superfluid density, to pin down the
transition. Away from half-band filling, the above quantity, shows a response
which increases with lattice size at the transition temperature. In contrast,
such a signal is not observed for the case of a half-band filling.Comment: Latex 8 pages, 3 figures (in postscript format) appendded at the end
of the fil
The Red-Sequence Luminosity Function in Galaxy Clusters since z~1
We use a statistical sample of ~500 rich clusters taken from 72 square
degrees of the Red-Sequence Cluster Survey (RCS-1) to study the evolution of
~30,000 red-sequence galaxies in clusters over the redshift range 0.35<z<0.95.
We construct red-sequence luminosity functions (RSLFs) for a well-defined,
homogeneously selected, richness limited sample. The RSLF at higher redshifts
shows a deficit of faint red galaxies (to M_V=> -19.7) with their numbers
increasing towards the present epoch. This is consistent with the `down-sizing`
picture in which star-formation ended at earlier times for the most massive
(luminous) galaxies and more recently for less massive (fainter) galaxies. We
observe a richness dependence to the down-sizing effect in the sense that, at a
given redshift, the drop-off of faint red galaxies is greater for poorer (less
massive) clusters, suggesting that star-formation ended earlier for galaxies in
more massive clusters. The decrease in faint red-sequence galaxies is
accompanied by an increase in faint blue galaxies, implying that the process
responsible for this evolution of faint galaxies is the termination of
star-formation, possibly with little or no need for merging. At the bright end,
we also see an increase in the number of blue galaxies with increasing
redshift, suggesting that termination of star-formation in higher mass galaxies
may also be an important formation mechanism for higher mass ellipticals. By
comparing with a low-redshift Abell Cluster sample, we find that the
down-sizing trend seen within RCS-1 has continued to the local universe.Comment: ApJ accepted. 11 pages, 5 figure
- …