Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees

Deep Reinforcement Learning (DRL) has achieved impressive success in many applications. A key component of many DRL models is a neural network representing a Q function, to estimate the expected cumulative reward following a state-action pair. The Q function neural network contains a lot of implicit knowledge about the RL problems, but often remains unexamined and uninterpreted. To our knowledge, this work develops the first mimic learning framework for Q functions in DRL. We introduce Linear Model U-trees (LMUTs) to approximate neural network predictions. An LMUT is learned using a novel on-line algorithm that is well-suited for an active play setting, where the mimic learner observes an ongoing interaction between the neural net and the environment. Empirical evaluation shows that an LMUT mimics a Q function substantially better than five baseline methods. The transparent tree structure of an LMUT facilitates understanding the network's learned knowledge by analyzing feature influence, extracting rules, and highlighting the super-pixels in image inputs.Comment: This paper is accepted by ECML-PKDD 201

Microminiaturized, biopotential conditioning system (MBCS)

Multichannel, medical monitoring system allows almost complete freedom of movement for subject during monitoring periods. System comprises monitoring unit (biobelt), transmission line, and data acquisition unit. Belt, made of polybenzimidizole fabric, is wrapped around individual's waist and held in place by overlapping sections of Velcro closure material

Australian Aboriginal perspectives of attention deficit hyperactivity disorder

[Extract] The diagnosis of attention deficit hyperactivity disorder (ADHD) has been based on a western concept of health, a concern when considering a non-western culture such as Australian Aboriginal and Torres Strait Islander peoples. The lack of statistical data on the extent of ADHD in the Aboriginal community is another concern, a situation similar to many other mental health problems in the Indigenous population. Furthermore, no Australian studies have mentioned specific information on the prevalence of ADHD in Aboriginal communities. The WA Aboriginal Child Health Survey, however, reported that Aboriginal children had a higher risk of hyperactivity problems (15.8%) when compared to 9.7% for non-Aboriginal children (Zubrick et al., 2005)

Theory of monolayers with boundaries: Exact results and Perturbative analysis

Domains and bubbles in tilted phases of Langmuir monolayers contain a class of textures knows as boojums. The boundaries of such domains and bubbles may display either cusp-like features or indentations. We derive analytic expressions for the textures within domains and surrounding bubbles, and for the shapes of the boundaries of these regions. The derivation is perturbative in the deviation of the bounding curve from a circle. This method is not expected to be accurate when the boundary suffers large distortions, but it does provide important clues with regard to the influence of various energetic terms on the order-parameter texture and the shape of the domain or bubble bounding curve. We also look into the effects of thermal fluctuations, which include a sample-size-dependent effective line tension.Comment: replaced with published version, 21 pages, 16 figures include

A Constrained Path Quantum Monte Carlo Method for Fermion Ground States

We propose a new quantum Monte Carlo algorithm to compute fermion ground-state properties. The ground state is projected from an initial wavefunction by a branching random walk in an over-complete basis space of Slater determinants. By constraining the determinants according to a trial wavefunction $|\Psi_T \rangle$, we remove the exponential decay of signal-to-noise ratio characteristic of the sign problem. The method is variational and is exact if $|\Psi_T\rangle$ is exact. We report results on the two-dimensional Hubbard model up to size $16\times 16$, for various electron fillings and interaction strengths.Comment: uuencoded compressed postscript file. 5 pages with 1 figure. accepted by PRL

Characterisation of alpha-dystrobrevin in muscle

Dystrophin-related and associated proteins are important for the formation and maintenance of the mammalian neuromuscular junction. Initial studies in the electric organ of Torpedo californica showed that the dystrophin-related protein dystrobrevin (87K) co-purifies with the acetylcholine receptors and other postsynaptic proteins. Dystrobrevin is also a major phosphotyrosine-containing protein in the postsynaptic membrane. Since inhibitors of tyrosine protein phosphorylation block acetylcholine receptor clustering in cultured muscle cells, we examined the role of alpha-dystrobrevin during synapse formation and in response to agrin. Using specific antibodies, we show that C2 myoblasts and early myotubes only produce alpha-dystrobrevin-1, the mammalian orthologue of Torpedo dystrobrevin, whereas mature skeletal muscle expresses three distinct alpha-dystrobrevin isoforms. In myotubes, alpha-dystrobrevin-1 is found on the cell surface and also in acetylcholine receptor-rich domains. Following agrin stimulation, alpha-dystrobrevin-1 becomes re-localised beneath the cell surface into macroclusters that contain acetylcholine receptors and another dystrophin-related protein, utrophin. This redistribution is not associated with tyrosine phosphorylation of alpha-dystrobrevin-1 by agrin. Furthermore, we show that alpha-dystrobrevin-1 is associated with both utrophin in C2 cells and dystrophin in mature skeletal muscle. Thus alpha-dystrobrevin-1 is a component of two protein complexes in muscle, one with utrophin at the neuromuscular junction and the other with dystrophin at the sarcolemma. These results indicate that alpha-dystrobrevin-1 is not involved in the phosphorylation-dependent, early stages of receptor clustering, but rather in the stabilisation and maturation of clusters, possibly via an interaction with utrophin

Cryptotomography: reconstructing 3D Fourier intensities from randomly oriented single-shot diffraction patterns

We reconstructed the 3D Fourier intensity distribution of mono-disperse prolate nano-particles using single-shot 2D coherent diffraction patterns collected at DESY's FLASH facility when a bright, coherent, ultrafast X-ray pulse intercepted individual particles of random, unmeasured orientations. This first experimental demonstration of cryptotomography extended the Expansion-Maximization-Compression (EMC) framework to accommodate unmeasured fluctuations in photon fluence and loss of data due to saturation or background scatter. This work is an important step towards realizing single-shot diffraction imaging of single biomolecules.Comment: 4 pages, 4 figure

Temperature Derivative of the Superfluid Density in the Attractive Hubbard model

Based on extensions of the grand-canonical Quantum Monte-Carlo algorithm to incorporate magnetic fields, we provide numerical data confirming the existence of a Kosterlitz-Thouless transition in the attractive Hubbard model. Here, we calculate the temperature derivative of the superfluid density, to pin down the transition. Away from half-band filling, the above quantity, shows a response which increases with lattice size at the transition temperature. In contrast, such a signal is not observed for the case of a half-band filling.Comment: Latex 8 pages, 3 figures (in postscript format) appendded at the end of the fil

The Red-Sequence Luminosity Function in Galaxy Clusters since z~1

We use a statistical sample of ~500 rich clusters taken from 72 square degrees of the Red-Sequence Cluster Survey (RCS-1) to study the evolution of ~30,000 red-sequence galaxies in clusters over the redshift range 0.35<z<0.95. We construct red-sequence luminosity functions (RSLFs) for a well-defined, homogeneously selected, richness limited sample. The RSLF at higher redshifts shows a deficit of faint red galaxies (to M_V=> -19.7) with their numbers increasing towards the present epoch. This is consistent with the `down-sizing` picture in which star-formation ended at earlier times for the most massive (luminous) galaxies and more recently for less massive (fainter) galaxies. We observe a richness dependence to the down-sizing effect in the sense that, at a given redshift, the drop-off of faint red galaxies is greater for poorer (less massive) clusters, suggesting that star-formation ended earlier for galaxies in more massive clusters. The decrease in faint red-sequence galaxies is accompanied by an increase in faint blue galaxies, implying that the process responsible for this evolution of faint galaxies is the termination of star-formation, possibly with little or no need for merging. At the bright end, we also see an increase in the number of blue galaxies with increasing redshift, suggesting that termination of star-formation in higher mass galaxies may also be an important formation mechanism for higher mass ellipticals. By comparing with a low-redshift Abell Cluster sample, we find that the down-sizing trend seen within RCS-1 has continued to the local universe.Comment: ApJ accepted. 11 pages, 5 figure