Crawling in Rogue's dungeons with (partitioned) A3C

Rogue is a famous dungeon-crawling video-game of the 80ies, the ancestor of its gender. Rogue-like games are known for the necessity to explore partially observable and always different randomly-generated labyrinths, preventing any form of level replay. As such, they serve as a very natural and challenging task for reinforcement learning, requiring the acquisition of complex, non-reactive behaviors involving memory and planning. In this article we show how, exploiting a version of A3C partitioned on different situations, the agent is able to reach the stairs and descend to the next level in 98% of cases.Comment: Accepted at the Fourth International Conference on Machine Learning, Optimization, and Data Science (LOD 2018

Soft eSkin:distributed touch sensing with harmonized energy and computing

Inspired by biology, significant advances have been made in the field of electronic skin (eSkin) or tactile skin. Many of these advances have come through mimicking the morphology of human skin and by distributing few touch sensors in an area. However, the complexity of human skin goes beyond mimicking few morphological features or using few sensors. For example, embedded computing (e.g. processing of tactile data at the point of contact) is centric to the human skin as some neuroscience studies show. Likewise, distributed cell or molecular energy is a key feature of human skin. The eSkin with such features, along with distributed and embedded sensors/electronics on soft substrates, is an interesting topic to explore. These features also make eSkin significantly different from conventional computing. For example, unlike conventional centralized computing enabled by miniaturized chips, the eSkin could be seen as a flexible and wearable large area computer with distributed sensors and harmonized energy. This paper discusses these advanced features in eSkin, particularly the distributed sensing harmoniously integrated with energy harvesters, storage devices and distributed computing to read and locally process the tactile sensory data. Rapid advances in neuromorphic hardware, flexible energy generation, energy-conscious electronics, flexible and printed electronics are also discussed. This article is part of the theme issue ‘Harmonizing energy-autonomous computing and intelligence’

Suppression of field-induced spin density wave order in Sr_{3}Ru_{2}O_{7} with pressure

Measuring the resistivity of high-purity single crystals of Sr_{3}Ru_{2}O_{7} under pressure, we find strong evidence that the field-induced spin density wave phase at the H ∥ c metamagnetic transition is suppressed at a surprisingly low pressure of ∼ 3 ± 1 kbar. This offers the possibility of studying a bare quasi-two-dimensional spin density wave quantum critical point, testing the T → 0 K limit of theories of Planckian dissipation and quantum criticality. Preliminary attempts to fit ρ(T) with a quantum critical spin fluctuation model, while encouraging, reveal a need for further, complementary measurements

VLSI Architectures for the Steerable-Discrete-Cosine-Transform (SDCT)

Since frame resolution of modern video streams is rapidly growing, the need for more complex and efficient video compression methods arises. H.265/HEVC represents the state of the art in video coding standard. Its architecture is however not completely standardized, as many parts are only described at software level to allow the designer to implement new compression techniques. This paper presents an innovative hardware architecture for the Steerable Discrete Cosine Transform (SDCT), which has been recently embedded into the HEVC standard, providing better compression ratios. Such technique exploits directional DCT using basis having different orientation angles, leading to a sparser representation which translates to an improved coding efficiency. The final design is able to work at a frequency of 188 MHZ, reaching a throughput of 3.00 GSample/s. In particular, this architecture supports 8k UltraHigh Definition (UHD) (7680 × 4320) with a frame rate of 60 Hz, which is one of the best resolutions supported by HEVC

Bidirectional signaling of neuregulin-2 mediates formation of GABAergic synapses and maturation of glutamatergic synapses in newborn granule cells of postnatal hippocampus

Expression of neuregulin-2 (NRG2) is intense in a few regions of the adult brain where neurogenesis persists; however, little is understood about its role in developments of newborn neurons. To study the role of NRG2 in synaptogenesis at different developmental stages, newborn granule cells in rat hippocampal slice cultures were labeled with retrovirus encoding tetracycline-inducible microRNA targeting NRG2 and treated with doxycycline (Dox) at the fourth or seventh postinfection day (dpi). The developmental increase of GABAergic postsynaptic currents (GPSCs) was suppressed by the early Dox treatment (4 dpi), but not by late treatment (7 dpi). The late Dox treatment was used to study the effect of NRG2 depletion specific to excitatory synaptogenesis. The Dox effect on EPSCs emerged 4 d after the impairment in dendritic outgrowth became evident (10 dpi). Notably, Dox treatment abolished the developmental increases of AMPA-receptor mediated EPSCs and the AMPA/NMDA ratio, indicating impaired maturation of glutamatergic synapses. In contrast to GPSCs, Dox effects on EPSCs and dendritic growth were independent of ErbB4 and rescued by concurrent overexpression of NRG2 intracellular domain. These results suggest that forward signaling of NRG2 mediates GABAergic synaptogenesis and its reverse signaling contributes to dendritic outgrowth and maturation of glutamatergic synapses.117Ysciescopu

Machine-learning-enhanced time-of-flight mass spectrometry analysis

Mass spectrometry is a widespread approach used to work out what the constituents of a material are. Atoms and molecules are removed from the material and collected, and subsequently, a critical step is to infer their correct identities based on patterns formed in their mass-to-charge ratios and relative isotopic abundances. However, this identification step still mainly relies on individual users' expertise, making its standardization challenging, and hindering efficient data processing. Here, we introduce an approach that leverages modern machine learning technique to identify peak patterns in time-of-flight mass spectra within microseconds, outperforming human users without loss of accuracy. Our approach is cross-validated on mass spectra generated from different time-of-flight mass spectrometry (ToF-MS) techniques, offering the ToF-MS community an open-source, intelligent mass spectra analysis

A random cell motility gradient downstream of FGF controls elongation of amniote embryos

Vertebrate embryos are characterized by an elongated antero-posterior (AP) body axis, which forms by progressive cell deposition from a posterior growth zone in the embryo. Here, we used tissue ablation in the chicken embryo to demonstrate that the caudal presomitic mesoderm (PSM) has a key role in axis elongation. Using time-lapse microscopy, we analysed the movements of fluorescently labelled cells in the PSM during embryo elongation, which revealed a clear posterior-to-anterior gradient of cell motility and directionality in the PSM. We tracked the movement of the PSM extracellular matrix in parallel with the labelled cells and subtracted the extracellular matrix movement from the global motion of cells. After subtraction, cell motility remained graded but lacked directionality, indicating that the posterior cell movements associated with axis elongation in the PSM are not intrinsic but reflect tissue deformation. The gradient of cell motion along the PSM parallels the fibroblast growth factor (FGF)/mitogen-activated protein kinase (MAPK) gradient1, which has been implicated in the control of cell motility in this tissue2. Both FGF signalling gain- and loss-of-function experiments lead to disruption of the motility gradient and a slowing down of axis elongation. Furthermore, embryos treated with cell movement inhibitors (blebbistatin or RhoK inhibitor), but not cell cycle inhibitors, show a slower axis elongation rate. We propose that the gradient of random cell motility downstream of FGF signalling in the PSM controls posterior elongation in the amniote embryo. Our data indicate that tissue elongation is an emergent property that arises from the collective regulation of graded, random cell motion rather than by the regulation of directionality of individual cellular movements