Discretized Bayesian pursuit – A new scheme for reinforcement learning

The success of Learning Automata (LA)-based estimator algorithms over the classical, Linear Reward-Inaction ( L RI )-like schemes, can be explained by their ability to pursue the actions with the highest reward probability estimates. Without access to reward probability estimates, it makes sense for schemes like the L RI to first make large exploring steps, and then to gradually turn exploration into exploitation by making progressively smaller learning steps. However, this behavior becomes counter-intuitive when pursuing actions based on their estimated reward probabilities. Learning should then ideally proceed in progressively larger steps, as the reward probability estimates turn more accurate. This paper introduces a new estimator algorithm, the Discretized Bayesian Pursuit Algorithm (DBPA), that achieves this. The DBPA is implemented by linearly discretizing the action probability space of the Bayesian Pursuit Algorithm (BPA) [1]. The key innovation is that the linear discrete updating rules mitigate the counter-intuitive behavior of the corresponding linear continuous updating rules, by augmenting them with the reward probability estimates. Extensive experimental results show the superiority of DBPA over previous estimator algorithms. Indeed, the DBPA is probably the fastest reported LA to date

Post-training inactivation of the anterior thalamic nuclei impairs spatial performance on the radial arm maze

The limbic thalamus, specifically the anterior thalamic nuclei (ATN), contains brain signals including that of head direction cells, which fire as a function of an animal\u27s directional orientation in an environment. Recent work has suggested that this directional orientation information stemming from the ATN contributes to the generation of hippocampal and parahippocampal spatial representations, and may contribute to the establishment of unique spatial representations in radially oriented tasks such as the radial arm maze. While previous studies have shown that ATN lesions can impair spatial working memory performance in the radial maze, little work has been done to investigate spatial reference memory in a discrimination task variant. Further, while previous studies have shown that ATN lesions can impair performance in the radial maze, these studies produced the ATN lesions prior to training. It is therefore unclear whether the ATN lesions disrupted acquisition or retention of radial maze performance. Here, we tested the role of ATN signaling in a previously learned spatial discrimination task on a radial arm maze. Rats were first trained to asymptotic levels in a task in which two maze arms were consistently baited across training. After 24 h, animals received muscimol inactivation of the ATN before a 4 trial probe test. We report impairments in post-inactivation trials, suggesting that signals from the ATN modulate the use of a previously acquired spatial discrimination in the radial-arm maze. The results are discussed in relation to the thalamo-cortical limbic circuits involved in spatial information processing, with an emphasis on the head direction signal. © 2017 Harvey, Thompson, Sanchez, Yoder and Clark

The dependence of the EIT wave velocity on the magnetic field strength

"EIT waves" are a wavelike phenomenon propagating in the corona, which were initially observed in the extreme ultraviolet (EUV) wavelength by the EUV Imaging Telescope (EIT). Their nature is still elusive, with the debate between fast-mode wave model and non-wave model. In order to distinguish between these models, we investigate the relation between the EIT wave velocity and the local magnetic field in the corona. It is found that the two parameters show significant negative correlation in most of the EIT wave fronts, {\it i.e.}, EIT wave propagates more slowly in the regions of stronger magnetic field. Such a result poses a big challenge to the fast-mode wave model, which would predict a strong positive correlation between the two parameters. However, it is demonstrated that such a result can be explained by the fieldline stretching model, \emph{i.e.,} that "EIT waves" are apparently-propagating brightenings, which are generated by successive stretching of closed magnetic field lines pushed by the erupting flux rope during coronal mass ejections (CMEs).Comment: 11 pages, 8 figures, accepted for publication in Solar Phy

Recent Developments of NEMO: Detection of Solar Eruptions Characteristics

The recent developments in space instrumentation for solar observations and telemetry have caused the necessity of advanced pattern recognition tools for the different classes of solar events. The Extreme ultraviolet Imaging Telescope (EIT) of solar corona on-board SOHO spacecraft has uncovered a new class of eruptive events which are often identified as signatures of Coronal Mass Ejection (CME) initiations on solar disk. It is evident that a crucial task is the development of an automatic detection tool of CMEs precursors. The Novel EIT wave Machine Observing (NEMO) (http://sidc.be/nemo) code is an operational tool that detects automatically solar eruptions using EIT image sequences. NEMO applies techniques based on the general statistical properties of the underlying physical mechanisms of eruptive events on the solar disc. In this work, the most recent updates of NEMO code - that have resulted to the increase of the recognition efficiency of solar eruptions linked to CMEs - are presented. These updates provide calculations of the surface of the dimming region, implement novel clustering technique for the dimmings and set new criteria to flag the eruptive dimmings based on their complex characteristics. The efficiency of NEMO has been increased significantly resulting to the extraction of dimmings observed near the solar limb and to the detection of small-scale events as well. As a consequence, the detection efficiency of CMEs precursors and the forecasts of CMEs have been drastically improved. Furthermore, the catalogues of solar eruptive events that can be constructed by NEMO may include larger number of physical parameters associated to the dimming regions.Comment: 12 Pages, 5 figures, submitted to Solar Physic

The young and happy marriage of membrane traffic and cell polarity

The ESF-EMBO meeting on Cell Polarity and Membrane Traffic took place in Poland in April 2012. It brought together scientists from two once separate fields and highlighted their emerging interdependence. The wealth of scientific insights and discoveries presented laid a path for future research

Toward Common Data Elements for International Research in Long-term Care Homes: Advancing Person-Centered Care

To support person-centered, residential long-term care internationally, a consortium of researchers in medicine, nursing, behavioral, and social sciences from 21 geographically and economically diverse countries have launched the WE-THRIVE consortium to develop a common data infrastructure. WE-THRIVE aims to identify measurement domains that are internationally relevant, including in low-, middle-, and high-income countries, prioritize concepts to operationalize domains, and specify a set of data elements to measure concepts that can be used across studies for data sharing and comparisons. This article reports findings from consortium meetings at the 2016 meeting of the Gerontological Society of America and the 2017 meeting of the International Association of Gerontology and Geriatrics, to identify domains and prioritize concepts, following best practices to identify common data elements (CDEs) that were developed through the US National Institutes of Health/National Institute of Nursing Research's CDEs initiative. Four domains were identified, including organizational context, workforce and staffing, person-centered care, and care outcomes. Using a nominal group process, WE-THRIVE prioritized 21 concepts across the 4 domains. Several concepts showed similarity to existing measurement structures, whereas others differed. Conceptual similarity (convergence; eg, concepts in the care outcomes domain of functional level and harm-free care) provides further support of the critical foundational work in LTC measurement endorsed and implemented by regulatory bodies. Different concepts (divergence; eg, concepts in the person-centered care domain of knowing the person and what matters most to the person) highlights current gaps in measurement efforts and is consistent with WE-THRIVE's focus on supporting resilience and thriving for residents, family, and staff. In alignment with the World Health Organization's call for comparative measurement work for health systems change, WE-THRIVE's work to date highlights the benefits of engaging with diverse LTC researchers, including those in low-, middle-, and high-income countries, to develop a measurement infrastructure that integrates the aspirations of person-centered LTC

Large-scale Bright Fronts in the Solar Corona: A Review of "EIT waves"

``EIT waves" are large-scale coronal bright fronts (CBFs) that were first observed in 195 \AA\ images obtained using the Extreme-ultraviolet Imaging Telescope (EIT) onboard the \emph{Solar and Heliospheric Observatory (SOHO)}. Commonly called ``EIT waves", CBFs typically appear as diffuse fronts that propagate pseudo-radially across the solar disk at velocities of 100--700 km s$^{-1}$ with front widths of 50-100 Mm. As their speed is greater than the quiet coronal sound speed ($c_s\leq$200 km s$^{-1}$) and comparable to the local Alfv\'{e}n speed ($v_A\leq$1000 km s$^{-1}$), they were initially interpreted as fast-mode magnetoacoustic waves ($v_{f}=(c_s^2 + v_A^2)^{1/2}$). Their propagation is now known to be modified by regions where the magnetosonic sound speed varies, such as active regions and coronal holes, but there is also evidence for stationary CBFs at coronal hole boundaries. The latter has led to the suggestion that they may be a manifestation of a processes such as Joule heating or magnetic reconnection, rather than a wave-related phenomena. While the general morphological and kinematic properties of CBFs and their association with coronal mass ejections have now been well described, there are many questions regarding their excitation and propagation. In particular, the theoretical interpretation of these enigmatic events as magnetohydrodynamic waves or due to changes in magnetic topology remains the topic of much debate.Comment: 34 pages, 19 figure

Coronal Shock Waves, EUV Waves, and Their Relation to CMEs. III. Shock-Associated CME/EUV Wave in an Event with a Two-Component EUV Transient

On 17 January 2010, STEREO-B observed in extreme ultraviolet (EUV) and white light a large-scale dome-shaped expanding coronal transient with perfectly connected off-limb and on-disk signatures. Veronig et al. (2010, ApJL 716, 57) concluded that the dome was formed by a weak shock wave. We have revealed two EUV components, one of which corresponded to this transient. All of its properties found from EUV, white light, and a metric type II burst match expectations for a freely expanding coronal shock wave including correspondence to the fast-mode speed distribution, while the transient sweeping over the solar surface had a speed typical of EUV waves. The shock wave was presumably excited by an abrupt filament eruption. Both a weak shock approximation and a power-law fit match kinematics of the transient near the Sun. Moreover, the power-law fit matches expansion of the CME leading edge up to 24 solar radii. The second, quasi-stationary EUV component near the dimming was presumably associated with a stretched CME structure; no indications of opening magnetic fields have been detected far from the eruption region.Comment: 18 pages, 10 figures. Solar Physics, published online. The final publication is available at http://www.springerlink.co

Simulations of the Static Friction Due to Adsorbed Molecules

The static friction between crystalline surfaces separated by a molecularly thin layer of adsorbed molecules is calculated using molecular dynamics simulations. These molecules naturally lead to a finite static friction that is consistent with macroscopic friction laws. Crystalline alignment, sliding direction, and the number of adsorbed molecules are not controlled in most experiments and are shown to have little effect on the friction. Temperature, molecular geometry and interaction potentials can have larger effects on friction. The observed trends in friction can be understood in terms of a simple hard sphere model.Comment: 13 pages, 13 figure

A Parametric Study of Erupting Flux Rope Rotation. Modeling the "Cartwheel CME" on 9 April 2008

The rotation of erupting filaments in the solar corona is addressed through a parametric simulation study of unstable, rotating flux ropes in bipolar force-free initial equilibrium. The Lorentz force due to the external shear field component and the relaxation of tension in the twisted field are the major contributors to the rotation in this model, while reconnection with the ambient field is of minor importance. Both major mechanisms writhe the flux rope axis, converting part of the initial twist helicity, and produce rotation profiles which, to a large part, are very similar in a range of shear-twist combinations. A difference lies in the tendency of twist-driven rotation to saturate at lower heights than shear-driven rotation. For parameters characteristic of the source regions of erupting filaments and coronal mass ejections, the shear field is found to be the dominant origin of rotations in the corona and to be required if the rotation reaches angles of order 90 degrees and higher; it dominates even if the twist exceeds the threshold of the helical kink instability. The contributions by shear and twist to the total rotation can be disentangled in the analysis of observations if the rotation and rise profiles are simultaneously compared with model calculations. The resulting twist estimate allows one to judge whether the helical kink instability occurred. This is demonstrated for the erupting prominence in the "Cartwheel CME" on 9 April 2008, which has shown a rotation of \approx 115 degrees up to a height of 1.5 R_sun above the photosphere. Out of a range of initial equilibria which include strongly kink-unstable (twist Phi=5pi), weakly kink-unstable (Phi=3.5pi), and kink-stable (Phi=2.5pi) configurations, only the evolution of the weakly kink-unstable flux rope matches the observations in their entirety.Comment: Solar Physics, submitte