1,523 research outputs found
Discretized Bayesian pursuit – A new scheme for reinforcement learning
The success of Learning Automata (LA)-based estimator algorithms over the classical, Linear Reward-Inaction ( L RI )-like schemes, can be explained by their ability to pursue the actions with the highest reward probability estimates. Without access to reward probability estimates, it makes sense for schemes like the L RI to first make large exploring steps, and then to gradually turn exploration into exploitation by making progressively smaller learning steps. However, this behavior becomes counter-intuitive when pursuing actions based on their estimated reward probabilities. Learning should then ideally proceed in progressively larger steps, as the reward probability estimates turn more accurate. This paper introduces a new estimator algorithm, the Discretized Bayesian Pursuit Algorithm (DBPA), that achieves this. The DBPA is implemented by linearly discretizing the action probability space of the Bayesian Pursuit Algorithm (BPA) [1]. The key innovation is that the linear discrete updating rules mitigate the counter-intuitive behavior of the corresponding linear continuous updating rules, by augmenting them with the reward probability estimates. Extensive experimental results show the superiority of DBPA over previous estimator algorithms. Indeed, the DBPA is probably the fastest reported LA to date
Post-training inactivation of the anterior thalamic nuclei impairs spatial performance on the radial arm maze
The limbic thalamus, specifically the anterior thalamic nuclei (ATN), contains brain signals including that of head direction cells, which fire as a function of an animal\u27s directional orientation in an environment. Recent work has suggested that this directional orientation information stemming from the ATN contributes to the generation of hippocampal and parahippocampal spatial representations, and may contribute to the establishment of unique spatial representations in radially oriented tasks such as the radial arm maze. While previous studies have shown that ATN lesions can impair spatial working memory performance in the radial maze, little work has been done to investigate spatial reference memory in a discrimination task variant. Further, while previous studies have shown that ATN lesions can impair performance in the radial maze, these studies produced the ATN lesions prior to training. It is therefore unclear whether the ATN lesions disrupted acquisition or retention of radial maze performance. Here, we tested the role of ATN signaling in a previously learned spatial discrimination task on a radial arm maze. Rats were first trained to asymptotic levels in a task in which two maze arms were consistently baited across training. After 24 h, animals received muscimol inactivation of the ATN before a 4 trial probe test. We report impairments in post-inactivation trials, suggesting that signals from the ATN modulate the use of a previously acquired spatial discrimination in the radial-arm maze. The results are discussed in relation to the thalamo-cortical limbic circuits involved in spatial information processing, with an emphasis on the head direction signal. © 2017 Harvey, Thompson, Sanchez, Yoder and Clark
The dependence of the EIT wave velocity on the magnetic field strength
"EIT waves" are a wavelike phenomenon propagating in the corona, which were
initially observed in the extreme ultraviolet (EUV) wavelength by the EUV
Imaging Telescope (EIT). Their nature is still elusive, with the debate between
fast-mode wave model and non-wave model. In order to distinguish between these
models, we investigate the relation between the EIT wave velocity and the local
magnetic field in the corona. It is found that the two parameters show
significant negative correlation in most of the EIT wave fronts, {\it i.e.},
EIT wave propagates more slowly in the regions of stronger magnetic field. Such
a result poses a big challenge to the fast-mode wave model, which would predict
a strong positive correlation between the two parameters. However, it is
demonstrated that such a result can be explained by the fieldline stretching
model, \emph{i.e.,} that "EIT waves" are apparently-propagating brightenings,
which are generated by successive stretching of closed magnetic field lines
pushed by the erupting flux rope during coronal mass ejections (CMEs).Comment: 11 pages, 8 figures, accepted for publication in Solar Phy
Recent Developments of NEMO: Detection of Solar Eruptions Characteristics
The recent developments in space instrumentation for solar observations and
telemetry have caused the necessity of advanced pattern recognition tools for
the different classes of solar events. The Extreme ultraviolet Imaging
Telescope (EIT) of solar corona on-board SOHO spacecraft has uncovered a new
class of eruptive events which are often identified as signatures of Coronal
Mass Ejection (CME) initiations on solar disk. It is evident that a crucial
task is the development of an automatic detection tool of CMEs precursors. The
Novel EIT wave Machine Observing (NEMO) (http://sidc.be/nemo) code is an
operational tool that detects automatically solar eruptions using EIT image
sequences. NEMO applies techniques based on the general statistical properties
of the underlying physical mechanisms of eruptive events on the solar disc. In
this work, the most recent updates of NEMO code - that have resulted to the
increase of the recognition efficiency of solar eruptions linked to CMEs - are
presented. These updates provide calculations of the surface of the dimming
region, implement novel clustering technique for the dimmings and set new
criteria to flag the eruptive dimmings based on their complex characteristics.
The efficiency of NEMO has been increased significantly resulting to the
extraction of dimmings observed near the solar limb and to the detection of
small-scale events as well. As a consequence, the detection efficiency of CMEs
precursors and the forecasts of CMEs have been drastically improved.
Furthermore, the catalogues of solar eruptive events that can be constructed by
NEMO may include larger number of physical parameters associated to the dimming
regions.Comment: 12 Pages, 5 figures, submitted to Solar Physic
The young and happy marriage of membrane traffic and cell polarity
The ESF-EMBO meeting on Cell Polarity and Membrane Traffic took place in Poland in April 2012. It brought together scientists from two once separate fields and highlighted their emerging interdependence. The wealth of scientific insights and discoveries presented laid a path for future research
Recommended from our members
Toward Common Data Elements for International Research in Long-term Care Homes: Advancing Person-Centered Care
To support person-centered, residential long-term care internationally, a consortium of researchers in medicine, nursing, behavioral, and social sciences from 21 geographically and economically diverse countries have launched the WE-THRIVE consortium to develop a common data infrastructure. WE-THRIVE aims to identify measurement domains that are internationally relevant, including in low-, middle-, and high-income countries, prioritize concepts to operationalize domains, and specify a set of data elements to measure concepts that can be used across studies for data sharing and comparisons. This article reports findings from consortium meetings at the 2016 meeting of the Gerontological Society of America and the 2017 meeting of the International Association of Gerontology and Geriatrics, to identify domains and prioritize concepts, following best practices to identify common data elements (CDEs) that were developed through the US National Institutes of Health/National Institute of Nursing Research's CDEs initiative. Four domains were identified, including organizational context, workforce and staffing, person-centered care, and care outcomes. Using a nominal group process, WE-THRIVE prioritized 21 concepts across the 4 domains. Several concepts showed similarity to existing measurement structures, whereas others differed. Conceptual similarity (convergence; eg, concepts in the care outcomes domain of functional level and harm-free care) provides further support of the critical foundational work in LTC measurement endorsed and implemented by regulatory bodies. Different concepts (divergence; eg, concepts in the person-centered care domain of knowing the person and what matters most to the person) highlights current gaps in measurement efforts and is consistent with WE-THRIVE's focus on supporting resilience and thriving for residents, family, and staff. In alignment with the World Health Organization's call for comparative measurement work for health systems change, WE-THRIVE's work to date highlights the benefits of engaging with diverse LTC researchers, including those in low-, middle-, and high-income countries, to develop a measurement infrastructure that integrates the aspirations of person-centered LTC
Large-scale Bright Fronts in the Solar Corona: A Review of "EIT waves"
``EIT waves" are large-scale coronal bright fronts (CBFs) that were first
observed in 195 \AA\ images obtained using the Extreme-ultraviolet Imaging
Telescope (EIT) onboard the \emph{Solar and Heliospheric Observatory (SOHO)}.
Commonly called ``EIT waves", CBFs typically appear as diffuse fronts that
propagate pseudo-radially across the solar disk at velocities of 100--700 km
s with front widths of 50-100 Mm. As their speed is greater than the
quiet coronal sound speed (200 km s) and comparable to the
local Alfv\'{e}n speed (1000 km s), they were initially
interpreted as fast-mode magnetoacoustic waves ().
Their propagation is now known to be modified by regions where the magnetosonic
sound speed varies, such as active regions and coronal holes, but there is also
evidence for stationary CBFs at coronal hole boundaries. The latter has led to
the suggestion that they may be a manifestation of a processes such as Joule
heating or magnetic reconnection, rather than a wave-related phenomena. While
the general morphological and kinematic properties of CBFs and their
association with coronal mass ejections have now been well described, there are
many questions regarding their excitation and propagation. In particular, the
theoretical interpretation of these enigmatic events as magnetohydrodynamic
waves or due to changes in magnetic topology remains the topic of much debate.Comment: 34 pages, 19 figure
Coronal Shock Waves, EUV Waves, and Their Relation to CMEs. III. Shock-Associated CME/EUV Wave in an Event with a Two-Component EUV Transient
On 17 January 2010, STEREO-B observed in extreme ultraviolet (EUV) and white
light a large-scale dome-shaped expanding coronal transient with perfectly
connected off-limb and on-disk signatures. Veronig et al. (2010, ApJL 716, 57)
concluded that the dome was formed by a weak shock wave. We have revealed two
EUV components, one of which corresponded to this transient. All of its
properties found from EUV, white light, and a metric type II burst match
expectations for a freely expanding coronal shock wave including correspondence
to the fast-mode speed distribution, while the transient sweeping over the
solar surface had a speed typical of EUV waves. The shock wave was presumably
excited by an abrupt filament eruption. Both a weak shock approximation and a
power-law fit match kinematics of the transient near the Sun. Moreover, the
power-law fit matches expansion of the CME leading edge up to 24 solar radii.
The second, quasi-stationary EUV component near the dimming was presumably
associated with a stretched CME structure; no indications of opening magnetic
fields have been detected far from the eruption region.Comment: 18 pages, 10 figures. Solar Physics, published online. The final
publication is available at http://www.springerlink.co
Simulations of the Static Friction Due to Adsorbed Molecules
The static friction between crystalline surfaces separated by a molecularly
thin layer of adsorbed molecules is calculated using molecular dynamics
simulations. These molecules naturally lead to a finite static friction that is
consistent with macroscopic friction laws. Crystalline alignment, sliding
direction, and the number of adsorbed molecules are not controlled in most
experiments and are shown to have little effect on the friction. Temperature,
molecular geometry and interaction potentials can have larger effects on
friction. The observed trends in friction can be understood in terms of a
simple hard sphere model.Comment: 13 pages, 13 figure
DCE-MRI biomarkers of tumour heterogeneity predict CRC liver metastasis shrinkage following bevacizumab and FOLFOX-6
Background:
There is limited evidence that imaging biomarkers can predict subsequent response to therapy. Such prognostic and/or predictive biomarkers would facilitate development of personalised medicine. We hypothesised that pre-treatment measurement of the heterogeneity of tumour vascular enhancement could predict clinical outcome following combination anti-angiogenic and cytotoxic chemotherapy in colorectal cancer (CRC) liver metastases.
Methods:
Ten patients with 26 CRC liver metastases had two dynamic contrast-enhanced MRI (DCE-MRI) examinations before starting first-line bevacizumab and FOLFOX-6. Pre-treatment biomarkers of tumour microvasculature were computed and a regression analysis was performed against the post-treatment change in tumour volume after five cycles of therapy. The ability of the resulting linear model to predict tumour shrinkage was evaluated using leave-one-out validation. Robustness to inter-visit variation was investigated using data from a second baseline scan.
Results:
In all, 86% of the variance in post-treatment tumour shrinkage was explained by the median extravascular extracellular volume (ve), tumour enhancing fraction (EF), and microvascular uniformity (assessed with the fractal measure box dimension, d0) (R2=0.86, P<0.00005). Other variables, including baseline volume were not statistically significant. Median prediction error was 12%. Equivalent results were obtained from the second scan.
Conclusion:
Traditional image analyses may over-simplify tumour biology. Measuring microvascular heterogeneity may yield important prognostic and/or predictive biomarkers
- …