Temporal-Difference Learning to Assist Human Decision Making during the Control of an Artificial Limb

In this work we explore the use of reinforcement learning (RL) to help with human decision making, combining state-of-the-art RL algorithms with an application to prosthetics. Managing human-machine interaction is a problem of considerable scope, and the simplification of human-robot interfaces is especially important in the domains of biomedical technology and rehabilitation medicine. For example, amputees who control artificial limbs are often required to quickly switch between a number of control actions or modes of operation in order to operate their devices. We suggest that by learning to anticipate (predict) a user's behaviour, artificial limbs could take on an active role in a human's control decisions so as to reduce the burden on their users. Recently, we showed that RL in the form of general value functions (GVFs) could be used to accurately detect a user's control intent prior to their explicit control choices. In the present work, we explore the use of temporal-difference learning and GVFs to predict when users will switch their control influence between the different motor functions of a robot arm. Experiments were performed using a multi-function robot arm that was controlled by muscle signals from a user's body (similar to conventional artificial limb control). Our approach was able to acquire and maintain forecasts about a user's switching decisions in real time. It also provides an intuitive and reward-free way for users to correct or reinforce the decisions made by the machine learning system. We expect that when a system is certain enough about its predictions, it can begin to take over switching decisions from the user to streamline control and potentially decrease the time and effort needed to complete tasks. This preliminary study therefore suggests a way to naturally integrate human- and machine-based decision making systems.Comment: 5 pages, 4 figures, This version to appear at The 1st Multidisciplinary Conference on Reinforcement Learning and Decision Making, Princeton, NJ, USA, Oct. 25-27, 201

Area distribution and the average shape of a L\'evy bridge

We consider a one dimensional L\'evy bridge x_B of length n and index 0 < \alpha < 2, i.e. a L\'evy random walk constrained to start and end at the origin after n time steps, x_B(0) = x_B(n)=0. We compute the distribution P_B(A,n) of the area A = \sum_{m=1}^n x_B(m) under such a L\'evy bridge and show that, for large n, it has the scaling form P_B(A,n) \sim n^{-1-1/\alpha} F_\alpha(A/n^{1+1/\alpha}), with the asymptotic behavior F_\alpha(Y) \sim Y^{-2(1+\alpha)} for large Y. For \alpha=1, we obtain an explicit expression of F_1(Y) in terms of elementary functions. We also compute the average profile < \tilde x_B (m) > at time m of a L\'evy bridge with fixed area A. For large n and large m and A, one finds the scaling form = n^{1/\alpha} H_\alpha({m}/{n},{A}/{n^{1+1/\alpha}}), where at variance with Brownian bridge, H_\alpha(X,Y) is a non trivial function of the rescaled time m/n and rescaled area Y = A/n^{1+1/\alpha}. Our analytical results are verified by numerical simulations.Comment: 21 pages, 4 Figure

Detection of Lyme disease and anaplasmosis pathogens via PCR in Pennsylvania deer ked

Borrelia burgdorferi and Anaplasma phagocytophilum are obligate intracellular parasites that maintain their life cycles in enzoonotic vector‐host cycles with Ixodes scapularis as a vector. In addition to ticks, the hosts are commonly infested with insects from the Hippoboscidae family. This study confirms the presence of B. burgdorferi and A. phagocytophilum in deer keds (Lipoptena cervi) removed from white‐tailed deer using PCR. Detection of these pathogens in deer ked represents a potential novel susceptibility of wildlife and also suggests the risk of transmission of these pathogens to humans and animals alike through the bite of an infected ectoparasite. This study represents the first instance in the U.S. of detection of tick‐borne pathogens in a member of the Hippoboscid family

Effective mass and quantum lifetime in a Si/Si0.87Ge0.13/Si two-dimensional hole gas

Measurements of Shubnikov de Haas oscillations in the temperature range 0.3–2 K have been used to determine an effective mass of 0.23 m0 in a Si/Si0.87Ge0.13/Si two-dimensional hole gas. This value is in agreement with theoretical predictions and with that obtained from cyclotron resonance measurements. The ratio of the transport time to the quantum lifetime is found to be 0.8. It is concluded that the 4 K hole mobility of 11 000 cm2 V−1 s−1 at a carrier sheet density of 2.2×1011 cm−2 is limited by interface roughness and short-range interface charge scattering

Collaborative development of diffraction-limited beamline optical systems at US DOE light sources

An ongoing collaboration among four US Department of Energy (DOE) National Laboratories has demonstrated key technology prototypes and software modeling tools required for new high-coherent flux beamline optical systems. New free electron laser (FEL) and diffraction-limited storage ring (DLSR) light sources demand wavefront preservation from source to sample to achieve and maintain optimal performance. Fine wavefront control was achieved using a novel, roomtemperature cooled mirror system called REAL (resistive element adjustable length) that combines cooling with applied, spatially variable auxiliary heating. Single-grating shearing interferometry (also called Talbot interferometry) and Hartmann wavefront sensors were developed and used for optical characterization and alignment on several beamlines, across a range of photon energies. Demonstrations of non-invasive hard x-ray wavefront sensing were performed using a thin diamond single-crystal as a beamsplitter

Adapting to the digital age: a narrative approach

The article adopts a narrative inquiry approach to foreground informal learning and exposes a collection of stories from tutors about how they adapted comfortably to the digital age. We were concerned that despite substantial evidence that bringing about changes in pedagogic practices can be difficult, there is a gap in convincing approaches to help in this respect. In this context, this project takes a “bottom-up” approach and synthesises several life-stories into a single persuasive narrative to support the process of adapting to digital change. The project foregrounds the small, every-day motivating moments, cultural features and environmental factors in people's diverse lives which may have contributed to their positive dispositions towards change in relation to technology enhanced learning. We expect that such narrative approaches could serve to support colleagues in other institutions to warm up to ever-changing technological advances

Short-Term Removal of Exercise Impairs Glycemic Control in Older Adults: A Randomized Trial

Postprandial glycemia (PPG) predicts cardiovascular disease, and short-term physical inactivity increases PPG in young, active adults. Whether this occurs in older, active adults who may be more prone to bouts of inactivity is unknown. This study determined if postprandial interstitial glucose (PPIG) was impaired in active older adults following the removal of exercise for 3 days (NOEX) compared to active young adults. In this randomized, crossover study, 11 older (69.1 ± 1.9 years) and 9 young (32.8 ± 1.8 years) habitually active (≥90 min/week of exercise) adults completed 3-days of NOEX and 3-days of normal habitual exercise (EX), separated by ≥1 week. Diet was standardized across phases. Glycemic control (3-day average) was assessed via continuous glucose monitoring during both phases. Significant main effects of age and phase were detected (p \u3c 0.05), but no interaction was found for steps/day (p \u3e 0.05) (old EX: 6283 ± 607, old NOEX: 2380 ± 382 and young EX: 8798 ± 623, young NOEX: 4075 ± 516 steps/day). Significant main effects of age (p = 0.002) and time (p \u3c 0.001) existed for 1-h PPIG, but no effect of phase or interactions was found (p \u3e 0.05). Significant main effects (p \u3c 0.05) of age (old: 114 ± 1 mg/dl, young: 106 ± 1 mg/dl), phase (NOEX: 112 ± 1 mg/dl, EX: 108 ± 1 mg/dl), and time (0 min: 100 ± 2, 30 min: 118 ± 2, 60 min: 116 ± 2, 90 min: 111 ± 2, 120 min: 108 ± 2 mg/dl) in 2-h PPIG were detected, but no interaction was found (p \u3e 0.05). However, only significant main effects of phase (NOEX: 14 ± 1 and EX:12 ± 1, p \u3e 0.05) were found for 24-h blood glucose standard deviation. Older adults appear to have impaired glycemic control compared to young adults and exercise removal impairs glycemic control in both populations. Yet, the impairment in glycemic control with exercise removal is not different between old and young adults

Trends in blindness due to diabetic retinopathy among adults aged 18-69 years over a decade in Ireland

Aims: To describe trends in the incidence of visual impairment and blindness due to diabetic retinopathy among adults aged 18–69 years in Ireland between 2004 and 2013. Methods: Data on visual impairment due to diabetic retinopathy in adults aged 18–69 years or over who are registered with the National Council for the Blind of Ireland, (2004–2013) were analysed. Annual incidence rates were calculated for the adult population and the population with diagnosed diabetes. Poisson regression was used to test for changes in rates over time. The relative, attributable and population risk of blindness and visual impairment due to diabetic retinopathy were calculated for 2013. Results: Over the decade, the prevalence of diagnosed diabetes increased from 2.1% to 3.6%. Among people with diagnosed diabetes, the incidence of visual impairment due to diabetic retinopathy increased from 6.4 (95% CI 2.4–13.9) per 100,000 in 2004 to 11.7 (95% CI 5.9–21.0) per 100,000 in 2013. The incidence of blindness due to diabetic retinopathy varied from 31.9 per 100,000 (95% CI 21.6–45.7) in 2004 to 14.9 per 100,000 (95% CI 8.2–25.1) in 2013. Conclusions: Our findings indicate the need for increased attention to preventive measures for microvascular complications among adults with diabetes in Ireland. Retinopathy screening has been standardised in Ireland, these findings provide useful baseline statistics to monitor the impact of this population-based screening programme

Beta blocker use in subjects with type 2 diabetes mellitus and systolic heart failure does not worsen glycaemic control

<p>Abstract</p> <p>Background</p> <p>The prognostic benefits of beta-blockers (BB) in patients with systolic heart failure (SHF) are known but despite this, in patients with diabetes they are underutilized. The aim of this study was to assess the effect of beta-blockers (BB) on glycaemic control in patients with Type 2 Diabetes (T2DM) and systolic heart failure (SHF) stratified to beta-1 selective (Bisoprolol) vs. nonselective BB (Carvedilol).</p> <p>Methods</p> <p>This observational, cohort study was conducted in patients with T2DM and SHF attending an Australian tertiary teaching hospital's heart failure services. The primary endpoint was glycaemic control measured by glycosylated haemoglobin (HbA1c) at initiation and top dose of BB. Secondary endpoints included microalbuminuria, changes in lipid profile and estimated glomerular filtration rate (eGFR).</p> <p>Results</p> <p>125 patients were assessed. Both groups were well matched for gender, NYHA class and use of guideline validated heart failure and diabetic medications. The mean treatment duration was 1.9 ± 1.1 years with carvedilol and 1.4 ± 1.0 years with bisoprolol (<it>p </it>= ns). The carvedilol group achieved a reduction in HbA1c (7.8 ± 0.21% to 7.3 ± 0.17%, <it>p </it>= 0.02) whereas the bisoprolol group showed no change in HbA1c (7.0 ± 0.20% to 6.9 ± 0.23%, <it>p </it>= 0.92). There was no significant difference in the change in HbA1c from baseline to peak BB dose in the carvedilol group compared to the bisoprolol group. There was a similar deterioration in eGFR, but no significant changes in lipid profile or microalbuminuria in both groups (<it>p </it>= ns).</p> <p>Conclusion</p> <p>BB use did not worsen glycaemic control, lipid profile or albuminuria status in subjects with SHF and T2DM. Carvedilol significantly improved glycemic control in subjects with SHF and T2DM and this improvement was non significantly better than that obtained with bisoprolol. BB's should not be withheld from patients with T2DM and SHF.</p