Reinforcement learning in large, structured action spaces: A simulation study of decision support for spinal cord injury rehabilitation

Reinforcement learning (RL) has helped improve decision-making in several applications. However, applying traditional RL is challenging in some applications, such as rehabilitation of people with a spinal cord injury (SCI). Among other factors, using RL in this domain is difficult because there are many possible treatments (i.e., large action space) and few patients (i.e., limited training data). Treatments for SCIs have natural groupings, so we propose two approaches to grouping treatments so that an RL agent can learn effectively from limited data. One relies on domain knowledge of SCI rehabilitation and the other learns similarities among treatments using an embedding technique. We then use Fitted Q Iteration to train an agent that learns optimal treatments. Through a simulation study designed to reflect the properties of SCI rehabilitation, we find that both methods can help improve the treatment decisions of physiotherapists, but the approach based on domain knowledge offers better performance. Our findings provide a "proof of concept" that RL can be used to help improve the treatment of those with an SCI and indicates that continued efforts to gather data and apply RL to this domain are worthwhile.Comment: 31 pages, 7 figure

Physical activity self-management interventions for adults with spinal cord injury: Part 2 – Exploring the generalizability of findings from research to practice

Despite the benefits associated with regular participation in physical activity, individuals with spinal cord injury (SCI) remain insufficiently active. The ability to self-manage participation may increase physical activity levels, but only if self-management interventions can be implemented in the ‘real world’. The purpose of this review was to examine the degree to which authors of published studies of LTPA self-management interventions for individuals with SCI have reported on factors that could increase the likelihood of translating this research into practice. A systematic search of five databases was conducted, yielding 33 eligible studies representing 31 interventions. Each intervention was assessed using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Framework and the PRECIS-2 (PRagmatic-Explanatory Continuum Indicator Summary) tool. The most commonly reported RE-AIM dimensions were Effectiveness (51.0% of interventions) and Reach (18.5%), followed by Implementation (14.2%), Maintenance (13.8%), and Adoption (4.0%). Overall, interventions were scored as primarily explanatory in five of the nine PRECIS-2 domains (recruitment, primary analysis, organization, flexibility [delivery], follow-up) and primarily pragmatic in one domain (setting). These findings suggest that while some LTPA self-management interventions for individuals with SCI are intended to be translated to real world settings, limited information is available to understand the degree to which this has been accomplished. Enhanced reporting of factors that could increase the likelihood of translating these interventions into practice is recommended

Developing physical activity interventions for adults with spinal cord injury. Part 2: Motivational counseling and peer-mediated interventions for people intending to be active

Objective: The majority of people with spinal cord injury (SCI) do not engage in sufficient leisure-time physical activity (LTPA) to attain fitness benefits; however, many have good intentions to be active. This paper describes two pilot interventions targeting people with SCI who are insufficiently active but intend to be active (i.e., intenders ). Method: Study 1 examined the effects of a single, telephone-based counseling session on self-regulatory efficacy, intentions, and action plans for LTPA among seven men and women with paraplegia or tetraplegia. Study 2 examined the effects of a home-based strengthtraining session, delivered by a peer and a fitness trainer, on strength-training task self-efficacy, intentions, action plans, and behavior. Participants were 11 men and women with paraplegia. Results: The counseling session (Study 1) yielded medium- to large-sized increases in participants\u27 confidence to set LTPA goals and intentions to be active. The home visit (Study 2) produced medium- to large-sized increases in task self-efficacy, barrier self-efficacy, intentions, action planning, and strength-training behavior from baseline to 4 weeks after the visit. Conclusions/Implications: Study 1 findings provide preliminary evidence that a single counseling session can impact key determinants of LTPA among intenders with SCI. Study 2 findings demonstrate the potential utility of a peer-mediated, home-based strength training session for positively influencing social cognitions and strength-training behavior. Together, these studies provide evidence and resources for intervention strategies to promote LTPA. among intenders with SCI, a population for whom LTPA interventions and resources are scarcely available. © 2013 American Psychological Association

Changes in health in the countries of the UK and 150 English Local Authority areas 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016

Background Previous studies have reported national and regional Global Burden of Disease (GBD) estimates for the UK. Because of substantial variation in health within the UK, action to improve it requires comparable estimates of disease burden and risks at country and local levels. The slowdown in the rate of improvement in life expectancy requires further investigation. We use GBD 2016 data on mortality, causes of death, and disability to analyse the burden of disease in the countries of the UK and within local authorities in England by deprivation quintile. Methods We extracted data from the GBD 2016 to estimate years of life lost (YLLs), years lived with disability (YLDs), disability-adjusted life-years (DALYs), and attributable risks from 1990 to 2016 for England, Scotland, Wales, Northern Ireland, the UK, and 150 English Upper-Tier Local Authorities. We estimated the burden of disease by cause of death, condition, year, and sex. We analysed the association between burden of disease and socioeconomic deprivation using the Index of Multiple Deprivation. We present results for all 264 GBD causes of death combined and the leading 20 specific causes, and all 84 GBD risks or risk clusters combined and 17 specific risks or risk clusters. Findings The leading causes of age-adjusted YLLs in all UK countries in 2016 were ischaemic heart disease, lung cancers, cerebrovascular disease, and chronic obstructive pulmonary disease. Age-standardised rates of YLLs for all causes varied by two times between local areas in England according to levels of socioeconomic deprivation (from 14 274 per 100 000 population [95% uncertainty interval 12 791–15 875] in Blackpool to 6888 [6145–7739] in Wokingham). Some Upper-Tier Local Authorities, particularly those in London, did better than expected for their level of deprivation. Allowing for differences in age structure, more deprived Upper-Tier Local Authorities had higher attributable YLLs for most major risk factors in the GBD. The population attributable fractions for all-cause YLLs for individual major risk factors varied across Upper-Tier Local Authorities. Life expectancy and YLLs have improved more slowly since 2010 in all UK countries compared with 1990–2010. In nine of 150 Upper-Tier Local Authorities, YLLs increased after 2010. For attributable YLLs, the rate of improvement slowed most substantially for cardiovascular disease and breast, colorectal, and lung cancers, and showed little change for Alzheimer's disease and other dementias. Morbidity makes an increasing contribution to overall burden in the UK compared with mortality. The age-standardised UK DALY rate for low back and neck pain (1795 [1258–2356]) was higher than for ischaemic heart disease (1200 [1155–1246]) or lung cancer (660 [642–679]). The leading causes of ill health (measured through YLDs) in the UK in 2016 were low back and neck pain, skin and subcutaneous diseases, migraine, depressive disorders, and sense organ disease. Age-standardised YLD rates varied much less than equivalent YLL rates across the UK, which reflects the relative scarcity of local data on causes of ill health. Interpretation These estimates at local, regional, and national level will allow policy makers to match resources and priorities to levels of burden and risk factors. Improvement in YLLs and life expectancy slowed notably after 2010, particularly in cardiovascular disease and cancer, and targeted actions are needed if the rate of improvement is to recover. A targeted policy response is also required to address the increasing proportion of burden due to morbidity, such as musculoskeletal problems and depression. Improving the quality and completeness of available data on these causes is an essential component of this response

Srv Mediated Dispersal of Streptococcal Biofilms Through SpeB Is Observed in CovRS+ Strains

Group A Streptococcus (GAS) is a human specific pathogen capable of causing both mild infections and severe invasive disease. We and others have shown that GAS is able to form biofilms during infection. That is to say, they form a three-dimensional, surface attached structure consisting of bacteria and a multi-component extracellular matrix. The mechanisms involved in regulation and dispersal of these GAS structures are still unclear. Recently we have reported that in the absence of the transcriptional regulator Srv in the MGAS5005 background, the cysteine protease SpeB is constitutively produced, leading to increased tissue damage and decreased biofilm formation during a subcutaneous infection in a mouse model. This was interesting because MGAS5005 has a naturally occurring mutation that inactivates the sensor kinase domain of the two component regulatory system CovRS. Others have previously shown that strains lacking covS are associated with decreased SpeB production due to CovR repression of speB expression. Thus, our results suggest the inactivation of srv can bypass CovR repression and lead to constitutive SpeB production. We hypothesized that Srv control of SpeB production may be a mechanism to regulate biofilm dispersal and provide a mechanism by which mild infection can transition to severe disease through biofilm dispersal. The question remained however, is this mechanism conserved among GAS strains or restricted to the unique genetic makeup of MGAS5005. Here we show that Srv mediated control of SpeB and biofilm dispersal is conserved in the invasive clinical isolates RGAS053 (serotype M1) and MGAS315 (serotype M3), both of which have covS intact. This work provides additional evidence that Srv regulated control of SpeB may mediate biofilm formation and dispersal in diverse strain backgrounds

Characteristics of a Widespread Community Cluster of H275Y Oseltamivir-Resistant A(H1N1)pdm09 Influenza in Australia

Background. Oseltamivir resistance in A(H1N1)pdm09 influenza is rare, particularly in untreated community cases. Sustained community transmission has not previously been reported

Changes in health in the countries of the UK and 150 English Local Authority areas 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016

Background Previous studies have reported national and regional Global Burden of Disease (GBD) estimates for the UK. Because of substantial variation in health within the UK, action to improve it requires comparable estimates of disease burden and risks at country and local levels. The slowdown in the rate of improvement in life expectancy requires further investigation. We use GBD 2016 data on mortality, causes of death, and disability to analyse the burden of disease in the countries of the UK and within local authorities in England by deprivation quintile. Methods We extracted data from the GBD 2016 to estimate years of life lost (YLLs), years lived with disability (YLDs), disability-adjusted life-years (DALYs), and attributable risks from 1990 to 2016 for England, Scotland, Wales, Northern Ireland, the UK, and 150 English Upper-Tier Local Authorities. We estimated the burden of disease by cause of death, condition, year, and sex. We analysed the association between burden of disease and socioeconomic deprivation using the Index of Multiple Deprivation. We present results for all 264 GBD causes of death combined and the leading 20 specific causes, and all 84 GBD risks or risk clusters combined and 17 specific risks or risk clusters. Findings The leading causes of age-adjusted YLLs in all UK countries in 2016 were ischaemic heart disease, lung cancers, cerebrovascular disease, and chronic obstructive pulmonary disease. Age-standardised rates of YLLs for all causes varied by two times between local areas in England according to levels of socioeconomic deprivation (from 14 274 per 100 000 population [95% uncertainty interval 12 791–15 875] in Blackpool to 6888 [6145–7739] in Wokingham). Some Upper-Tier Local Authorities, particularly those in London, did better than expected for their level of deprivation. Allowing for differences in age structure, more deprived Upper-Tier Local Authorities had higher attributable YLLs for most major risk factors in the GBD. The population attributable fractions for all-cause YLLs for individual major risk factors varied across Upper-Tier Local Authorities. Life expectancy and YLLs have improved more slowly since 2010 in all UK countries compared with 1990–2010. In nine of 150 Upper-Tier Local Authorities, YLLs increased after 2010. For attributable YLLs, the rate of improvement slowed most substantially for cardiovascular disease and breast, colorectal, and lung cancers, and showed little change for Alzheimer’s disease and other dementias. Morbidity makes an increasing contribution to overall burden in the UK compared with mortality. The age-standardised UK DALY rate for low back and neck pain (1795 [1258–2356]) was higher than for ischaemic heart disease (1200 [1155–1246]) or lung cancer (660 [642–679]). The leading causes of ill health (measured through YLDs) in the UK in 2016 were low back and neck pain, skin and subcutaneous diseases, migraine, depressive disorders, and sense organ disease. Age-standardised YLD rates varied much less than equivalent YLL rates across the UK, which reflects the relative scarcity of local data on causes of ill health. Interpretation These estimates at local, regional, and national level will allow policy makers to match resources and priorities to levels of burden and risk factors. Improvement in YLLs and life expectancy slowed notably after 2010, particularly in cardiovascular disease and cancer, and targeted actions are needed if the rate of improvement is to recover. A targeted policy response is also required to address the increasing proportion of burden due to morbidity, such as musculoskeletal problems and depression. Improving the quality and completeness of available data on these causes is an essential component of this response.</p

Evidence-based Kernels: Fundamental Units of Behavioral Influence

This paper describes evidence-based kernels, fundamental units of behavioral influence that appear to underlie effective prevention and treatment for children, adults, and families. A kernel is a behavior–influence procedure shown through experimental analysis to affect a specific behavior and that is indivisible in the sense that removing any of its components would render it inert. Existing evidence shows that a variety of kernels can influence behavior in context, and some evidence suggests that frequent use or sufficient use of some kernels may produce longer lasting behavioral shifts. The analysis of kernels could contribute to an empirically based theory of behavioral influence, augment existing prevention or treatment efforts, facilitate the dissemination of effective prevention and treatment practices, clarify the active ingredients in existing interventions, and contribute to efficiently developing interventions that are more effective. Kernels involve one or more of the following mechanisms of behavior influence: reinforcement, altering antecedents, changing verbal relational responding, or changing physiological states directly. The paper describes 52 of these kernels, and details practical, theoretical, and research implications, including calling for a national database of kernels that influence human behavior