HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent

Stochastic Gradient Descent (SGD) is a popular algorithm that can achieve state-of-the-art performance on a variety of machine learning tasks. Several researchers have recently proposed schemes to parallelize SGD, but all require performance-destroying memory locking and synchronization. This work aims to show using novel theoretical analysis, algorithms, and implementation that SGD can be implemented without any locking. We present an update scheme called HOGWILD! which allows processors access to shared memory with the possibility of overwriting each other's work. We show that when the associated optimization problem is sparse, meaning most gradient updates only modify small parts of the decision variable, then HOGWILD! achieves a nearly optimal rate of convergence. We demonstrate experimentally that HOGWILD! outperforms alternative schemes that use locking by an order of magnitude.Comment: 22 pages, 10 figure

The Relationship Between HR Practices and Firm Performance: Examining Causal Order

Significant research attention has been devoted to examining the relationship between HR practices and firm performance, and the research support has assumed HR as the causal variable. Using data from 45 business units (with 62 data points), this study examines how measures of HR practices correlate with past, concurrent, and future operational performance measures. The results indicate that correlations with performance measures at all three times are both high and invariant, and that controlling for past or concurrent performance virtually eliminates the correlation of HR with future performance. Implications are discussed

Hyperarousal symptoms after traumatic and nontraumatic births

Background: Measurement is critical in postnatal posttraumatic stress disorder (PTSD) because symptoms may be influenced by normal postnatal phenomena such as physiological changes and fatigue. Objective: This study examined: (1) whether hyperarousal symptoms differ between women who have traumatic or nontraumatic births; (2) whether the construct of hyperarousal is coherent in postnatal women; and (3) whether hyperarousal symptoms are useful for identifying women who have traumatic births or PTSD. Methods: A survey of PTSD symptoms in 1,078 women recruited via the community or Internet who completed an online or paper questionnaire measuring childbirth-related PTSD symptoms between 1 and 36 months after birth. Women who had a traumatic birth as defined by DSM-IV criterion A (n = 458) were compared with women who did not have a traumatic birth (n = 591). Results: A one-factor dimension of hyperarousal was identified that included all five hyperarousal items. Diagnostic criteria of two or more hyperarousal symptoms in the previous week were reported by 75.3% of women with traumatic birth and 50.5% of women with nontraumatic births. The difference in mean hyperarousal symptoms between groups was substantial at 0.76 of a standard deviation (Hedge’s g, CI = 0.64, 0.89). A larger difference was observed between women with and without diagnostic PTSD (g = 1.64, CI 1.46, 1.81). However, receiver operating characteristic analyses showed hyperarousal symptoms have poor specificity and alternative ways of calculating symptoms did not improve this. Comparison with other PTSD symptoms found re-experiencing symptoms were most accurate at identifying women with traumatic births. Conclusions: Results suggest hyperarousal symptoms are associated with traumatic birth and are a coherent construct in postnatal women. However, they have poor specificity and should only be used as part of diagnostic criteria, not as a sole indicator

Reflections and Experiences of a Co-Researcher involved in a Renal Research Study

Background Patient and Public Involvement (PPI) is seen as a prerequisite for health research. However, current Patient and public involvement literature has noted a paucity of recording of patient and public involvement within research studies. There have been calls for more recordings and reflections, specifically on impact. Renal medicine has also had similar criticisms and any reflections on patient and public involvement has usually been from the viewpoint of the researcher. Roles of patient and public involvement can vary greatly from sitting on an Advisory Group to analysing data. Different PPI roles have been described within studies; one being a co-researcher. However, the role of the co-researcher is largely undefined and appears to vary from study to study. Methods The aims of this paper are to share one first time co-researcher's reflections on the impact of PPI within a mixed methods (non-clinical trial) renal research study. A retrospective, reflective approach was taken using data available to the co-researcher as part of the day-to-day research activity. Electronic correspondence and documents such as meeting notes, minutes, interview thematic analysis and comments on documents were re-examined. The co-researcher led on writing this paper. Results This paper offers a broad definition of the role of the co-researcher. The co-researcher reflects on undertaking and leading on the thematic analysis of interview transcripts, something she had not previously done before. The co-researcher identified a number of key themes; the differences in time and responsibility between being a coresearcher and an Advisory Group member; how the role evolved and involvement activities could match the co-researchers strengths (and the need for flexibility); the need for training and support and lastly, the time commitment. It was also noted that it is preferable that a co-researcher needs to be involved from the very beginning of the grant application. Conclusions The reflections, voices and views of those undertaking PPI has been largely underrepresented in the literature. The role of co-researcher was seen to be rewarding but demanding, requiring a large time commitment. It is hoped that the learning from sharing this experience will encourage others to undertake this role, and encourage researchers to reflect on the needs of those involved.Peer reviewedFinal Published versio

GeV Gamma-Ray Attenuation and the High-Redshift UV Background

We present new calculations of the evolving UV background out to the epoch of cosmological reionization and make predictions for the amount of GeV gamma-ray attenuation by electron-positron pair production. Our results are based on recent semi-analytic models of galaxy formation, which provide predictions of the dust-extinguished UV radiation field due to starlight, and empirical estimates of the contribution due to quasars. We account for the reprocessing of ionizing photons by the intergalactic medium. We test whether our models can reproduce estimates of the ionizing background at high redshift from flux decrement analysis and proximity effect measurements from quasar spectra, and identify a range of models that can satisfy these constraints. Pair-production against soft diffuse photons leads to a spectral cutoff feature for gamma rays observed between 10 and 100 GeV. This cutoff varies with redshift and the assumed star formation and quasar evolution models. We find only negligible amounts of absorption for gamma rays observed below 10 GeV for any emission redshift. With observations of high-redshift sources in sufficient numbers by the Fermi Gamma-ray Space Telescope and new ground-based instruments it should be possible to constrain the extragalactic background light in the UV and optical portion of the spectrum.Comment: 19 pages, 12 figures, Accepted for publication in MNRAS, this version includes minor correction

Optimization viewpoint on Kalman smoothing, with applications to robust and sparse estimation

In this paper, we present the optimization formulation of the Kalman filtering and smoothing problems, and use this perspective to develop a variety of extensions and applications. We first formulate classic Kalman smoothing as a least squares problem, highlight special structure, and show that the classic filtering and smoothing algorithms are equivalent to a particular algorithm for solving this problem. Once this equivalence is established, we present extensions of Kalman smoothing to systems with nonlinear process and measurement models, systems with linear and nonlinear inequality constraints, systems with outliers in the measurements or sudden changes in the state, and systems where the sparsity of the state sequence must be accounted for. All extensions preserve the computational efficiency of the classic algorithms, and most of the extensions are illustrated with numerical examples, which are part of an open source Kalman smoothing Matlab/Octave package.Comment: 46 pages, 11 figure

What constitutes a "clinical trial"?: A survey of oncology professionals

<p>Abstract</p> <p>Background</p> <p>What constitutes a "clinical trial" is inconsistently defined in the medical literature. With an initiative by Cancer Care Ontario (CCO) to report institutional clinical trials activity across the province of Ontario, Canada, we sought to investigate the variability in the interpretation of the term by local oncology professionals.</p> <p>Methods</p> <p>A survey amongst the physicians and nurses at the Juravinski Cancer Centre at Hamilton Health Sciences, Ontario was conducted. The survey included 12 summaries of local clinical research studies, and respondents were asked which they believed represented a clinical trial. Subsequently, they were asked which of the same 12 studies they believed should be labeled as clinical trials when considering separate definitions provided by CCO and by the Ontario Cancer Research Network (OCRN).</p> <p>Results</p> <p>A total of 66 (54%) of 123 surveys were completed; 32/46 (70%) by physicians, 21/59 (36%) by primary care nurses, and 13/18 (72%) by clinical trial nurses. Without a standardized definition, all studies, 12/12, were considered to be clinical trials by at least 50% of respondents. When provided with the CCO definition only 6/12 studies were considered to be clinical trials by the majority of respondents, while with the OCRN definition it was 9/12 studies. Studies evaluating natural health products, non-traditional medical interventions, and non-randomized studies with standard interventions consistently ranked the lowest, regardless of the definition used.</p> <p>Conclusion</p> <p>Oncology professionals appear to have a broadly inclusive baseline definition of what constitutes a clinical trial. Establishing rigor and consistency in the definition of a clinical trial is important for any program, institutional or jurisdictional based comparisons of clinical trials activity, especially when used as a quality indicator of patient care.</p

Sexual expression and cognitive function: gender-divergent associations in older adults

Prior research demonstrates a positive association between sexual activity and cognitive function in later life. However, the relationship between the type of sexual activity and cognitive function in older adulthood remains unclear. This study explores the associations between the frequency of engaging in different types of sexual activities (intercourse, masturbation, and kissing/petting/fondling) and cognitive function in older women and men. Using data from Wave 6 of the English Longitudinal Study of Ageing (ELSA), 1915 women and 2195 men (age range 50-89 years; n = 4110) reporting any type of sexual activity over the past 12 months, were included in the study. Multiple regression controlling for age, education, satisfaction with sex life, cohabiting, wealth, general health, physical activity, depression and loneliness, was used to explore the associations between the frequency of engagement in intercourse, masturbation and kissing/petting/fondling, and two measures of cognitive function; word recall and number sequencing. For women, masturbation was linked to better word recall (p = .008), whilst for men, kissing/petting/fondling was associated with better number sequencing (p = .035). In women (p = .016) and men (p = .018), dissatisfaction with sex life was associated with better number sequencing. The results point to gendered links between sexual activity and cognitive function. These gender-related divergences may reflect differences in biological/neurological mechanisms, or in cognitive lifestyle factors that could influence cognitive reserve in later life. This novel study underscores the need to delineate the underlying mechanisms of the association between sex and cognition in men and women

Service provision and barriers to care for homeless people with mental health problems across 14 European capital cities

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited

Regulation of pituitary MT1 melatonin receptor expression by gonadotrophin-releasing hormone (GnRH) and early growth response factor-1 (Egr-1) : in vivo and in vitro studies

Copyright: © 2014 Bae et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: This work was funded by the UK Biotechnology and Biological Sciences Research Council (BBSRC; grant BB/F020309/1; http://www.bbsrc.ac.uk/home/home.aspx). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.Peer reviewedPublisher PD