Accelerating Generalized Linear Models with MLWeaving: A One-Size-Fits-All System for Any-precision Learning (Technical Report)

Learning from the data stored in a database is an important function increasingly available in relational engines. Methods using lower precision input data are of special interest given their overall higher efficiency but, in databases, these methods have a hidden cost: the quantization of the real value into a smaller number is an expensive step. To address the issue, in this paper we present MLWeaving, a data structure and hardware acceleration technique intended to speed up learning of generalized linear models in databases. ML-Weaving provides a compact, in-memory representation enabling the retrieval of data at any level of precision. MLWeaving also takes advantage of the increasing availability of FPGA-based accelerators to provide a highly efficient implementation of stochastic gradient descent. The solution adopted in MLWeaving is more efficient than existing designs in terms of space (since it can process any resolution on the same design) and resources (via the use of bit-serial multipliers). MLWeaving also enables the runtime tuning of precision, instead of a fixed precision level during the training. We illustrate this using a simple, dynamic precision schedule. Experimental results show MLWeaving achieves up to16 performance improvement over low-precision CPU implementations of first-order methods.Comment: 18 page

Rapid bidirectional reorganization of cortical microcircuits.

Mature neocortex adapts to altered sensory input by changing neural activity in cortical circuits. The underlying cellular mechanisms remain unclear. We used blood oxygen level-dependent (BOLD) functional magnetic resonance imaging (fMRI) to show reorganization in somatosensory cortex elicited by altered whisker sensory input. We found that there was rapid expansion followed by retraction of whisker cortical maps. The cellular basis for the reorganization in primary somatosensory cortex was investigated with paired electrophysiological recordings in the periphery of the expanded whisker representation. During map expansion, the chance of finding a monosynaptic connection between pairs of pyramidal neurons increased 3-fold. Despite the rapid increase in local excitatory connectivity, the average strength and synaptic dynamics did not change, which suggests that new excitatory connections rapidly acquire the properties of established excitatory connections. During map retraction, entire excitatory connections between pyramidal neurons were lost. In contrast, connectivity between pyramidal neurons and fast spiking interneurons was unchanged. Hence, the changes in local excitatory connectivity did not occur in all circuits involving pyramidal neurons. Our data show that pyramidal neurons are recruited to and eliminated from local excitatory networks over days. These findings suggest that the local excitatory connectome is dynamic in mature neocortex

MicroRec: Efficient Recommendation Inference by Hardware and Data Structure Solutions

Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The inference is also heavily constrained in terms of latency because producing a recommendation for a user must be done in about tens of milliseconds. In this paper, we propose MicroRec, a high-performance inference engine for recommendation systems. MicroRec accelerates recommendation inference by (1) redesigning the data structures involved in the embeddings to reduce the number of lookups needed and (2) taking advantage of the availability of High-Bandwidth Memory (HBM) in FPGA accelerators to tackle the latency by enabling parallel lookups. We have implemented the resulting design on an FPGA board including the embedding lookup step as well as the complete inference process. Compared to the optimized CPU baseline (16 vCPU, AVX2-enabled), MicroRec achieves 13.8~14.7x speedup on embedding lookup alone and 2.5$~5.4x speedup for the entire recommendation inference in terms of throughput. As for latency, CPU-based engines needs milliseconds for inferring a recommendation while MicroRec only takes microseconds, a significant advantage in real-time recommendation systems.Comment: Accepted by MLSys'21 (the 4th Conference on Machine Learning and Systems

The effect of Neuragen PN® on Neuropathic pain: A randomized, double blind, placebo controlled clinical trial

<p>Abstract</p> <p>Background</p> <p>A double blind, randomized, placebo controlled study to evaluate the safety and efficacy of the naturally derived topical oil, "Neuragen PN^®" for the treatment of neuropathic pain.</p> <p>Methods</p> <p>Sixty participants with plantar cutaneous (foot sole) pain due to all cause peripheral neuropathy were recruited from the community. Each subject was randomly assigned to receive one of two treatments (Neuragen PN^®or placebo) per week in a crossover design. The primary outcome measure was acute spontaneous pain level as reported on a visual analog scale.</p> <p>Results</p> <p>There was an overall pain reduction for both treatments from pre to post application. As compared to the placebo, Neuragen PN^®led to significantly (p < .05) greater pain reduction. Fifty six of sixty subjects (93.3%) receiving Neuragen PN^®reported pain reduction within 30 minutes. This reduction within 30 minutes occurred in only twenty one of sixty (35.0%) subjects receiving the placebo. In a break out analysis of the diabetic only subgroup, 94% of subjects in the Neuragen PN^®group achieved pain reduction within 30 minutes vs 11.0% of the placebo group. No adverse events were observed.</p> <p>Conclusions</p> <p>This randomized, placebo controlled, clinical trial with crossover design revealed that the naturally derived oil, Neuragen PN^®, provided significant relief from neuropathic pain in an all cause neuropathy group. Participants with diabetes within this group experienced similar pain relief.</p> <p>Trial registration</p> <p><b>ISRCTN registered: </b>ISRCTN13226601</p

A resource-based view and dynamic capabilities approach in the context of a region’s international attractiveness: The recent case of Western Australia

This exploratory study proposes a framework based on the resource view theory and the dynamic capabilities approach to further the understanding of a region’s attractiveness, particularly from an international perspective. The case of Western Australia is examined through in-depth, face-to-face interviews with nine country consuls experienced in international trade. The findings revealed significant ways in which Western Australia could enhance its future commercial appeal. The findings revealed the value of synergies between this state and other countries, particularly exchanging expertise, transferring knowledge, or exporting know-how, education, both university and industry-focused, research and development and expertise. These forms of regional attractiveness emphasise the strategic role of industry resources and dynamic capabilities, thus, underscoring the usefulness and applicability of the proposed framework. While the state’s mineral exports will continue to drive its economy, harnessing its potential in other areas is crucial to adapt to changing business environments and to build sustained competitive advantage. © 2018, The Author(s) 2018

The updating of clinical practice guidelines: insights from an international survey

Contains fulltext : 98466.pdf (publisher's version ) (Open Access)BACKGROUND: Clinical practice guidelines (CPGs) have become increasingly popular, and the methodology to develop guidelines has evolved enormously. However, little attention has been given to the updating process, in contrast to the appraisal of the available literature. We conducted an international survey to identify current practices in CPG updating and explored the need to standardize and improve the methods. METHODS: We developed a questionnaire (28 items) based on a review of the existing literature about guideline updating and expert comments. We carried out the survey between March and July 2009, and it was sent by email to 106 institutions: 69 members of the Guidelines International Network who declared that they developed CPGs; 30 institutions included in the U.S. National Guideline Clearinghouse database that published more than 20 CPGs; and 7 institutions selected by an expert committee. RESULTS: Forty-four institutions answered the questionnaire (42% response rate). In the final analysis, 39 completed questionnaires were included. Thirty-six institutions (92%) reported that they update their guidelines. Thirty-one institutions (86%) have a formal procedure for updating their guidelines, and 19 (53%) have a formal procedure for deciding when a guideline becomes out of date. Institutions describe the process as moderately rigorous (36%) or acknowledge that it could certainly be more rigorous (36%). Twenty-two institutions (61%) alert guideline users on their website when a guideline is older than three to five years or when there is a risk of being outdated. Twenty-five institutions (64%) support the concept of "living guidelines," which are continuously monitored and updated. Eighteen institutions (46%) have plans to design a protocol to improve their guideline-updating process, and 21 (54%) are willing to share resources with other organizations. CONCLUSIONS: Our study is the first to describe the process of updating CPGs among prominent guideline institutions across the world, providing a comprehensive picture of guideline updating. There is an urgent need to develop rigorous international standards for this process and to minimize duplication of effort internationally

A Randomized Placebo-Controlled Trial of Intermittent Preventive Treatment in Pregnant Women in the Context of Insecticide Treated Nets Delivered through the Antenatal Clinic

Background:Current recommendations to prevent malaria in African pregnant women rely on insecticide treated nets(ITNs) and intermittent preventive treatment (IPTp). However, there is no information on the safety and efficacy of theircombined use.Methods:1030 pregnant Mozambican women of all gravidities received a long-lasting ITN during antenatal clinic (ANC)visits and, irrespective of HIV status, were enrolled in a randomised, double blind, placebo-controlled trial, to assess thesafety and efficacy of 2-dose sulphadoxine-pyrimethamine (SP). The main outcome was the reduction in low birth weight.Findings:Two-dose SP was safe and well tolerated, but was not associated with reductions in anaemia prevalence atdelivery (RR, 0.92 [95% CI, 0.79-1.08]), low birth weight (RR, 0.99 [95% CI, 0.70-1.39]), or overall placental infection(p = 0.964). However, the SP group showed a 40% reduction (95% CI, 7.40-61.20]; p = 0.020) in the incidence of clinicalmalaria during pregnancy, and reductions in the prevalence of peripheral parasitaemia (7.10% vs 15.15%) (p,0.001), and ofactively infected placentas (7.04% vs 13.60%) (p = 0.002). There was a reduction in severe anaemia at delivery of borderlinestatistical significance (p = 0.055). These effects were not modified by gravidity or HIV status. Reported ITN's use was morethan 90% in both groups.Conclusions:Two-dose SP was associated with a reduction in some indicators, but these were not translated to significantimprovement in other maternal or birth outcomes. The use of ITNs during pregnancy may reduce the need to administerIPTp. ITNs should be part of the ANC package in sub-Saharan Afric

Short-Term Treatment with Bisphenol-A Leads to Metabolic Abnormalities in Adult Male Mice

Bisphenol-A (BPA) is one of the most widespread endocrine disrupting chemicals (EDC) used as the base compound in the manufacture of polycarbonate plastics. Although evidence points to consider exposure to BPA as a risk factor for insulin resistance, its actions on whole body metabolism and on insulin-sensitive tissues are still unclear. The aim of the present work was to study the effects of low doses of BPA in insulin-sensitive peripheral tissues and whole body metabolism in adult mice. Adult mice were treated with subcutaneous injection of 100 µg/kg BPA or vehicle for 8 days. Whole body energy homeostasis was assessed with in vivo indirect calorimetry. Insulin signaling assays were conducted by western blot analysis. Mice treated with BPA were insulin resistant and had increased glucose-stimulated insulin release. BPA-treated mice had decreased food intake, lower body temperature and locomotor activity compared to control. In skeletal muscle, insulin-stimulated tyrosine phosphorylation of the insulin receptor β subunit was impaired in BPA-treated mice. This impairment was associated with a reduced insulin-stimulated Akt phosphorylation in the Thr308 residue. Both skeletal muscle and liver displayed an upregulation of IRS-1 protein by BPA. The mitogen-activated protein kinase (MAPK) signaling pathway was also impaired in the skeletal muscle from BPA-treated mice. In the liver, BPA effects were of lesser intensity with decreased insulin-stimulated tyrosine phosphorylation of the insulin receptor β subunit

Disparities in the frequency of fruit and vegetable consumption by socio-demographic and lifestyle characteristics in Canada

<p>Abstract</p> <p>Background</p> <p>The health benefits of adequate fruit and vegetable (F&V) consumption are significant and widely documented. However, many individuals self-report low F&V consumption frequency per day. This paper examines the disparities in the frequency of F&V consumption by socio-demographic and lifestyle characteristics.</p> <p>Method</p> <p>This study uses a representative sample of 93,719 individuals from the Canadian Community Health Survey (2007). A quantile regression model is estimated in order to capture the differential effects of F&V determinants across the conditional distribution of F&V consumption.</p> <p>Results</p> <p>The conditional and unconditional analyses reveal the existence of a socioeconomic gradient in F&V consumption frequency, in which the low income-education groups consume F&V less frequently than the high income-education groups. We also find significant disparities in F&V consumption frequency by demographic and lifestyle characteristics. The frequency of F&V consumption is relatively lower among: males, those in middle age, singles, smokers, individuals with weak social interaction and households with no children. The quantile regression results show that the association between F&V consumption frequency, and socio-demographic and lifestyle factors varies significantly along the conditional F&V consumption distribution. In particular, individual educational attainment is positively and significantly associated with F&V consumption frequency across different parts of the F&V distribution, while the income level matters only over the lower half of the distribution. F&V consumption follows a U-shaped pattern across the age categories. Those aged 30-39, 40-49 and 50-59 years consume F&V less frequently than those aged 18-29 years. The smallest F&V consumption is among the middle aged adults (40-49).</p> <p>Conclusions</p> <p>Understanding the socio-demographic and lifestyle characteristics of individuals with low F&V consumption frequency could increase the effectiveness of policies aimed at promoting F&V consumption. The differential effects of individual characteristics along the F&V consumption distribution suggest the need for a multifaceted approach to address the variation in F&V consumption frequency.</p

Prealignment B(E2)-anomaly in 124Xe

Lifetimes of 17 levels of 124Xe were measured using the Recoil Distance Doppler Shift method. An anomalous E2-reduction was observed, starting at Iπ = 8+ and Iπ = 5+ in the groundstate and in the quasi-gamma band respectively. This anomaly is discussed in terms of the Interacting Boson Model