Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data

In this work we introduce Labrador, a pre-trained Transformer model for laboratory data. Labrador and BERT were pre-trained on a corpus of 100 million lab test results from electronic health records (EHRs) and evaluated on various downstream outcome prediction tasks. Both models demonstrate mastery of the pre-training task but neither consistently outperform XGBoost on downstream supervised tasks. Our ablation studies reveal that transfer learning shows limited effectiveness for BERT and achieves marginal success with Labrador. We explore the reasons for the failure of transfer learning and suggest that the data generating process underlying each patient cannot be characterized sufficiently using labs alone, among other factors. We encourage future work to focus on joint modeling of multiple EHR data categories and to include tree-based baselines in their evaluations.Comment: 27 pages, 8 figure

A Randomized, Controlled Investigation of Motor Cortex Transcranial Magnetic Stimulation (TMS) Effects on Quantitative Sensory Measures in Healthy Adults: Evaluation of TMS Device Parameters

There is emerging evidence that transcranial magnetic stimulation (TMS) can produce analgesic effects in clinical samples and in healthy adults undergoing experimentally induced pain, and the field of minimally invasive brain stimulation for the management of pain is expanding rapidly. While, motor cortex is the most widely used cortical target for TMS in the management of neuropathic pain, few studies have systematically investigated the analgesic effects of a full range of device parameters to provide initial hints about what stimulation intensities and frequencies are most helpful (or even potentially harmful) to patients. Further, there is considerable inconsistency between studies with respect to laboratory pain measurement procedures, TMS treatment parameters, sophistication of the sham methods, and sample-sizes. The present study employed a sham-controlled, within-subject, cross-over design to examine the effects of five different TMS treatment parameters across several quantitative sensory measures in a sample of healthy adult volunteers. 65 participants underwent quantitative sensory testing procedures pre- and post- 40-minutes of real and sham motor cortex TMS. TMS was delivered at 1Hz 80% resting motor threshold (rMT), 1Hz 100%rMT, 10Hz 80%rMT, 10Hz 100%rMT, or 50Hz triplets at 90% of active motor threshold (intermittent theta-burst). The mean painfulness rating of real TMS stimulation itself was 3.0 (SE=.36) out of 10 and was significantly greater than zero (t(64)=8.17, p<.0001). The sham TMS methods used permitted matching between real and sham TMS-induced scalp sensations and participants were successfully blinded to condition (real versus sham). Findings suggest that the effects of motor cortex TMS on quantitative sensory tests in healthy adults vary across different treatment parameters with the smallest observed effect for intermittent theta-burst stimulation (Cohen's d=0.03) and the largest for 10Hz 100%rMT (d=.34). Overall, TMS was associated with statistically significant effects on warm and cool sensory thresholds, cold pain thresholds, suprathreshold stimulus unpleasantness ratings and wind-up pain. With respect to device parameter effects, higher frequency stimulation appears to be associated with the most analgesic and anti-sensitivity effects with the exception of intermittent theta-burst stimulation. The present findings support several clinical research findings suggesting that higher TMS frequencies tend to be associated with the most clinical benefit in patients with chronic pain

The Back 2 Activity Trial: education and advice versus education and advice plus a structured walking programme for chronic low back pain

<p>Abstract</p> <p>Background</p> <p>Current evidence supports the use of exercise-based treatment for chronic low back pain that encourages the patient to assume an active role in their recovery. Walking has been shown it to be an acceptable type of exercise with a low risk of injury. However, it is not known whether structured physical activity programmes are any more effective than giving advice to remain active.</p> <p>Methods/Design</p> <p>The proposed study will test the feasibility of using a pedometer-driven walking programme, as an adjunct to a standard education and advice session in participants with chronic low back pain. Fifty adult participants will be recruited via a number of different sources. Baseline outcome measures including self reported function; objective physical activity levels; fear-avoidance beliefs and health-related quality of life will be recorded. Eligible participants will be randomly allocated under strict, double blind conditions to one of two treatments groups. Participants in group A will receive a single education and advice session with a physiotherapist based on the content of the 'Back Book'. Participants in group B will receive the same education and advice session. In addition, they will also receive a graded pedometer-driven walking programme prescribed by the physiotherapist. Follow up outcomes will be recorded by the same researcher, who will remain blinded to group allocation, at eight weeks and six months post randomisation. A qualitative exploration of participants' perception of walking will also be examined by use of focus groups at the end of the intervention. As a feasibility study, treatment effects will be represented by point estimates and confidence intervals. The assessment of participant satisfaction will be tabulated, as will adherence levels and any recorded difficulties or adverse events experienced by the participants or therapists. This information will be used to modify the planned interventions to be used in a larger randomised controlled trial.</p> <p>Discussion</p> <p>This paper describes the rationale and design of a study which will test the feasibility of using a structured, pedometer-driven walking programme in participants with chronic low back pain.</p> <p>Trial Registration</p> <p>[ISRCTN67030896]</p

The Lung Image Database Consortium (LIDC): An Evaluation of Radiologist Variability in the Identification of Lung Nodules on CT Scans

RATIONALE AND OBJECTIVES: The purpose of this study was to analyze the variability of experienced thoracic radiologists in the identification of lung nodules on CT scans and thereby to investigate variability in the establishment of the “truth” against which nodule-based studies are measured. MATERIALS AND METHODS: Thirty CT scans were reviewed twice by four thoracic radiologists through a two-phase image annotation process. During the initial “blinded read” phase, radiologists independently marked lesions they identified as “nodule ≥ 3mm (diameter),” “nodule < 3mm,” or “non-nodule ≥ 3mm.” During the subsequent “unblinded read” phase, the blinded read results of all radiologists were revealed to each of the four radiologists, who then independently reviewed their marks along with the anonymous marks of their colleagues; a radiologist’s own marks then could be deleted, added, or left unchanged. This approach was developed to identify, as completely as possible, all nodules in a scan without requiring forced consensus. RESULTS: After the initial blinded read phase, a total of 71 lesions received “nodule ≥ 3mm” marks from at least one radiologist; however, all four radiologists assigned such marks to only 24 (33.8%) of these lesions. Following the unblinded reads, a total of 59 lesions were marked as “nodule ≥ 3 mm” by at least one radiologist. 27 (45.8%) of these lesions received such marks from all four radiologists, 3 (5.1%) were identified as such by three radiologists, 12 (20.3%) were identified by two radiologists, and 17 (28.8%) were identified by only a single radiologist. CONCLUSION: The two-phase image annotation process yields improved agreement among radiologists in the interpretation of nodules ≥ 3mm. Nevertheless, substantial variabilty remains across radiologists in the task of lung nodule identification

A randomised clinical trial of subgrouping and targeted treatment for low back pain compared with best current care. The STarT Back Trial Study Protocol

Back pain is a major health problem and many sufferers develop persistent symptoms. Detecting relevant subgroups of patients with non-specific low back pain has been highlighted as a priority area for research, as this could enable better secondary prevention through the targeting of prognostic indicators for persistent, disabling symptoms. We plan to conduct a randomised controlled trial to establish whether subgrouping using a novel tool, combined with targeted treatment, is better than best current care at reducing long-term disability from low back pain

Predictors of Enhancing Human Physical Attractiveness: Data from 93 Countries

People across the world and throughout history have gone to great lengths to enhance their physical appearance. Evolutionary psychologists and ethologists have largely attempted to explain this phenomenon via mating preferences and strategies. Here, we test one of the most popular evolutionary hypotheses for beauty-enhancing behaviors, drawn from mating market and parasite stress perspectives, in a large cross-cultural sample. We also test hypotheses drawn from other influential and non-mutually exclusive theoretical frameworks, from biosocial role theory to a cultural media perspective. Survey data from 93,158 human participants across 93 countries provide evidence that behaviors such as applying makeup or using other cosmetics, hair grooming, clothing style, caring for body hygiene, and exercising or following a specific diet for the specific purpose of improving ones physical attractiveness, are universal. Indeed, 99% of participants reported spending \u3e10 min a day performing beauty-enhancing behaviors. The results largely support evolutionary hypotheses: more time was spent enhancing beauty by women (almost 4 h a day, on average) than by men (3.6 h a day), by the youngest participants (and contrary to predictions, also the oldest), by those with a relatively more severe history of infectious diseases, and by participants currently dating compared to those in established relationships. The strongest predictor of attractiveness-enhancing behaviors was social media usage. Other predictors, in order of effect size, included adhering to traditional gender roles, residing in countries with less gender equality, considering oneself as highly attractive or, conversely, highly unattractive, TV watching time, higher socioeconomic status, right-wing political beliefs, a lower level of education, and personal individualistic attitudes. This study provides novel insight into universal beauty-enhancing behaviors by unifying evolutionary theory with several other complementary perspectives

The 2018 GaN power electronics roadmap

Gallium nitride (GaN) is a compound semiconductor that has tremendous potential to facilitate economic growth in a semiconductor industry that is silicon-based and currently faced with diminishing returns of performance versus cost of investment. At a material level, its high electric field strength and electron mobility have already shown tremendous potential for high frequency communications and photonic applications. Advances in growth on commercially viable large area substrates are now at the point where power conversion applications of GaN are at the cusp of commercialisation. The future for building on the work described here in ways driven by specific challenges emerging from entirely new markets and applications is very exciting. This collection of GaN technology developments is therefore not itself a road map but a valuable collection of global state-of-the-art GaN research that will inform the next phase of the technology as market driven requirements evolve. First generation production devices are igniting large new markets and applications that can only be achieved using the advantages of higher speed, low specific resistivity and low saturation switching transistors. Major investments are being made by industrial companies in a wide variety of markets exploring the use of the technology in new circuit topologies, packaging solutions and system architectures that are required to achieve and optimise the system advantages offered by GaN transistors. It is this momentum that will drive priorities for the next stages of device research gathered here