Dynamic Masking Rate Schedules for MLM Pretraining

Most works on transformers trained with the Masked Language Modeling (MLM) objective use the original BERT model's fixed masking rate of 15%. Our work instead dynamically schedules the masking ratio throughout training. We found that linearly decreasing the masking rate from 30% to 15% over the course of pretraining improves average GLUE accuracy by 0.46% in BERT-base, compared to a standard 15% fixed rate. Further analyses demonstrate that the gains from scheduling come from being exposed to both high and low masking rate regimes. Our results demonstrate that masking rate scheduling is a simple way to improve the quality of masked language models and achieve up to a 1.89x speedup in pretraining

Wireless Orbiter Hang-Angle Inclinometer System

A document describes a system to reliably gather the hang-angle inclination of the orbiter. The system comprises a wireless handheld master station (which contains the main station software) and a wireless remote station (which contains the inclinometer sensors, the RF transceivers, and the remote station software). The remote station is designed to provide redundancy to the system. It includes two RF transceivers, two power-management boards, and four inclinometer sensors

Efficacy of beveled tip aspiration catheter in mechanical thrombectomy for acute ischemic stroke

BACKGROUND: Direct aspiration thrombectomy techniques use large bore aspiration catheters for mechanical thrombectomy. Several aspiration catheters are now available. We report a bench top exploration of a novel beveled tip catheter and our experience in treating large vessel occlusions (LVOs) using next-generation aspiration catheters. METHODS: A retrospective analysis from a prospectively maintained database comparing the bevel shaped tip aspiration catheter versus non-beveled tip catheters was performed. Patient demographics, periprocedural metrics, and discharge and 90-day modified Rankin Scale (mRS) scores were collected. Patients were divided into two groups based on which aspiration catheter was used. RESULTS: Our data showed no significant difference in age, gender, IV tissue plasminogen activator administration, admission NIH Stroke Scale score, baseline mRS, or LVO location between the beveled tip and flat tip groups. With the beveled tip, Thrombolysis in Cerebral Infarction (TICI) 2C or better recanalization was more frequent overall (93.2% vs 74.2%, p=0.017), stent retriever usage was lower (9.1% vs 29%, p=0.024), and patients had lower mRS on discharge (median 3 vs 4, p \u3c 0.001) and at 90 days (median 2 vs 4, p=0.008). CONCLUSION: Patients who underwent mechanical thrombectomy with the beveled tip catheter had a higher proportion of TICI 2C or better and had a significantly lower mRS score on discharge and at 90 days

‘Making the invisible visible’ through alcohol screening and brief intervention in community pharmacies: an Australian feasibility study

Background: Screening and brief interventions (SBI) for alcohol related problems have been shown to be effective in health settings such as general practice or emergency departments. Recent data from the United Kingdom and New Zealand suggest that SBI can be delivered through community pharmacies, but this approach has not been tested in Australia. This study assesses the feasibility of delivering alcohol SBI via community pharmacists. Method: We recruited five pharmacies and developed an SBI training package to be delivered by pharmacy staff, who screened consumers and delivered the brief intervention where appropriate. Consumers also completed a questionnaire on the process. At three months consumers were telephoned to enable ‘retention’ to be quantified. After completing recruitment, a semi-structured interview was conducted with pharmacists on the process of delivering the intervention, potential improvements and sustainability. Results: Fifty consumer participants were screened, ten from each pharmacy. There were 28 (57 %) men and 21 (43 %) women with one not responding. Most (67 %) were aged 25-55 years. Their AUDIT scores had a range of 0 to 39 (mean 10.9, SD 9.8) with 11 categorised as ‘hazardous (8-15)’, four as ‘harmful (16-19)’ and eight as ‘probably dependent (20+)’ consumers of alcohol. Reactions to the process of SBI were generally favourable: for example 75 % agreed that it was either appropriate or very appropriate being asked about their alcohol consumption. With respect to follow-up interviews, 23 (46 %) agreed that they could be contacted, including five from the highest AUDIT category. Subsequently 11 (48 %) were contactable at three months. Three of the five non-low risk drinkers had reduced their level of risk over the three months. Ten pharmacists participated in semi-structured telephone interviews. Overall these pharmacists were positive about the intervention and five main themes emerged from the interviews: 1) flexibility applied in recruitment of participants, 2) easiness in use of AUDIT score to facilitate discussions, 3) perceived positive intervention impact, 4) enhanced role of community pharmacists and 5) facilitators and challenges experienced. Conclusions: Pharmacy-based SBI appears to be acceptable to consumers and feasible for pharmacy staff to deliver. Challenges remain in translating this potential into actual services

39 fJ/bit On-Chip Identification ofWireless Sensors Based on Manufacturing Variation

A 39 fJ/bit IC identification system based on FET mismatch is presented and implemented in a 130 nm CMOS process. ID bits are generated based on the ΔVT between identically drawn NMOS devices due to manufacturing variation, and the ID cell structure allows for the characterization of ID bit reliability by characterizing ΔVT . An addressing scheme is also presented that allows for reliable on-chip identification of ICs in the presence of unreliable ID bits. An example implementation is presented that can address 1000 unique ICs, composed of 31 ID bits and having an error rate less than 10-6, with up to 21 unreliable bits

A Java-based Server/Client Architecture that Enables Undergraduate Usage of Complex CAD Tools

Undergraduate electrical engineering education can be made more effective by exposing students to the types of computer--aided design tools that are used in industry. Often these tools are complex and expensive, making their use difficult, distracting, and possi- bly unrealistic for resource--poor institutions. A Java--based system to provide distributed electronic CAD services has been adopted in the classroom at Mississippi State. Named Java-CADD, it is able to overcome these obstacles by providing remote, simplified access to complex tools. Its architecture and pedagogical impact are assessed and discussed. Key Words: Education, Java, Client/Server, Worldwide Web, Computer--Aided Design, Digital Design I. Introduction, Survey of Existing Systems, and Background Electrical engineering education is attempting to produce graduates that can function successfully in the modern engineering environment. Rapid changes in the engineering environment, and in the ability of commun..

A mechanism for matrikine regulation in acute inflammatory lung injury

Proline-glycine-proline (PGP) and its acetylated form (Ac-PGP) are neutrophil chemoattractants generated by collagen degradation, and they have been shown to play a role in chronic inflammatory disease. However, the mechanism for matrikine regulation in acute inflammation has not been well established. Here, we show that these peptides are actively transported from the lung by the oligopeptide transporter, PEPT2. Following intratracheal instillation of Ac-PGP in a mouse model, there was a rapid decline in concentration of the labeled peptide in the bronchoalveolar lavage (BAL) over time and redistribution to extrapulmonary sites. In vitro knockdown of the PEPT2 transporter in airway epithelia or use of a competitive inhibitor of PEPT2, cefadroxil, significantly reduced uptake of Ac-PGP. Animals that received intratracheal Ac-PGP plus cefadroxil had higher levels of Ac-PGP in BAL and lung tissue. Utilizing an acute LPS-induced lung injury model, we demonstrate that PEPT2 blockade enhanced pulmonary Ac-PGP levels and lung inflammation. We further validated this effect using clinical samples from patients with acute lung injury in coculture with airway epithelia. This is the first study to our knowledge to determine the in vitro and in vivo significance of active matrikine transport as a mechanism of modulating acute inflammation and to demonstrate that it may serve as a potential therapeutic target

Mobile health contingency management for smoking cessation among veterans experiencing homelessness: A comparative effectiveness trial

Tobacco cessation is reduced in U.S. military veterans experiencing homelessness. Mobile contingency management (mCM) is a promising treatment for tobacco use among populations experiencing homelessness, but past CM studies have largely been small, have relied on in-person follow-up, and/or lacked long-term biochemically verified abstinence measures. Veterans who smoked and were experiencing homelessness (N = 127) were randomly assigned to mCM treatment (4 weeks of mCM, 5 weeks of telehealth counseling, and the option of 12 weeks of pharmacotherapy) or VA standard care (3 biweekly group sessions and clinically appropriate pharmacotherapy), and all participants were randomly assigned to a $100 longer-term financial incentive for abstinence at 3-month follow-up. Participants were followed at 3-, 6-, and 12-months post-randomization, with the a priori main outcome designated as biochemically verified prolonged abstinence (with lapses) at 6-month follow-up. At 6-months, participants in the mCM group were significantly more likely to meet criteria for prolonged abstinence (OR = 3.1). Across time points, veterans in the mCM group had twice the odds of prolonged abstinence as those in the standard care group. However, by the 12-month follow-up, there was no statistically significant group difference in abstinence. Cost-effectiveness analysis indicated a modest increase in cost ($1,133) associated with an increase of one quality-adjusted life year saved for the intervention compared to standard care. mCM is a cost-effective approach to smoking cessation among veterans experiencing homelessness. Considering waning potency of this and other tobacco cessation interventions at 12-month follow-up, it is crucial to implement strategies to sustain abstinence for individuals experiencing homelessness