BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

We show that with small-to-medium training data, fine-tuning only the bias terms (or a subset of the bias terms) of pre-trained BERT models is competitive with (and sometimes better than) fine-tuning the entire model. For larger data, bias-only fine-tuning is competitive with other sparse fine-tuning methods. Besides their practical utility, these findings are relevant for the question of understanding the commonly-used process of finetuning: they support the hypothesis that finetuning is mainly about exposing knowledge induced by language-modeling training, rather than learning new task-specific linguistic knowledge

Practical uses of genetic profile assessment in athletic training – an illustrative case study

Recent studies suggested that several potential genes may explain athletic success. However, while genetic assessment will probably become part of future talent identification, at present, genetic testing predictive value is poor, mainly because athletic success depends on a combination of genetic, physiological, behavioral and environmental factors (including coaching, medical, nutritional, psychological, equipment, facilities and administrative aspects). However, one should consider genetic testing not only for talent identification or sport event selection, but also for possible assistance in the training process itself. In the present case study we show an example of potential practical use of genetic profile assessment for improving the athletic training process. We deliberately chose a case study of a national-level athlete to show that genetic aid should not be limited to top world-class athletes

The AGT M235T (RS699, 4072T>C) polymorphism is not associated with elite weightlifting performance

It is now well established that genetic background influences an athlete’s ability to excel in different sport disciplines. Previous studies have demonstrated that among power athletes, single nucleotide polymorphism (SNP) in the AGT genotype (Thr-Thr), was significantly more prevalent among weightlifters compared to sprinters and jumpers indicating that despite the common features of these sport subtypes (short and very intense), they vary in their strength and speed abilities, as well as in their genetic make-up. The aim of the present study was to assess whether the AGT SNP can be used also to distinguish elite from national levels weightlifters. The AGT M235T genotype frequencies were assessed in 47 weightlifters (30 elite, 17 national level) and 86 non-athletes control. The Thr-Thr genotype was significantly higher among weightlifters (29.8%) compared to controls (12.8%) (p=0.048). Thr allele frequency was significantly higher among weightlifters (55.3%) compared to controls (37.8%) (p=0.021). However, there was no difference in the prevalence of the polymorphism between national level and elite athletes. In conclusion, the results suggest that the AGT polymorphism cannot predict elite competitive weightlifting performance

Prevalence of ACSL (rs6552828) polymorphism among runners

The ACSL A/G polymorphism is associated with endurance trainability. Previous studies have demonstrated that homozygotes of the minor AA allele had a reduced maximal oxygen consumption response to training compared to the common GG allele homozygotes, and that the ACSL A/G single nucleotide polymorphism explained 6.1% of the variance in the VO2max response to endurance training. The contribution of ACSL single nucleotide polymorphism to endurance trainability was shown in nonathletes, however, its potential role in professional athletes is not clear. Moreover, the genetic basis to anaerobic trainability is even less studied. Therefore, the aim of the present study was to examine the prevalence of ACSL single nucleotide polymorphism among professional Israeli long distance runners (n=59), middle distance runners (n=31), sprinters and jumpers (n=48) and non-athletic controls (n=60). The main finding of the present study was that the ACSL1 AA genotype, previously shown to be associated with reduced endurance trainability, was not higher among sprinters and jumpers (15%) compared to middle- (16%) and long-distance runners (15%). This suggests that in contrast to previous studies indicating that the ACSL1 single nucleotide polymorphism may influence endurance trainability among non-athletic individuals, the role of this polymorphism among professional athletes is still not clear

Changes in Aerobic and Anaerobic Performance Capabilities Following Different Interval-Training Programs

The aim of the study was to compare the effect of an increasing-distance interval-training program and a decreasing-distance interval-training program, matched for total distance, on aerobic and anaerobic performance capabilities. Forty physical education students were randomly assigned to either increasing- or decreasing-distance interval-training group (ITG and DTG), and completed two similar sets of tests before and after six weeks of training. One training program consisted of 100 – 200 – 300 – 400 – 500m running intervals, and the other 500 – 400 – 300 – 200 - 100m. While both training programs led to a significant improvement in 2000m run (ES = 0.02-0.68), the improvement in the DTG was significantly greater than in the ITG (18.3 ± 3.6 vs. 12.2 ± 3.2 %, p< 0.05). In addition, while both training programs led to a significant improvement in 300m run (ES = 0.25-0.73), the improvement in the DTG was significantly greater than in the ITG (21.1 ± 1.8 vs. 15.4 ± 1.1 %, p< 0.05). The findings indicate that beyond the significant positive effects of both training programs, the DTG showed significant superiority over the ITG in improving aerobic and anaerobic performance capabilities. Athletes should acknowledge that, in spite of identical total work, interval-training program might induce different physiological impacts if order of intervals is different

In Situ Photodegradation of Incorporated Polyanion Does Not Alter Prion Infectivity

Single-stranded polyanions ≥40 bases in length facilitate the formation of hamster scrapie prions in vitro, and polyanions co-localize with PrPSc aggregates in vivo [1], [2]. To test the hypothesis that intact polyanionic molecules might serve as a structural backbone essential for maintaining the infectious conformation(s) of PrPSc, we produced synthetic prions using a photocleavable, 100-base oligonucleotide (PC-oligo). In serial Protein Misfolding Cyclic Amplification (sPMCA) reactions using purified PrPC substrate, PC-oligo was incorporated into physical complexes with PrPSc molecules that were resistant to benzonase digestion. Exposure of these nuclease-resistant prion complexes to long wave ultraviolet light (315 nm) induced degradation of PC-oligo into 5 base fragments. Light-induced photolysis of incorporated PC-oligo did not alter the infectivity of in vitro-generated prions, as determined by bioassay in hamsters and brain homogenate sPMCA assays. Neuropathological analysis also revealed no significant differences in the neurotropism of prions containing intact versus degraded PC-oligo. These results show that polyanions >5 bases in length are not required for maintaining the infectious properties of in vitro-generated scrapie prions, and indicate that such properties are maintained either by short polyanion remnants, other co-purified cofactors, or by PrPSc molecules alone

Role of the monocarboxylate transporter MCT1 in the uptake of lactate during active recovery

Purpose We assessed the role of monocarboxylate transporter 1 (MCT1) on lactate clearance during an active recovery after high-intensity exercise, by comparing genetic groups based on the T1470A (rs1049434) MCT1 polymorphism, whose influence on lactate transport has been proven. Methods Sixteen young male elite field hockey players participated in this study. All of them completed two 400 m maximal run tests performed on different days, followed by 40 min of active or passive recovery. Lactate samples were measured immediately after the tests, and at min 10, 20, 30 and 40 of the recoveries. Blood lactate decreases were calculated for each 10-min period. Participants were distributed into three groups according to the T1470A polymorphism (TT, TA and AA). Results TT group had a lower blood lactate decrease than AA group during the 10?20 min period of the active recovery (p = 0.018). This period had the highest blood lactate for the whole sample, significantly differing from the other periods (p ? 0.003). During the passive recovery, lactate declines were constant except for the 0?10-min period (p ? 0.003), suggesting that liver uptake is similar in all the genetic groups, and that the difference seen during the active recovery is mainly due to muscle lactate uptake. Conclusions These differences according to the polymorphic variant T1470A suggest that MCT1 affects the plasma lactate decrease during a crucial period of active recovery, where the maximal lactate amount is cleared (i.e. 10?20 min period)

Systemic inflammation in chronic obstructive pulmonary disease: a population-based study

<p>Abstract</p> <p>Background</p> <p>Elevated circulating levels of several inflammatory biomarkers have been described in selected patient populations with COPD, although less is known about their population-based distribution. The aims of this study were to compare the levels of several systemic biomarkers between stable COPD patients and healthy subjects from a population-based sample, and to assess their distribution according to clinical variables.</p> <p>Methods</p> <p>This is a cross-sectional study design of participants in the EPI-SCAN study (40-80 years of age). Subjects with any other condition associated with an inflammatory process were excluded. COPD was defined as a post-bronchodilator FEV₁/FVC < 0.70. The reference group was made of non-COPD subjects without respiratory symptoms, associated diseases or prescription of medication. Subjects were evaluated with quality-of-life questionnaires, spirometry and 6-minute walk tests. Serum C-reactive protein (CRP), tumor necrosis factor (TNF)-α, interleukins (IL-6 and IL-8), alpha1-antitrypsin, fibrinogen, albumin and nitrites/nitrates (NOx) were measured.</p> <p>Results</p> <p>We compared 324 COPD patients and 110 reference subjects. After adjusting for gender, age, BMI and tobacco consumption, COPD patients showed higher levels of CRP (0.477 ± 0.023 vs. 0.376 ± 0.041 log mg/L, p = 0.049), TNF-α (13.12 ± 0.59 vs. 10.47 ± 1.06 pg/mL, p = 0.033), IL-8 (7.56 ± 0.63 vs. 3.57 ± 1.13 pg/ml; p = 0.033) and NOx (1.42 ± 0.01 vs. 1.36 ± 0.02 log nmol/l; p = 0.048) than controls. In COPD patients, serum concentrations of some biomarkers were related to severity and their exercise tolerance was related to serum concentrations of CRP, IL-6, IL-8, fibrinogen and albumin.</p> <p>Conclusions</p> <p>Our results provide population-based evidence that COPD is independently associated with low-grade systemic inflammation, with a different inflammatory pattern than that observed in healthy subjects.</p

Time to Optimize Supplementation: Modifying Factors Influencing the Individual Responses to Extracellular Buffering Agents.

Blood alkalosis, as indicated by an increased blood bicarbonate concentration and pH, has been shown to be beneficial for exercise performance. Sodium bicarbonate, sodium citrate, and sodium or calcium lactate, can all result in increased circulating bicarbonate and have all independently been shown to improve exercise capacity and performance under various circumstances. Although there is considerable evidence demonstrating the efficacy of these supplements in several sports-specific situations, it is commonly acknowledged that their efficacy is equivocal, due to contrasting evidence. Herein, we discuss the physiological and environmental factors that may modify the effectiveness of these supplements including, (i) absolute changes in circulating bicarbonate; (ii) supplement timing, (iii) the exercise task performed, (iv) monocarboxylate transporter (MCT) activity; (v) training status, and (vi) associated side-effects. The aim of this narrative review is to highlight the factors which may modify the response to these supplements, so that individuals can use this information to attempt to optimize supplementation and allow the greatest possibility of an ergogenic effect

Derivation of Xeno-Free and GMP-Grade Human Embryonic Stem Cells – Platforms for Future Clinical Applications

Clinically compliant human embryonic stem cells (hESCs) should be developed in adherence to ethical standards, without risk of contamination by adventitious agents. Here we developed for the first time animal-component free and good manufacturing practice (GMP)-compliant hESCs. After vendor and raw material qualification, we derived xeno-free, GMP-grade feeders from umbilical cord tissue, and utilized them within a novel, xeno-free hESC culture system. We derived and characterized three hESC lines in adherence to regulations for embryo procurement, and good tissue, manufacturing and laboratory practices. To minimize freezing and thawing, we continuously expanded the lines from initial outgrowths and samples were cryopreserved as early stocks and banks. Batch release criteria included DNA-fingerprinting and HLA-typing for identity, characterization of pluripotency-associated marker expression, proliferation, karyotyping and differentiation in-vitro and in-vivo. These hESCs may be valuable for regenerative therapy. The ethical, scientific and regulatory methodology presented here may serve for development of additional clinical-grade hESCs