Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking

Recent work by Power et al. (2022) highlighted a surprising "grokking" phenomenon in learning arithmetic tasks: a neural net first "memorizes" the training set, resulting in perfect training accuracy but near-random test accuracy, and after training for sufficiently longer, it suddenly transitions to perfect test accuracy. This paper studies the grokking phenomenon in theoretical setups and shows that it can be induced by a dichotomy of early and late phase implicit biases. Specifically, when training homogeneous neural nets with large initialization and small weight decay on both classification and regression tasks, we prove that the training process gets trapped at a solution corresponding to a kernel predictor for a long time, and then a very sharp transition to min-norm/max-margin predictors occurs, leading to a dramatic change in test accuracy.Comment: Published as a conference paper at ICLR 2024; 40 pages, 4 figure

Autophagy Inhibition Enhances Daunorubicin-Induced Apoptosis in K562 Cells

Anthracycline daunorubicin (DNR) is one of the major antitumor agents widely used in the treatment of myeloid leukemia. Unfortunately, the clinical efficacy of DNR was limited because of its cytotoxity at high dosage. As a novel cytoprotective mechanism for tumor cell to survive under unfavorable conditions, autophagy has been proposed to play a role in drug resistance of tumor cells. Whether DNR can activate to impair the sensitivity of cancer cells remains unknown. Here, we first report that DNR can induce a high level of autophagy, which was associated with the activation of extracellular signal-regulated kinase 1/2 (ERK1/2). Moreover, cell death induced by DNR was greatly enhanced after autophagy inhibition by the pharmacological inhibitor chloroquine (CQ) and siRNAs targeting Atg5 and Atg7, the most important components for the formation of autophagosome. In conclusion, we found that DNR can induce cytoprotective autophagy by activation of ERK in myeloid leukemia cells. Autophagy inhibition thus represents a promising approach to improve the efficacy of DNR in the treatment of patients with myeloid leukemia

Clinical efficacy of the combined use of levofloxacin and different courses of isoniazid and rifampicin in the treatment of mild spinal tuberculosis

Purpose: To investigate the clinical effectiveness of the combined use of levofloxacin and different courses of isoniazid and rifampicin in the treatment of mild spinal tuberculosis (TB). Methods: The clinic data of 100 patients with light spinal TB were retrospectively reviewed. A double-blind technique was used to divide the patients into 6-month treatment group (M6 group, n = 32), 12-month treatment group (M12 group, n = 34) and 18-month treatment group (M18 group, n = 34). All patients were given isoniazid and rifampicin, in combination with levofloxacin. The effects of the different treatment courses on mild spinal TB were determined. Results: There were significantly higher post-treatment levels of inflammatory factors in M6 group than in M12 and M18 groups (p < 0.001). Moreover, there were significantly higher Visual Analogue Scale (VAS) score and erythrocyte sedimentation rate (ESR), and larger focus size in M6 group than in M12 and M18 groups (p < 0.05). However, after treatment, M18 group had significantly higher total incidence of adverse reactions than M6 and M12 groups (p < 0.05). Conclusion: Compared with the short-course treatment, long-course treatment with isoniazid and rifampicin in combination with levofloxacin is more effective in reducing the levels of inflammatory factors and decreasing focus size in patients with mild spinal TB. However, patients given the 18-month treatment tend to develop more adverse reactions. Therefore, 12-month treatment with the combined therapy is a better therapeutic option

Robust estimation of bacterial cell count from optical density

Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

Coupling Coordination of China’s Agricultural Environment and Economy under the New Economic Background

On the basis of the panel data of 31 provinces in China from 2011 to 2020, this paper first constructs an index system through the Pressure-State-Response (PSR) model and conducts a comprehensive evaluation of China’s agricultural environment according to the entropy weight TOPSIS model. Second, a coupling coordination degree model is established to calculate the degree of coupling coordination between the agricultural economy and the environment in each province. Finally, a spatial Durbin model is established to analyze the influencing factors of China’s agricultural economy. Results show that: ① the overall environment in the eastern region has little change, and the overall level is relatively backward; the agricultural environment in the central region is uneven; the agricultural environment in the western region is quite different from north to south. ② The regions with a high level of coupling coordination are mainly concentrated in the central and southern regions, and the performance is relatively intensive. The agricultural economy and the environment in the western region are extremely uncoordinated, and as is the overall coupling coordination between the agricultural economy and the environment in the eastern region in general. Further improvement is also needed. ③ Fixed asset investment, total power of agricultural machinery, rural electricity consumption, rural population, and rural per capita disposable income all have important influences on China’s agricultural economy. ④ The rural population size has a positive and the largest effect on the agricultural economy, whereas rural per capita disposable income has a negative effect on the agricultural economy. Moreover, improving farmers’ enthusiasm for farming is one of the key issues to be solved urgently