VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

Scale is the primary factor for building a powerful foundation model that could well generalize to a variety of downstream tasks. However, it is still challenging to train video foundation models with billions of parameters. This paper shows that video masked autoencoder (VideoMAE) is a scalable and general self-supervised pre-trainer for building video foundation models. We scale the VideoMAE in both model and data with a core design. Specifically, we present a dual masking strategy for efficient pre-training, with an encoder operating on a subset of video tokens and a decoder processing another subset of video tokens. Although VideoMAE is very efficient due to high masking ratio in encoder, masking decoder can still further reduce the overall computational cost. This enables the efficient pre-training of billion-level models in video. We also use a progressive training paradigm that involves an initial pre-training on a diverse multi-sourced unlabeled dataset, followed by a post-pre-training on a mixed labeled dataset. Finally, we successfully train a video ViT model with a billion parameters, which achieves a new state-of-the-art performance on the datasets of Kinetics (90.0% on K400 and 89.9% on K600) and Something-Something (68.7% on V1 and 77.0% on V2). In addition, we extensively verify the pre-trained video ViT models on a variety of downstream tasks, demonstrating its effectiveness as a general video representation learner.Comment: CVPR 2023 camera-ready versio

Incidence of diarrhea caused by rotavirus infections in rural Zhengding, China: prospective, population-based surveillance.

Rotavirus is the pathogen most commonly associated with severe gastroenteritis in young children in the People's Republic of China, yet there are few population-based data on the incidence of rotavirus infection. The present study investigated the burden of rotavirus diarrhea and rotavirus infections in rural China, according to age. Population-based surveillance was used to study the incidence of rotavirus infection among children <5 years of age in 4 townships of Zhengding County, Hebei Province, China. The total population in the catchment area in 2002 was 75,630 individuals, including 2997 children aged <5 years. Stool samples were obtained and were tested for rotavirus antigen by use of an enzyme-linked immunosorbent assay. During 2002, a total of 2010 cases of diarrhea were detected among children <5 years of age. The incidence of treated cases of diarrhea was 671 cases/1000 children/year for children <5 years of age, and it was highest for children <12 months of age (1467 cases/1000 children/year). The estimated incidence of rotavirus infection was 151 cases/1000 children/year for children <5 years of age. The highest incidence of rotavirus infection was among children aged 1-2 years (340 cases/1000 children/year). Widespread immunization of children against rotavirus before 6 months of age should be considered for the control of rotavirus diarrhea

BGO quenching effect on spectral measurements of cosmic-ray nuclei in DAMPE experiment

The Dark Matter Particle Explorer (DAMPE) is a satellite-borne detector designed to measure high energy cosmic-rays and $\gamma$-rays. As a key sub-detector of DAMPE, the Bismuth Germanium Oxide (BGO) imaging calorimeter is utilized to measure the particle energy with a high resolution. The nonlinear fluorescence response of BGO for large ionization energy deposition, known as the quenching effect, results in an under-estimate of the energy measurement for cosmic-ray nuclei. In this paper, various models are employed to characterize the BGO quenching factors obtained from the experimental data of DAMPE. Applying the proper quenching model in the detector simulation process, we investigate the tuned energy responses for various nuclei and compare the results based on two different simulation softwares, i.e. GEANT4 and FLUKA. The BGO quenching effect results in a decrease of the measured energy by approximately $2.5\%$ ($5.7 \%$) for carbon (iron) at $\sim$10 GeV/n and $<1\%$ above 1 TeV/n, respectively. Accordingly, the correction of the BGO quenching effect leads to an increase of the low-energy flux measurement of cosmic-ray nuclei.Comment: 13 pages, 4 figures, to be published in Nuclear Inst. and Methods in Physics Research,

High remission and low relapse with prolonged intensive DMARD therapy in rheumatoid arthritis (PRINT): A multicenter randomized clinical trial

Objectives: To determine whether prolonged intensive disease-modifying antirheumatic drug (DMARD) treatment (PRINT) leads to high remission and low relapse rates in patients with severe rheumatoid arthritis (RA). Methods: In this multicenter, randomized and parallel treatment trial, 346 patients with active RA (disease activity score (28 joints) [DAS28] (erythrocyte sedimentation rate [ESR]) &gt; 5.1) were enrolled from 9 centers. In phase 1, patients received intensive treatment with methotrexate, leflunomide, and hydroxychloroquine, up to 36 weeks, until remission (DAS28 ≤ 2.6) or a low disease activity (2.6 &#60; DAS28 ≤ 3.2) was achieved. In phase 2, patients achieving remission or low disease activity were followed up with randomization to 1 of 2 step-down protocols: leflunomide plus hydroxychloroquine combination or leflunomide monotherapy. The primary endpoints were good European League Against Rheumatism (EULAR) response (DAS28 (ESR) &#60; 3.2 and a decrease of DAS28 by at least 1.2) during the intensive treatment and the disease state retention rate during step-down maintenance treatment. Predictors of a good EULAR response in the intensive treatment period and disease flare in the maintenance period were sought. Results: A good EULAR response was achieved in 18.7%, 36.9%, and 54.1% of patients at 12, 24, and 36 weeks, respectively. By 36 weeks, 75.4% of patients achieved good and moderate EULAR responses. Compared with those achieving low disease activity and a high health assessment questionnaire (HAQ &gt; 0.5), patients achieving remission (DAS28 ≤ 2.6) and low HAQ (≤ 0.5) had a significantly higher retention rate when tapering the DMARDs treatment (P = 0.046 and P = 0.01, respectively). There was no advantage on tapering to combination rather than monotherapy. Conclusions: Remission was achieved in a proportion of patients with RA receiving prolonged intensive DMARD therapy. Low disease activity at the start of disease taper leads to less subsequent flares. Leflunomide is a good maintenance treatment as single treatment

High Origin of Radial Arteries: A Report of Two Rare Cases

Variations in the arterial supply of the upper limb are relatively common, with reported prevalence rates ranging from 11 to 24.4%. Of these, the most commonly encountered variation in the arm is a high origin of the radial artery. However, after consecutively dissecting and examining 600 Singaporean Chinese cadavers (1,200 upper limbs), we found only two cases of this. In both cases, the brachioradial artery originated from the upper one-third of the brachial artery and continued distally as the radial artery in the forearm. The local prevalence of 0.33% of this variation is significantly lower compared against populations from other geographical regions. Although rare, recognition of the variation is of fundamental importance to clinical practice

Long-term satellite observations show continuous increase of vegetation growth enhancement in urban environment

Urbanization shows continuous expansion and development, ushering in the co-evolution of urban environments and vegetation over time. Recent remote sensing-based studies have discovered prevalent vegetation growth enhancement in urban environments. However, whether there is a temporal evolution of the growth enhancement remains unknown and unexplored. Here we expanded the existing framework for assessing the long-term impact of urbanization on vegetation greenness (enhanced vegetation index, EVI) using long time series of remote sensing images and applied it in Changsha, the capital city of Hunan province in China. Results showed that vegetation growth experienced widespread enhancement from 2000 to 2017, and increased 1.8 times from 2000 to 2017, suggesting strong continuous adaptive capability of vegetation to urban conditions. Although the overall impact of urbanization was negative due to the replacement of vegetated surfaces, the growth enhancement nevertheless offset or compensated the direct loss of vegetated cover during urbanization in the magnitude of 28% in 2000 to 44% in 2017. Our study also revealed large spatial heterogeneity in vegetation growth response among various districts at different urbanization levels and found an emergent trend under the observed spatial heterogeneity toward an asymptotic maximum with urbanization, showing EVI converges to 0.22 in highly urbanized areas. We further found that the positive effect of urbanization on vegetation growth is a function of urbanization intensity and time, which implies that the effect of the urban environment on vegetation can be simulated and predicted, and can be verified in more cities in the future. Our study is the first to successfully quantify long-term spatial patterns on the co-evolution of urbanization and vegetation, providing a new understanding of the continuous adaptive responses of vegetation growth to urbanization and shedding light on predicting 24 biological responses to future environmental change

Loss of Scribble confers cisplatin resistance during NSCLC chemotherapy via Nox2/ROS and Nrf2/PD-L1 signaling

Background: Cisplatin resistance remains a major clinical obstacle to the successful treatment of non-small cell lung cancer (NSCLC). Scribble contributes to ROS-induced inflammation and cisplatin-elevated toxic reactive oxygen species (ROS) promotes cell death. However, it is unknown whether and how Scribble is involved in the cisplatin-related cell death and the underlying mechanism of Scribble in response to chemotherapies and in the process of oxidative stress in NSCLC. Methods: We used two independent cohorts of NSCLC samples derived from patients treated with platinumcontaining chemotherapy and xenograft modeling in vivo. We analyzed the correlation between Scribble and Nox2 or Nrf2/PD-L1 both in vivo and in vitro, and explored the role of Scribble in cisplatin-induced ROS and apoptosis. Findings: Clinical analysis revealed that Scribble expression positively correlatedwith clinical outcomes and chemotherapeutic sensitivity in NSCLC patients. Scribble protected Nox2 protein from proteasomal degradation. Scribble knockdown induced cisplatin resistance by blocking Nox2/ROS and apoptosis in LRR domaindependent manner. In addition, low levels of Scribble correlated with high levels of PD-L1 via activation of Nrf2 transcription in vivo and in vitro. Interpretations: Our study revealed that polarity protein Scribble increased cisplatin-induced ROS generation and is beneficial to chemotherapeutic outcomes in NSCLC. Although Scribble deficiency tends to lead to cisplatin resistance by Nox2/ROS and Nrf2

Accurate Prediction of ncRNA-Protein Interactions From the Integration of Sequence and Evolutionary Information

Non-coding RNA (ncRNA) plays a crucial role in numerous biological processes including gene expression and post-transcriptional gene regulation. The biological function of ncRNA is mostly realized by binding with related proteins. Therefore, an accurate understanding of interactions between ncRNA and protein has a significant impact on current biological research. The major challenge at this stage is the waste of a great deal of redundant time and resource consumed on classification in traditional interaction pattern prediction methods. Fortunately, an efficient classifier named LightGBM can solve this difficulty of long time consumption. In this study, we employed LightGBM as the integrated classifier and proposed a novel computational model for predicting ncRNA and protein interactions. More specifically, the pseudo-Zernike Moments and singular value decomposition algorithm are employed to extract the discriminative features from protein and ncRNA sequences. On four widely used datasets RPI369, RPI488, RPI1807, and RPI2241, we evaluated the performance of LGBM and obtained an superior performance with AUC of 0.799, 0.914, 0.989, and 0.762, respectively. The experimental results of 10-fold cross-validation shown that the proposed method performs much better than existing methods in predicting ncRNA-protein interaction patterns, which could be used as a useful tool in proteomics research