RevColV2: Exploring Disentangled Representations in Masked Image Modeling

Masked image modeling (MIM) has become a prevalent pre-training setup for vision foundation models and attains promising performance. Despite its success, existing MIM methods discard the decoder network during downstream applications, resulting in inconsistent representations between pre-training and fine-tuning and can hamper downstream task performance. In this paper, we propose a new architecture, RevColV2, which tackles this issue by keeping the entire autoencoder architecture during both pre-training and fine-tuning. The main body of RevColV2 contains bottom-up columns and top-down columns, between which information is reversibly propagated and gradually disentangled. Such design enables our architecture with the nice property: maintaining disentangled low-level and semantic information at the end of the network in MIM pre-training. Our experimental results suggest that a foundation model with decoupled features can achieve competitive performance across multiple downstream vision tasks such as image classification, semantic segmentation and object detection. For example, after intermediate fine-tuning on ImageNet-22K dataset, RevColV2-L attains 88.4% top-1 accuracy on ImageNet-1K classification and 58.6 mIoU on ADE20K semantic segmentation. With extra teacher and large scale dataset, RevColv2-L achieves 62.1 box AP on COCO detection and 60.4 mIoU on ADE20K semantic segmentation. Code and models are released at https://github.com/megvii-research/RevCo

Surface-neutralization engineered NiCo-LDH/phosphate hetero-sheets toward robust oxygen evolution reaction

Developing highly active oxygen evolution reaction (OER) electrocatalysts with robust durability is essential in producing high-purity hydrogen through water electrolysis. Layered double hydroxide (LDH) based catalysts have demonstrated efficient catalytic performance toward the relatively sluggish OER. By considering the promotion effect of phosphate (Pi) on proton transfer, herein, a facile phosphate acid (PA) surface-neutralization strategy is developed to in-situ construct NiCo-LDH/NiCoPi hetero-sheets toward OER catalysis. OER activity of NiCo-LDH is significantly boosted due to the proton promotion effect and the electronic modulation effect of NiCoPi. As a result, the facilely prepared NiCo-LDH/NiCoPi catalyst displays superior OER catalytic activity with a low overpotential of 300 mV to deliver 100 mA cm−2 OER and a Tafel slope of 73 mV dec−1. Furthermore, no visible activity decay is detected after a 200-h continuous OER operation. The present work, therefore, provides a promising strategy to exploit robust OER electrocatalysts for commercial water electrolysers

Research Progress of Vitamin D and Autoimmune Diseases

As a fat-soluble vitamin, Vitamin D is a necessary hormone to maintain normal physiological activities of the body. In recent years, vitamin D has been considered as a new neuroendocrine-immunomodulatory hormone, and researchers have paid more attention to the study of immune regulatory mechanism. It is not only related to calcium and phosphorus metabolism, bone metabolism and other important metabolic mechanisms of the body, but also closely related to the immune regulation mechanism of the body. Vitamin D deficiency caused by many factors can play a certain role in the development of autoimmune diseases. In this paper, the related mechanisms of vitamin D affecting autoimmune diseases were reviewed, with a view to expound the close correlation between vitamin D and autoimmune diseases, so as to find new diagnosis and treatment approaches for clinical autoimmune diseases and improve the quality of life of patients with autoimmune diseases

A Method of EV Detour-to-Recharge Behavior Modeling and Charging Station Deployment

Electric vehicles (EVs) are increasingly used in transportation. Worldwide use of EVs, for their limited battery capacity, calls for effective planning of EVs charging stations to enhance the efficiency of using EVs. This paper provides a methodology of describing EV detouring behavior for recharging, and based on this, we adopt the extra driving length caused by detouring and the length of uncompleted route as the indicators of evaluating an EV charging station deployment plan. In this way, we can simulate EV behavior based on travel data (demand). Then, a genetic algorithm (GA) based EV charging station sitting optimization method is developed to obtain an effective plan. A detailed case study based on a 100-node 203-branch transportation network within a 30 km * 30 km region is included to test the effectiveness of our method. Insights from our method may be applicable for charging station planning in various transportation networks

Advances in Single Nucleotide Polymorphisms of Vitamin D Metabolic Pathway Genes and Respiratory Diseases

Vitamin D is a fat-soluble vitamin. It is an essential vitamin for human body. It has a classical effect on regulating calcium and phosphorus metabolism. Participate in cellular and humoral immune processes by regulating the growth, differentiation and metabolism of immune cells. A large number of studies in recent years have shown that vitamin D deficiency increases the incidence of respiratory diseases. Respiratory diseases mainly include bronchial asthma, chronic obstructive pulmonary disease, tuberculosis, acute upper respiratory tract infection and pneumonia. Vitamin D metabolic pathway genes play a very important regulatory role in the transformation of vitamin D into active vitamin D, including CYP2R1,,CYP27B1, CYP24A1, VDBP, VDR five genes. Genetic polymorphism of genes is the molecular basis of individual differences and disease development. Therefore, this paper summarizes the research on single nucleotide polymorphism of vitamin D metabolic pathway gene and respiratory diseases. In order to provide a new idea for future treatment

Research Progress on the Relationship between Polymorphism and SLE of Vitamin D Metabolic Pathway Related Gene

Vitamin D is a class of hormones necessary to maintain normalphysiological activities of the body. A large number of studies have shownthat vitamin D, as a fat-soluble vitamin, is not only related to calcium andphosphorus metabolism, but also closely related to immune regulation,humoral regulation, cell cycle and so on. Systemic Lupus erythema-Tosus(SLE) is a specific autoimmune diffuse connective tissue disease thatcauses tissue and organ damage under the joint action of multiple factorssuch as environment and heredity. Among many factors, the vitamin Dmetabolism pathway gene is particularly important for its influence. Someliterature has shown that the genetic polymorphism of vitamin D metabolicpathway genes is correlated with SLE. Therefore, by referring to relevantliterature, this paper summarized the progress in the research on themechanism of genetic polymorphism of vitamin metabolism pathway genesand the development of SLE

YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design

The rapid development and wide utilization of object detection techniques have aroused attention on both accuracy and speed of object detectors. However, the current state-of-the-art object detection works are either accuracy-oriented using a large model but leading to high latency or speed-oriented using a lightweight model but sacrificing accuracy. In this work, we propose YOLObile framework, a real-time object detection on mobile devices via compression-compilation co-design. A novel block-punched pruning scheme is proposed for any kernel size. To improve computational efficiency on mobile devices, a GPU-CPU collaborative scheme is adopted along with advanced compiler-assisted optimizations. Experimental results indicate that our pruning scheme achieves 14$\times$ compression rate of YOLOv4 with 49.0 mAP. Under our YOLObile framework, we achieve 17 FPS inference speed using GPU on Samsung Galaxy S20. By incorporating our proposed GPU-CPU collaborative scheme, the inference speed is increased to 19.1 FPS, and outperforms the original YOLOv4 by 5$\times$ speedup. Source code is at: \url{https://github.com/nightsnack/YOLObile}