163 research outputs found
RevColV2: Exploring Disentangled Representations in Masked Image Modeling
Masked image modeling (MIM) has become a prevalent pre-training setup for
vision foundation models and attains promising performance. Despite its
success, existing MIM methods discard the decoder network during downstream
applications, resulting in inconsistent representations between pre-training
and fine-tuning and can hamper downstream task performance. In this paper, we
propose a new architecture, RevColV2, which tackles this issue by keeping the
entire autoencoder architecture during both pre-training and fine-tuning. The
main body of RevColV2 contains bottom-up columns and top-down columns, between
which information is reversibly propagated and gradually disentangled. Such
design enables our architecture with the nice property: maintaining
disentangled low-level and semantic information at the end of the network in
MIM pre-training. Our experimental results suggest that a foundation model with
decoupled features can achieve competitive performance across multiple
downstream vision tasks such as image classification, semantic segmentation and
object detection. For example, after intermediate fine-tuning on ImageNet-22K
dataset, RevColV2-L attains 88.4% top-1 accuracy on ImageNet-1K classification
and 58.6 mIoU on ADE20K semantic segmentation. With extra teacher and large
scale dataset, RevColv2-L achieves 62.1 box AP on COCO detection and 60.4 mIoU
on ADE20K semantic segmentation. Code and models are released at
https://github.com/megvii-research/RevCo
Surface-neutralization engineered NiCo-LDH/phosphate hetero-sheets toward robust oxygen evolution reaction
Developing highly active oxygen evolution reaction (OER) electrocatalysts with robust durability is essential in producing high-purity hydrogen through water electrolysis. Layered double hydroxide (LDH) based catalysts have demonstrated efficient catalytic performance toward the relatively sluggish OER. By considering the promotion effect of phosphate (Pi) on proton transfer, herein, a facile phosphate acid (PA) surface-neutralization strategy is developed to in-situ construct NiCo-LDH/NiCoPi hetero-sheets toward OER catalysis. OER activity of NiCo-LDH is significantly boosted due to the proton promotion effect and the electronic modulation effect of NiCoPi. As a result, the facilely prepared NiCo-LDH/NiCoPi catalyst displays superior OER catalytic activity with a low overpotential of 300 mV to deliver 100 mA cm−2 OER and a Tafel slope of 73 mV dec−1. Furthermore, no visible activity decay is detected after a 200-h continuous OER operation. The present work, therefore, provides a promising strategy to exploit robust OER electrocatalysts for commercial water electrolysers
Research Progress of Vitamin D and Autoimmune Diseases
As a fat-soluble vitamin, Vitamin D is a necessary hormone to maintain normal physiological activities of the body. In recent years, vitamin D has been considered as a new neuroendocrine-immunomodulatory hormone, and researchers have paid more attention to the study of immune regulatory mechanism. It is not only related to calcium and phosphorus metabolism, bone metabolism and other important metabolic mechanisms of the body, but also closely related to the immune regulation mechanism of the body. Vitamin D deficiency caused by many factors can play a certain role in the development of autoimmune diseases. In this paper, the related mechanisms of vitamin D affecting autoimmune diseases were reviewed, with a view to expound the close correlation between vitamin D and autoimmune diseases, so as to find new diagnosis and treatment approaches for clinical autoimmune diseases and improve the quality of life of patients with autoimmune diseases
A Method of EV Detour-to-Recharge Behavior Modeling and Charging Station Deployment
Electric vehicles (EVs) are increasingly used in transportation. Worldwide
use of EVs, for their limited battery capacity, calls for effective planning of
EVs charging stations to enhance the efficiency of using EVs. This paper
provides a methodology of describing EV detouring behavior for recharging, and
based on this, we adopt the extra driving length caused by detouring and the
length of uncompleted route as the indicators of evaluating an EV charging
station deployment plan. In this way, we can simulate EV behavior based on
travel data (demand). Then, a genetic algorithm (GA) based EV charging station
sitting optimization method is developed to obtain an effective plan. A
detailed case study based on a 100-node 203-branch transportation network
within a 30 km * 30 km region is included to test the effectiveness of our
method. Insights from our method may be applicable for charging station
planning in various transportation networks
Advances in Single Nucleotide Polymorphisms of Vitamin D Metabolic Pathway Genes and Respiratory Diseases
Vitamin D is a fat-soluble vitamin. It is an essential vitamin for human body. It has a classical effect on regulating calcium and phosphorus metabolism. Participate in cellular and humoral immune processes by regulating the growth, differentiation and metabolism of immune cells. A large number of studies in recent years have shown that vitamin D deficiency increases the incidence of respiratory diseases. Respiratory diseases mainly include bronchial asthma, chronic obstructive pulmonary disease, tuberculosis, acute upper respiratory tract infection and pneumonia. Vitamin D metabolic pathway genes play a very important regulatory role in the transformation of vitamin D into active vitamin D, including CYP2R1,,CYP27B1, CYP24A1, VDBP, VDR five genes. Genetic polymorphism of genes is the molecular basis of individual differences and disease development. Therefore, this paper summarizes the research on single nucleotide polymorphism of vitamin D metabolic pathway gene and respiratory diseases. In order to provide a new idea for future treatment
Research Progress on the Relationship between Polymorphism and SLE of Vitamin D Metabolic Pathway Related Gene
Vitamin D is a class of hormones necessary to maintain normalphysiological activities of the body. A large number of studies have shownthat vitamin D, as a fat-soluble vitamin, is not only related to calcium andphosphorus metabolism, but also closely related to immune regulation,humoral regulation, cell cycle and so on. Systemic Lupus erythema-Tosus(SLE) is a specific autoimmune diffuse connective tissue disease thatcauses tissue and organ damage under the joint action of multiple factorssuch as environment and heredity. Among many factors, the vitamin Dmetabolism pathway gene is particularly important for its influence. Someliterature has shown that the genetic polymorphism of vitamin D metabolicpathway genes is correlated with SLE. Therefore, by referring to relevantliterature, this paper summarized the progress in the research on themechanism of genetic polymorphism of vitamin metabolism pathway genesand the development of SLE
YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
The rapid development and wide utilization of object detection techniques
have aroused attention on both accuracy and speed of object detectors. However,
the current state-of-the-art object detection works are either
accuracy-oriented using a large model but leading to high latency or
speed-oriented using a lightweight model but sacrificing accuracy. In this
work, we propose YOLObile framework, a real-time object detection on mobile
devices via compression-compilation co-design. A novel block-punched pruning
scheme is proposed for any kernel size. To improve computational efficiency on
mobile devices, a GPU-CPU collaborative scheme is adopted along with advanced
compiler-assisted optimizations. Experimental results indicate that our pruning
scheme achieves 14 compression rate of YOLOv4 with 49.0 mAP. Under our
YOLObile framework, we achieve 17 FPS inference speed using GPU on Samsung
Galaxy S20. By incorporating our proposed GPU-CPU collaborative scheme, the
inference speed is increased to 19.1 FPS, and outperforms the original YOLOv4
by 5 speedup. Source code is at:
\url{https://github.com/nightsnack/YOLObile}
- …