1,486 research outputs found
Guided Hybrid Quantization for Object detection in Multimodal Remote Sensing Imagery via One-to-one Self-teaching
Considering the computation complexity, we propose a Guided Hybrid
Quantization with One-to-one Self-Teaching (GHOST}) framework. More concretely,
we first design a structure called guided quantization self-distillation
(GQSD), which is an innovative idea for realizing lightweight through the
synergy of quantization and distillation. The training process of the
quantization model is guided by its full-precision model, which is time-saving
and cost-saving without preparing a huge pre-trained model in advance. Second,
we put forward a hybrid quantization (HQ) module to obtain the optimal bit
width automatically under a constrained condition where a threshold for
distribution distance between the center and samples is applied in the weight
value search space. Third, in order to improve information transformation, we
propose a one-to-one self-teaching (OST) module to give the student network a
ability of self-judgment. A switch control machine (SCM) builds a bridge
between the student network and teacher network in the same location to help
the teacher to reduce wrong guidance and impart vital knowledge to the student.
This distillation method allows a model to learn from itself and gain
substantial improvement without any additional supervision. Extensive
experiments on a multimodal dataset (VEDAI) and single-modality datasets (DOTA,
NWPU, and DIOR) show that object detection based on GHOST outperforms the
existing detectors. The tiny parameters (<9.7 MB) and Bit-Operations (BOPs)
(<2158 G) compared with any remote sensing-based, lightweight or
distillation-based algorithms demonstrate the superiority in the lightweight
design domain. Our code and model will be released at
https://github.com/icey-zhang/GHOST.Comment: This article has been delivered to TRGS and is under revie
Orthopedic Center of Chinese PLA, Urumqi General Hospital of Lanzhou Military Region,
Sphingosine-1-phosphate is a possible fibrogenic factor in glutea
ViT-Calibrator: Decision Stream Calibration for Vision Transformer
A surge of interest has emerged in utilizing Transformers in diverse vision
tasks owing to its formidable performance. However, existing approaches
primarily focus on optimizing internal model architecture designs that often
entail significant trial and error with high burdens. In this work, we propose
a new paradigm dubbed Decision Stream Calibration that boosts the performance
of general Vision Transformers. To achieve this, we shed light on the
information propagation mechanism in the learning procedure by exploring the
correlation between different tokens and the relevance coefficient of multiple
dimensions. Upon further analysis, it was discovered that 1) the final decision
is associated with tokens of foreground targets, while token features of
foreground target will be transmitted into the next layer as much as possible,
and the useless token features of background area will be eliminated gradually
in the forward propagation. 2) Each category is solely associated with specific
sparse dimensions in the tokens. Based on the discoveries mentioned above, we
designed a two-stage calibration scheme, namely ViT-Calibrator, including token
propagation calibration stage and dimension propagation calibration stage.
Extensive experiments on commonly used datasets show that the proposed approach
can achieve promising results. The source codes are given in the supplements.Comment: 14pages, 12 figure
Robust beam splitter with fast quantum state transfer through a topological interface
The Su-Schrieffer-Heeger (SSH) model, commonly used for robust state
transfers through topologically protected edge pumping, has been generalized
and exploited to engineer diverse functional quantum devices. Here, we propose
to realize a fast topological beam splitter based on a generalized SSH model by
accelerating the quantum state transfer (QST) process essentially limited by
adiabatic requirements. The scheme involves delicate orchestration of the
instantaneous energy spectrum through exponential modulation of nearest
neighbor coupling strengths and onsite energies, yielding a significantly
accelerated beam splitting process. Due to properties of topological pumping
and accelerated QST, the beam splitter exhibits strong robustness against
parameter disorders and losses of system. In addition, the model demonstrates
good scalability and can be extended to two-dimensional crossed-chain
structures to realize a topological router with variable numbers of output
ports. Our work provides practical prospects for fast and robust topological
QST in feasible quantum devices in large-scale quantum information processing.Comment: To be published in Frontiers of Physic
Recommended from our members
Modulating Linker Composition of Haptens Resulted in Improved Immunoassay for Histamine.
Histamine (HA) is an important food contaminant generated during food fermentation or spoilage. However, an immunoassay for direct (derivatization free) determination of HA has rarely been reported due to its small size to induce the desired antibodies by its current hapten-protein conjugates. In this work, despite violating the classical hapten design criteria which recommend introducing a linear aliphatic (phenyl free) linker into the immunizing hapten, a novel haptens, HA-245 designed and synthesized with a phenyl-contained linker, exhibited significantly enhanced immunological properties. Thus, a quality-improved monoclonal antibody (Mab) against HA was elicited by its hapten-carrier conjugates. Then, as the linear aliphatic linker contained haptens, Hapten B was used as linker-heterologous coating haptens to eliminate the recognition of linker antibodies. Indirect competitive ELISA (ic-ELISA) was developed with a 50% inhibition concentration (IC50) of 0.21 mg/L and a limit of detection (LOD) of 0.06 mg/L in buffer solution. The average recoveries of HA from spiked food samples for this ic-ELISA ranged from 84.1% and 108.5%, and the analysis results agreed well with those of referenced LC-MS/MS. This investigation not only realized derivatization-free immunoassay for HA, but also provided a valuable guidance for hapten design and development of immunoassay for small molecules
Recommended from our members
Deletion of heat shock protein 60 in adult mouse cardiomyocytes perturbs mitochondrial protein homeostasis and causes heart failure.
To maintain healthy mitochondrial enzyme content and function, mitochondria possess a complex protein quality control system, which is composed of different endogenous sets of chaperones and proteases. Heat shock protein 60 (HSP60) is one of these mitochondrial molecular chaperones and has been proposed to play a pivotal role in the regulation of protein folding and the prevention of protein aggregation. However, the physiological function of HSP60 in mammalian tissues is not fully understood. Here we generated an inducible cardiac-specific HSP60 knockout mouse model, and demonstrated that HSP60 deletion in adult mouse hearts altered mitochondrial complex activity, mitochondrial membrane potential, and ROS production, and eventually led to dilated cardiomyopathy, heart failure, and lethality. Proteomic analysis was performed in purified control and mutant mitochondria before mutant hearts developed obvious cardiac abnormalities, and revealed a list of mitochondrial-localized proteins that rely on HSP60 (HSP60-dependent) for correctly folding in mitochondria. We also utilized an in vitro system to assess the effects of HSP60 deletion on mitochondrial protein import and protein stability after import, and found that both HSP60-dependent and HSP60-independent mitochondrial proteins could be normally imported in mutant mitochondria. However, the former underwent degradation in mutant mitochondria after import, suggesting that the protein exhibited low stability in mutant mitochondria. Interestingly, the degradation could be almost fully rescued by a non-specific LONP1 and proteasome inhibitor, MG132, in mutant mitochondria. Therefore, our results demonstrated that HSP60 plays an essential role in maintaining normal cardiac morphology and function by regulating mitochondrial protein homeostasis and mitochondrial function
- …