90 research outputs found
MultiQuant: A Novel Multi-Branch Topology Method for Arbitrary Bit-width Network Quantization
Arbitrary bit-width network quantization has received significant attention
due to its high adaptability to various bit-width requirements during runtime.
However, in this paper, we investigate existing methods and observe a
significant accumulation of quantization errors caused by frequent bit-width
switching of weights and activations, leading to limited performance. To
address this issue, we propose MultiQuant, a novel method that utilizes a
multi-branch topology for arbitrary bit-width quantization. MultiQuant
duplicates the network body into multiple independent branches and quantizes
the weights of each branch to a fixed 2-bit while retaining the input
activations in the expected bit-width. This approach maintains the
computational cost as the same while avoiding the switching of weight
bit-widths, thereby substantially reducing errors in weight quantization.
Additionally, we introduce an amortization branch selection strategy to
distribute quantization errors caused by activation bit-width switching among
branches to enhance performance. Finally, we design an in-place distillation
strategy that facilitates guidance between branches to further enhance
MultiQuant's performance. Extensive experiments demonstrate that MultiQuant
achieves significant performance gains compared to existing arbitrary bit-width
quantization methods. Code is at \url{https://github.com/zysxmu/MultiQuant}
Recommended from our members
Genetic and metabolic links between the murine microbiome and memory.
BackgroundRecent evidence has linked the gut microbiome to host behavior via the gut-brain axis [1-3]; however, the underlying mechanisms remain unexplored. Here, we determined the links between host genetics, the gut microbiome and memory using the genetically defined Collaborative Cross (CC) mouse cohort, complemented with microbiome and metabolomic analyses in conventional and germ-free (GF) mice.ResultsA genome-wide association analysis (GWAS) identified 715 of 76,080 single-nucleotide polymorphisms (SNPs) that were significantly associated with short-term memory using the passive avoidance model. The identified SNPs were enriched in genes known to be involved in learning and memory functions. By 16S rRNA gene sequencing of the gut microbial community in the same CC cohort, we identified specific microorganisms that were significantly correlated with longer latencies in our retention test, including a positive correlation with Lactobacillus. Inoculation of GF mice with individual species of Lactobacillus (L. reuteri F275, L. plantarum BDGP2 or L. brevis BDGP6) resulted in significantly improved memory compared to uninoculated or E. coli DH10B inoculated controls. Untargeted metabolomics analysis revealed significantly higher levels of several metabolites, including lactate, in the stools of Lactobacillus-colonized mice, when compared to GF control mice. Moreover, we demonstrate that dietary lactate treatment alone boosted memory in conventional mice. Mechanistically, we show that both inoculation with Lactobacillus or lactate treatment significantly increased the levels of the neurotransmitter, gamma-aminobutyric acid (GABA), in the hippocampus of the mice.ConclusionTogether, this study provides new evidence for a link between Lactobacillus and memory and our results open possible new avenues for treating memory impairment disorders using specific gut microbial inoculants and/or metabolites. Video Abstract
Amorphous 1-D nanowires of calcium phosphate/pyrophosphate : A demonstration of oriented self-growth of amorphous minerals
Amorphous inorganic solids are traditionally isotropic, thus, it is believed that they only grow in a non-preferential way without the assistance of regulators, leading to the morphologies of nanospheres or irregular aggregates of nanoparticles. However, in the presence of (ortho)phosphate (Pi) and pyrophosphate ions (PPi) which have synergistic roles in biomineralization, the highly elongated amorphous nanowires (denoted ACPPNs) form in a regulator-free aqueous solution (without templates, additives, organics, etc). Based on thorough characterization and tracking of the formation process (e.g., Cryo-TEM, spherical aberration correction high resolution TEM, solid state NMR, high energy resolution monochromated STEM-EELS), the microstructure and its preferential growth behavior are elucidated. In ACPPNs, amorphous calcium orthophosphate and amorphous calcium pyrophosphate are distributed at separated but close sites. The ACPPNs grow via either the preferential attachment of ∼2 nm nanoclusters in a 1-dimension way, or the transformation of bigger nanoparticles, indicating an inherent driving force-governed process. We propose that the anisotropy of ACPPNs microstructure, which is corroborated experimentally, causes their oriented growth. This study proves that, unlike the conventional view, amorphous minerals can form via oriented growth without external regulation, demonstrating a novel insight into the structures and growth behaviors of amorphous minerals
Roadmap on energy harvesting materials
Ambient energy harvesting has great potential to contribute to sustainable development and address growing environmental challenges. Converting waste energy from energy-intensive processes and systems (e.g. combustion engines and furnaces) is crucial to reducing their environmental impact and achieving net-zero emissions. Compact energy harvesters will also be key to powering the exponentially growing smart devices ecosystem that is part of the Internet of Things, thus enabling futuristic applications that can improve our quality of life (e.g. smart homes, smart cities, smart manufacturing, and smart healthcare). To achieve these goals, innovative materials are needed to efficiently convert ambient energy into electricity through various physical mechanisms, such as the photovoltaic effect, thermoelectricity, piezoelectricity, triboelectricity, and radiofrequency wireless power transfer. By bringing together the perspectives of experts in various types of energy harvesting materials, this Roadmap provides extensive insights into recent advances and present challenges in the field. Additionally, the Roadmap analyses the key performance metrics of these technologies in relation to their ultimate energy conversion limits. Building on these insights, the Roadmap outlines promising directions for future research to fully harness the potential of energy harvesting materials for green energy anytime, anywhere
A novel cloud based auxiliary medical system for hypertension management
© 2017 The Authors As a common disease, hypertension (HTN) can lead to severe complications such as heart failure, renal failure and stroke. However, delayed diagnosis often happens because of no obvious symptoms in earlier stage. This paper addresses the issue through a novel cloud based auxiliary medical system for HTN. Nowadays, telemedicine has been used to diagnose and monitor HTN by sharing and consulting personal health status with doctors. Its high flexibility and processing ability have helped to reduce the overall cost of medical care and enhanced the control rate. Technically, telemedicine uses communication, holographic imaging and computer science to achieve the management for long-distance patients. This paper presents a novel system based on cloud computing and mobile Internet, which can provide telemedicine services for HTN patients. This system could help patients reduce costs, provide flexible communication platform and powerful computing services, and also automatically collect patients’ blood pressure status. As an auxiliary medical system, the data of patients can be processed with instant status feedbacks in the cloud environment, thus patients can actually know their current cardiac status and take necessary measures for efficient management. Also, related doctors could help patients resolve mild symptoms out of office
Spatial transcriptomics deconvolution at single-cell resolution using Redeconve
Abstract Computational deconvolution with single-cell RNA sequencing data as reference is pivotal to interpreting spatial transcriptomics data, but the current methods are limited to cell-type resolution. Here we present Redeconve, an algorithm to deconvolute spatial transcriptomics data at single-cell resolution, enabling interpretation of spatial transcriptomics data with thousands of nuanced cell states. We benchmark Redeconve with the state-of-the-art algorithms on diverse spatial transcriptomics platforms and datasets and demonstrate the superiority of Redeconve in terms of accuracy, resolution, robustness, and speed. Application to a human pancreatic cancer dataset reveals cancer-clone-specific T cell infiltration, and application to lymph node samples identifies differential cytotoxic T cells between IgA+ and IgG+ spots, providing novel insights into tumor immunology and the regulatory mechanisms underlying antibody class switch
- …