Breaking On-device Training Memory Wall: A Systematic Survey

On-device training has become an increasingly popular approach to machine learning, enabling models to be trained directly on mobile and edge devices. However, a major challenge in this area is the limited memory available on these devices, which can severely restrict the size and complexity of the models that can be trained. In this systematic survey, we aim to explore the current state-of-the-art techniques for breaking on-device training memory walls, focusing on methods that can enable larger and more complex models to be trained on resource-constrained devices. Specifically, we first analyze the key factors that contribute to the phenomenon of memory walls encountered during on-device training. Then, we present a comprehensive literature review of on-device training, which addresses the issue of memory limitations. Finally, we summarize on-device training and highlight the open problems for future research. By providing a comprehensive overview of these techniques and their effectiveness in breaking memory walls, we hope to help researchers and practitioners in this field navigate the rapidly evolving landscape of on-device training.Comment: 8 pages, 3 figure

Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-modal Language Models

While Multi-modal Language Models (MLMs) demonstrate impressive multimodal ability, they still struggle on providing factual and precise responses for tasks like visual question answering (VQA). In this paper, we address this challenge from the perspective of contextual information. We propose Causal Context Generation, Causal-CoG, which is a prompting strategy that engages contextual information to enhance precise VQA during inference. Specifically, we prompt MLMs to generate contexts, i.e, text description of an image, and engage the generated contexts for question answering. Moreover, we investigate the advantage of contexts on VQA from a causality perspective, introducing causality filtering to select samples for which contextual information is helpful. To show the effectiveness of Causal-CoG, we run extensive experiments on 10 multimodal benchmarks and show consistent improvements, e.g., +6.30% on POPE, +13.69% on Vizwiz and +6.43% on VQAv2 compared to direct decoding, surpassing existing methods. We hope Casual-CoG inspires explorations of context knowledge in multimodal models, and serves as a plug-and-play strategy for MLM decoding

Development and Deployment of High-Throughput Retrotransposon-Based Markers Reveal Genetic Diversity and Population Structure of Asian Bamboo

Bamboo, a non-timber grass species, known for exceptionally fast growth is a commercially viable crop. Long terminal repeat (LTR) retrotransposons, the main class I mobile genetic elements in plant genomes, are highly abundant (46%) in bamboo, contributing to genome diversity. They play significant roles in the regulation of gene expression, chromosome size and structure as well as in genome integrity. Due to their random insertion behavior, interspaces of retrotransposons can vary significantly among bamboo genotypes. Capitalizing this feature, inter-retrotransposon amplified polymorphism (IRAP) is a high-throughput marker system to study the genetic diversity of plant species. To date, there are no transposon based markers reported from the bamboo genome and particularly using IRAP markers on genetic diversity. Phyllostachys genus of Asian bamboo is the largest of the Bambusoideae subfamily, with great economic importance. We report structure-based analysis of bamboo genome for the LTR-retrotransposon superfamilies, Ty3-gypsy and Ty1-copia, which revealed a total of 98,850 retrotransposons with intact LTR sequences at both the ends. Grouped into 64,281 clusters/scaffold using CD-HIT-EST software, only 13 clusters of retroelements were found with more than 30 LTR sequences and with at least one copy having all intact protein domains such as gag and polyprotein. A total of 16 IRAP primers were synthesized, based on the high copy numbers of conserved LTR sequences. A study using these IRAP markers on genetic diversity and population structure of 58 Asian bamboo accessions belonging to the genus Phyllostachys revealed 3340 amplicons with an average of 98% polymorphism. The bamboo accessions were collected from nine different provinces of China, as well as from Italy and America. A three phased approach using hierarchical clustering, principal components and a model based population structure divided the bamboo accessions into four sub-populations, PhSP1, PhSP2, PhSP3 and PhSP4. All the three analyses produced significant sub-population wise consensus. Further, all the sub-populations revealed admixture of alleles. The analysis of molecular variance (AMOVA) among the sub-populations revealed high intra-population genetic variation (75%) than inter-population. The results suggest that Phyllostachys bamboos are not well evolutionarily diversified, although geographic speciation could have occurred at a limited level. This study highlights the usability of IRAP markers in determining the inter-species variability of Asian bamboos

Development and deployment of high-throughput retrotransposon-based markers reveal genetic diversity and population structure of Asian bamboo

Bamboo, a non-timber grass species, known for exceptionally fast growth, is a commercially viable crop. Long terminal repeat (LTR) retrotransposons, the main class I mobile genetic elements in plant genomes, are highly abundant (46%) in bamboo contributing to genome diversity. They play significant roles in the regulation of gene expression, chromosome size and structure as well as in genome integrity. Inter-retrotransposon amplified polymorphism (IRAP) is a high-throughput method to study the genetic diversity of plant species. Till date, there are no markers based on Transposable Elements (TEs) for the bamboo genome and no reports on bamboo genetic diversity using the IRAP method. Phyllostachys is an Asian bamboo, the largest group in the bamboo subfamily, Bambusoideae, and it is of great economic value due to its fast growth. The structure of LTR-retrotransposon superfamilies, Ty3-gypsy and Ty1-copia, were analysed in the bamboo genome using LTRharvest and LTRdigest software. A total of 98,850 LTR retrotransposons with both ends of intact LTR sequences were identified, grouped into 64,281 clusters/scaffolds, using CD-HIT software. Among the total of 64,281 clusters, 13 clusters had more than 30 copy numbers of LTR sequences and at least one copy had all intact protein domains such as gag protein and polyprotein. Based on the high copy numbers of conserved LTR sequences, a total of 16 IRAP primers were developed. All these IRAP primers were used to study the genetic diversity and population structure of the Asian bamboo. AMOVA analysis was done for 58 Asian bamboo species collected from nine different provinces of China, from Italy and America. In the bamboo species, these IRAP primers produced a total of 3340 amplicons with an average of 98% polymorphism. The 58 Asian bamboo species were grouped into two major clusters and four sub-clusters, based on UPGMA analysis. UPGMA cluster analysis was corroborated by statistical analyses of genetic similarity coefficients. Structure analysis showed that the bamboo species could be divided into four subpopulations (K = 4): SP1, SP2, SP3 and SP4. All SPs had an admixture of alleles. AMOVA analysis showed that higher genetic variations occurred within populations (75%) rather than among populations (25%). The study highlights the usability of IRAP in Asian bamboo to determine inter-species variability using retrotransposon markers.Peer reviewe

Development and Deployment of High-Throughput Retrotransposon-Based Markers Reveal Genetic Diversity and Population Structure of Asian Bamboo

Bamboo, a non-timber grass species, known for exceptionally fast growth is a commercially viable crop. Long terminal repeat (LTR) retrotransposons, the main class I mobile genetic elements in plant genomes, are highly abundant (46%) in bamboo, contributing to genome diversity. They play significant roles in the regulation of gene expression, chromosome size and structure as well as in genome integrity. Due to their random insertion behavior, interspaces of retrotransposons can vary significantly among bamboo genotypes. Capitalizing this feature, inter-retrotransposon amplified polymorphism (IRAP) is a high-throughput marker system to study the genetic diversity of plant species. To date, there are no transposon based markers reported from the bamboo genome and particularly using IRAP markers on genetic diversity. Phyllostachys genus of Asian bamboo is the largest of the Bambusoideae subfamily, with great economic importance. We report structure-based analysis of bamboo genome for the LTR-retrotransposon superfamilies, Ty3-gypsy and Ty1-copia, which revealed a total of 98,850 retrotransposons with intact LTR sequences at both the ends. Grouped into 64,281 clusters/scaffold using CD-HIT-EST software, only 13 clusters of retroelements were found with more than 30 LTR sequences and with at least one copy having all intact protein domains such as gag and polyprotein. A total of 16 IRAP primers were synthesized, based on the high copy numbers of conserved LTR sequences. A study using these IRAP markers on genetic diversity and population structure of 58 Asian bamboo accessions belonging to the genus Phyllostachys revealed 3340 amplicons with an average of 98% polymorphism. The bamboo accessions were collected from nine different provinces of China, as well as from Italy and America. A three phased approach using hierarchical clustering, principal components and a model based population structure divided the bamboo accessions into four sub-populations, PhSP1, PhSP2, PhSP3 and PhSP4. All the three analyses produced significant sub-population wise consensus. Further, all the sub-populations revealed admixture of alleles. The analysis of molecular variance (AMOVA) among the sub-populations revealed high intra-population genetic variation (75%) than inter-population. The results suggest that Phyllostachys bamboos are not well evolutionarily diversified, although geographic speciation could have occurred at a limited level. This study highlights the usability of IRAP markers in determining the inter-species variability of Asian bamboos

Advanced drilling detection and multi-information identification of water-conducting channel of coal floor

The coal floor develops various water-conducting channels, which seriously threaten the safe production of mines. In order to establish a more scientific multi-information identification technology system for the water-conducting channels in the coal floor, and prevent floor water inrush. Firstly, the principles of reasonable trajectory, reasonable target layer and exploration area maximization are proposed based on the characteristics of the water-conducting channels and the advantages of the ground directional drilling area exploration technology. Diversified types, unclear locations, and significant water inrush hazards are the characteristics of water-conducting channels. Secondly, the summary analysis is conducted on the exploration process of water diversion channels in areas such as HuaiBei Mining Area, Huainan Mining Area, Xingtai Mining Area, and Huanghebei Coal Field. When revealing the water-conducting channels, there are significant differences in visual indicators such as rock debris, drilling time, drilling fluid leakage, and confirmatory indicators such as permeability and grouting parameters compared to revealing normal formations. Therefore, the identification indicators of multi-information during the drilling process are divided into two types: qualitative and quantitative. Based on the variation amplitude of two qualitative indicators, rock debris and drilling time, when encountering water-conducting channels, it gives corresponding standard curves, and determines the classification system for water-conducting channel types. Subsequently, a comprehensive analysis is conducted on the changes in the two quantitative indicators of drilling fluid leakage and permeability when encountering water-conducting channels. 30 m3/h of drilling fluid leakage and 10 Lu of permeability are proposed as the classification criteria for conductivity. Based on this, a dual factor comprehensive classification system for water-conducting channels conductivity is established, and the conductivity is divided into four levels. Finally, taking a typical mine in the North China coalfield as a case study, the principle of exploration is adopted to explore the water-conducting channels. The multi-information identification technology is applied to successfully identify four faults, two karst fracture zones and a collapse in the detection area, and determines conductivity levels of water-conducting channels. The research results have guiding effect and important significance for improving the identification and control of water-conducting channels

Research on Three-Dimensional Simulation of the Internal Arc Gear Skiving

Aiming at the problems that the simulation accuracy which is reduced due to the simplification of the model, a three-dimensional simulation method based on solid modeling is being proposed. By analyzing the motion relationship and positional relationship between the caries knife and the workpiece, the coordinate system of the caries machining was established. With the MATLAB software, the cutting edge model and the blade sweeping surface model of the boring cutter are sequentially established. Boolean operation is performed on the blade swept surface formed by the tooth cutter teeth with time t and the workpiece tooth geometry as well as the undeformed three-dimensional chip geometry model and the instantaneous cogging geometry model are obtained at different times. Through the compare between gear end face simulation tooth profile and the theoretical inner arc tooth profile, we verified the accuracy and rationality of the proposed method

A Systematic RNAi Screen Reveals a Novel Role of a Spindle Assembly Checkpoint Protein BuGZ in Synaptic Transmission in C. elegans

Synaptic vesicles (SV) store various neurotransmitters that are released at the synapse. The molecular mechanisms of biogenesis, exocytosis, and endocytosis for SV, however, remain largely elusive. In this study, using Complex Object Parametric Analysis and Sorter (COPAS) to monitor the fluorescence of synapto-pHluorin (SpH), we performed a whole-genome RNAi screen in C. elegans to identify novel genetic modulators in SV cycling. One hundred seventy six genes that up-regulating SpH fluorescence and 96 genes that down-regulating SpH fluorescence were identified after multi-round screen. Among these genes, B0035.1 (bugz-1) encodes ortholog of mammalian C2H2 zinc-finger protein BuGZ/ZNF207, which is a spindle assembly checkpoint protein essential for mitosis in human cells. Combining electrophysiology, imaging and behavioral assays, we reveal that depletion of BuGZ-1 results in defects in locomotion. We further demonstrate that BuGZ-1 promotes SV recycling by regulating the expression levels of endocytosis-related genes such as rab11.1. Therefore, we have identified a bunch of potential genetic modulators in SV cycling, and revealed an unexpected role of BuGZ-1 in regulating synaptic transmission

A Metamaterial-Based Cross-Polarization Converter Characterized by Wideband and High Efficiency

Metamaterial-based polarization converters, which have all kinds of polarizations realizable via adjusting metamaterial parameters, have been springing up at an increasing rate. However, the reported metamaterial-based polarization converters suffer from either limited bandwidth or low polarization conversion ratios. In this study, a metamaterial-based polarization converter consisting of multilayer copper split-ring resonators and a copper ground separated by dielectrics was demonstrated and was characterized by the cross-polarization with wideband and high-efficiency. For normal incidence, the simulated results illustrated that the expanded bandwidth benefited from the superposition of cross-polarization electromagnetic resonances around 2.78, 3.09, 3.68, and 4.54 GHz, and the polarization conversion ratio was higher than 99% in the frequency range of 2.73 and 4.63 GHz. For oblique incidence, the design can provide larger angle tolerance in the investigated band, except for a very narrow stopband. Moreover, the experimental results agreed well with the simulations, which verified the reliability of the performance