LLMCad: Fast and Scalable On-device Large Language Model Inference

Generative tasks, such as text generation and question answering, hold a crucial position in the realm of mobile applications. Due to their sensitivity to privacy concerns, there is a growing demand for their execution directly on mobile devices. Currently, the execution of these generative tasks heavily depends on Large Language Models (LLMs). Nevertheless, the limited memory capacity of these devices presents a formidable challenge to the scalability of such models. In our research, we introduce LLMCad, an innovative on-device inference engine specifically designed for efficient generative Natural Language Processing (NLP) tasks. The core idea behind LLMCad revolves around model collaboration: a compact LLM, residing in memory, takes charge of generating the most straightforward tokens, while a high-precision LLM steps in to validate these tokens and rectify any identified errors. LLMCad incorporates three novel techniques: (1) Instead of generating candidate tokens in a sequential manner, LLMCad employs the smaller LLM to construct a token tree, encompassing a wider range of plausible token pathways. Subsequently, the larger LLM can efficiently validate all of these pathways simultaneously. (2) It employs a self-adjusting fallback strategy, swiftly initiating the verification process whenever the smaller LLM generates an erroneous token. (3) To ensure a continuous flow of token generation, LLMCad speculatively generates tokens during the verification process by implementing a compute-IO pipeline. Through an extensive series of experiments, LLMCad showcases an impressive token generation speed, achieving rates up to 9.3x faster than existing inference engines

The early Neoproterozoic Andean-Type Orogenic and Within-Plate Magmatic events in the northern margin of the Yangtze Craton during the convergence of the Rodinia Supercontinent

Although considered a crucial component of the Rodinia supercontinent, it remains uncertain how the Yangtze craton relates to the accretion and breakup of Rodinia. Here, the Huanglingmiao granitic complex (HGC), an intermediate-acid rock series that intruded on the southern Kongling terrane of the northern Yangtze craton margin, is investigated to help resolve this conundrum. Our analysis indicates that these rocks consist of tonalite, trondhjemite, granodiorite, oligoporphyritic granodiorite, porphyric biotite granodiorite, and fine- to medium-grained granodiorite dyke compositions. Collectively, this assemblage is further subdivided into two categories by their temporal, spatial, and geochemical features into early TTG-like and later granitic–dioritic units, which are composed of tonalite, trondhjemite, granodiorite, porphyritic granodiorite, and the fine- to medium-grained granodiorite dykes, respectively. Zircon U-Pb dating yields ages of 865~850 Ma for the TTG-like rocks, 844~825 Ma for the porphyritic granodiorites, and ~800 Ma for the granodiorite dykes. Combined with geochemical evidence, the data suggest that the early- and late-series rocks were formed by a partial melting of Mesoproterozoic and Paleoproterozoic crustal materials, respectively, suggesting that the vertical layering of the crust controlled the composition of the independent units. In addition, isotopic evidence points to different sources for the various rocks in the Kongling terrane and that mantle-derived materials influenced the early-series lithologies. Combined with previous studies on the northern margin of the Yangtze craton, it is inferred that the early-series rocks formed in an active continental margin environment, while the late-series rocks display within-plate boundary formation characteristics. The multiple magmatic activities revealed by this study record sequential partial melting with tectonic transition characteristics from an Andean-type to within-plate magmatism in the northern margin of the Yangtze craton. Taken together, these observations point to a strong association between these rocks, convergence, and incorporation of the northern Yangtze craton margin into the Rodinia supercontinent during the Tonian Period

Targeted synthesis of an electroactive organic framework

A new strategy for targeted design and synthesis of an electroactive microporous organic molecular sieve (JUC-Z2) is described. Experiment demonstrated that such a targeted synthesis approach to achieve phenyl-phenyl coupling was a controllable process and predominately generated two-dimensional polymer sheets, significantly different from the traditional chemical or electrochemical oxidation methods to prepare conducting polymers. Successive self-assembly leads to a lamellar organic framework comprised of stacked polymer sheets with an hcb topology. JUC-Z2 was found to have a well-defined uniform micropore distribution (similar to 1.2 nm), a large surface area (BET = 2081 m(2) g(-1)) and high physicochemical stability (> 440 degrees C). After doping with I(2), JUC-Z2 exhibits typical p-type semiconductive properties. As the first example of an electroactive organic framework, JUC-Z2 possesses a unique ability of electrochemical ion recognition, arising from the synergistic function of the uniform micropores and the N-atom redox site.State Basic Research Project[2011CB808703]; NSFC[91022030, 20771041, 20773101, 20833005]; "111'' project[B07016]; Ministry of Science and Technology[2006DFA41190]; Jilin Science and Technology Department[20106021

A Bibliometric and Visualization Analysis of Motor Learning in Preschoolers and Children over the Last 15 Years

Motor learning enables preschoolers and children to acquire fundamental skills that are critical to their development. The current study sought to conduct a bibliometric and visualization analysis to provide a comprehensive overview of motor-learning progress in preschoolers and children over the previous 15 years. The number of studies is constantly growing, with the United States and Australia, as well as other productive institutions and authors, at the leading edge. The dominant disciplines were Neurosciences and Neurology, Psychology, Rehabilitation, and Sport Sciences. The journals Developmental Medicine & Child Neurology, Human Movement Science, Physical Therapy, Neuropsychology, Journal of Motor Behavior, and Journal of Experimental Child Psychology have been the most productive and influential in this regard. The most common co-citations for clinical symptoms were for cerebral palsy, developmental coordination disorder, and autism. Research has focused on language impairment (speech disorders, explicit learning, and instructor-control feedback), as well as effective intervention strategies. Advances in brain mechanisms and diagnostic indicators, as well as new intervention and rehabilitation technologies (virtual reality, transcranial magnetic stimulation, and transcranial direct current stimulation), have shifted research frontiers and progress. The cognitive process is critical in intervention, rehabilitation, and new technology implementation and should not be overlooked. Overall, our broad overview identifies three major areas: brain mechanism research, clinical practice (intervention and rehabilitation), and new technology application

Power and Voltage Control for Single-Phase Cascaded H-Bridge Multilevel Converters under Unbalanced Loads

The conventional control method for a single-phase cascaded H-bridge (CHB) multilevel converter is vector (dq) control; however, dq control requires complicated calculations and additional time delays. This paper presents a novel power control strategy for the CHB multilevel converter. A power-based dc-link voltage balance control is also proposed for unbalanced load conditions. The new control method is designed in a virtual αβ stationary reference frame without coordinate transformation or phase-locked loop (PLL) to avoid the potential issues related to computational complexity. Because only imaginary voltage construction is needed in the proposed control method, the time delay from conventional imaginary current construction can be eliminated. The proposed method can obtain a sinusoidal grid current waveform with unity power factor. Compared with the conventional dq control method, the power control strategy possesses the advantage of a fast dynamic response. The stability of the closed-loop system with the dc-link voltage balance controller is evaluated. Simulation and experimental results are presented to verify the accuracy of the proposed power and voltage control method

Evaluation and Construction of Regional Ecological Network Based on Multi-Objective Optimization: A Perspective of Mountains–Rivers–Forests–Farmlands–Lakes–Grasslands Life Community Concept in China

Landscape degradation and habitat fragmentation are some of the most urgent environmental problems associated with human development and regional integrated planning. Regional ecological network planning involves connecting high-quality habitats and reducing the negative impact of landscape fragmentation on the remaining natural patches through structural and functional connectivity. The concept of “mountains–rivers–forests–farmlands–lakes–grasslands life community”, as a system concept to solve the whole problem of regional ecological network in China, associates all natural ecological factors and ecological relations through a systematic pattern, emphasizing the systematicness and integrality of ecological environment protection. This study, based on the progress of the study of “mountains–rivers–forests–farmlands–lakes–grasslands life community” and ecological network, clarifies the intrinsic connection and systemic relationship between humans and natural resources, and it clarifies the importance of multi-objective ecological network construction for the integrated development of resources in the whole region. Taking the Taishan area as the study subject, the ecological network construction approach of “risk assessment–source identification–corridor extraction–node selection” was constructed from three objectives—ecological systemic structure, ecological process integrity and ecological service efficiency—based on morphological spatial pattern analysis, minimum cumulative resistance model, gravity model and other modeling methods. The findings of this study can provide the evidence and clarification for the construction of a regional ecological network in China