842 research outputs found
Identification of a novel nuclear export sequence of OREBP / TonEBP / NFAT5 that controls cytoplasmic localization
published_or_final_versio
A Quantitative Review on Language Model Efficiency Research
Language models (LMs) are being scaled and becoming powerful. Improving their
efficiency is one of the core research topics in neural information processing
systems. Tay et al. (2022) provided a comprehensive overview of efficient
Transformers that have become an indispensable staple in the field of NLP.
However, in the section of "On Evaluation", they left an open question "which
fundamental efficient Transformer one should consider," answered by "still a
mystery" because "many research papers select their own benchmarks."
Unfortunately, there was not quantitative analysis about the performances of
Transformers on any benchmarks. Moreover, state space models (SSMs) have
demonstrated their abilities of modeling long-range sequences with
non-attention mechanisms, which were not discussed in the prior review. This
article makes a meta analysis on the results from a set of papers on efficient
Transformers as well as those on SSMs. It provides a quantitative review on LM
efficiency research and gives suggestions for future research.Comment: 29 pages, 24 table
Discoveries from a phenanthroline-based dynamic combinatorial library: catenane from a copper(I) or copper(II) template?
We report here a DCL study of a phenanthroline-based building block focusing on catenane formation with copper templates. Two [2]catenanes have been amplified by using Cu+ as a template from the DCLs that contain no interlocked compounds in the absence of copper. In addition, an unexpected Cu2+ template effect on the [2]catenane formation was discovered. The observed Cu2+ template effect was found to originate from the in situ reduction of the divalent metal to Cu+.postprin
Review of multi-scale electromagnetic modeling
This paper reviews various methods to solve multiscale problems ranging from low-frequency methods to very high-frequency methods. ©2010 IEEE.published_or_final_versionThe 2010 International Conference on Electromagnetics in Advanced Applications (ICEAA), Sydney, N.S.W., 20-24 September 2010. In Proceedings of ICEAA'10, 2010, p. 641-64
Motifs, themes and thematic maps of an integrated Saccharomyces cerevisiae interaction network
BACKGROUND: Large-scale studies have revealed networks of various biological interaction types, such as protein-protein interaction, genetic interaction, transcriptional regulation, sequence homology, and expression correlation. Recurring patterns of interconnection, or 'network motifs', have revealed biological insights for networks containing either one or two types of interaction. RESULTS: To study more complex relationships involving multiple biological interaction types, we assembled an integrated Saccharomyces cerevisiae network in which nodes represent genes (or their protein products) and differently colored links represent the aforementioned five biological interaction types. We examined three- and four-node interconnection patterns containing multiple interaction types and found many enriched multi-color network motifs. Furthermore, we showed that most of the motifs form 'network themes' – classes of higher-order recurring interconnection patterns that encompass multiple occurrences of network motifs. Network themes can be tied to specific biological phenomena and may represent more fundamental network design principles. Examples of network themes include a pair of protein complexes with many inter-complex genetic interactions – the 'compensatory complexes' theme. Thematic maps – networks rendered in terms of such themes – can simplify an otherwise confusing tangle of biological relationships. We show this by mapping the S. cerevisiae network in terms of two specific network themes. CONCLUSION: Significantly enriched motifs in an integrated S. cerevisiae interaction network are often signatures of network themes, higher-order network structures that correspond to biological phenomena. Representing networks in terms of network themes provides a useful simplification of complex biological relationships
Developmental changes in the role of different metalinguistic awareness skills in Chinese reading acquisition from preschool to third grade
Copyright @ 2014 Wei et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted
use, distribution, and reproduction in any medium, provided the original author and source are credited.The present study investigated the relationship between Chinese reading skills and metalinguistic awareness skills such as phonological, morphological, and orthographic awareness for 101 Preschool, 94 Grade-1, 98 Grade-2, and 98 Grade-3 children from two primary schools in Mainland China. The aim of the study was to examine how each of these metalinguistic awareness skills would exert their influence on the success of reading in Chinese with age. The results showed that all three metalinguistic awareness skills significantly predicted reading success. It further revealed that orthographic awareness played a dominant role in the early stages of reading acquisition, and its influence decreased with age, while the opposite was true for the contribution of morphological awareness. The results were in stark contrast with studies in English, where phonological awareness is typically shown as the single most potent metalinguistic awareness factor in literacy acquisition. In order to account for the current data, a three-stage model of reading acquisition in Chinese is discussed.National Natural Science Foundation of China and Knowledge Innovation Program of the
Chinese Academy of Sciences
Improved ground-state modulation characteristics in 1.3 μm InAs/GaAs quantum dot lasers by rapid thermal annealing
We investigated the ground-state (GS) modulation characteristics of 1.3 μm InAs/GaAs quantum dot (QD) lasers that consist of either as-grown or annealed QDs. The choice of annealing conditions was determined from our recently reported results. With reference to the as-grown QD lasers, one obtains approximately 18% improvement in the modulation bandwidth from the annealed QD lasers. In addition, the modulation efficiency of the annealed QD lasers improves by approximately 45% as compared to the as-grown ones. The observed improvements are due to (1) the removal of defects which act as nonradiative recombination centers in the QD structure and (2) the reduction in the Auger-related recombination processes upon annealing
Global climate forcing of aerosols embodied in international trade
International trade separates regions consuming goods and services from regions where goods and related aerosol pollution are produced. Yet the role of trade in aerosol climate forcing attributed to different regions has never been quantified. Here, we contrast the direct radiative forcing of aerosols related to regions’ consumption of goods and services against the forcing due to emissions produced in each region. Aerosols assessed include black carbon, primary organic aerosol, and secondary inorganic aerosols, including sulfate, nitrate and ammonium. We find that global aerosol radiative forcing due to emissions produced in East Asia is much stronger than the forcing related to goods and services ultimately consumed in that region because of its large net export of emissions-intensive goods. The opposite is true for net importers such as Western Europe and North America: global radiative forcing related to consumption is much greater than the forcing due to emissions produced in these regions. Overall, trade is associated with a shift of radiative forcing from net importing to net exporting regions. Compared to greenhouse gases such as carbon dioxide, the short atmospheric lifetimes of aerosols cause large localized differences between consumption- and production-related radiative forcing. International efforts to reduce emissions in the exporting countries will help alleviate trade-related climate and health impacts of aerosols while lowering global emissions
Neuronal circuitry for pain processing in the dorsal horn
Neurons in the spinal dorsal horn process sensory information, which is then transmitted to several brain regions, including those responsible for pain perception. The dorsal horn provides numerous potential targets for the development of novel analgesics and is thought to undergo changes that contribute to the exaggerated pain felt after nerve injury and inflammation. Despite its obvious importance, we still know little about the neuronal circuits that process sensory information, mainly because of the heterogeneity of the various neuronal components that make up these circuits. Recent studies have begun to shed light on the neuronal organization and circuitry of this complex region
- …