Chain-of-Thought Hub: A Continuous Effort to Measure Large Language Models' Reasoning Performance

As large language models (LLMs) are continuously being developed, their evaluation becomes increasingly important yet challenging. This work proposes Chain-of-Thought Hub, an open-source evaluation suite on the multi-step reasoning capabilities of large language models. We are interested in this setting for two reasons: (1) from the behavior of GPT and PaLM model family, we observe that complex reasoning is likely to be a key differentiator between weaker and stronger LLMs; (2) we envisage large language models to become the next-generation computational platform and foster an ecosystem of LLM-based new applications, this naturally requires the foundation models to perform complex tasks that often involve the composition of linguistic and logical operations. Our approach is to compile a suite of challenging reasoning benchmarks to track the progress of LLMs. Our current results show that: (1) model scale clearly correlates with reasoning capabilities; (2) As of May 2023, Claude-v1.3 and PaLM-2 are the only two models that are comparable with GPT-4, while open-sourced models still lag behind; (3) LLaMA-65B performs closely to code-davinci-002, indicating that with successful further development such as reinforcement learning from human feedback (RLHF), it has great potential to be close to GPT-3.5-Turbo. Our results also suggest that for the open-source efforts to catch up, the community may focus more on building better base models and exploring RLHF.Comment: Preprint. Code at https://github.com/FranxYao/chain-of-thought-hu

Affection Driven Neural Networks for Sentiment Analysis

Deep neural network models have played a critical role in sentiment analysis with promising results in the recent decade. One of the essential challenges, however, is how external sentiment knowledge can be effectively utilized. In this work, we propose a novel affection-driven approach to incorporating affective knowledge into neural network models. The affective knowledge is obtained in the form of a lexicon under the Affect Control Theory (ACT), which is represented by vectors of three-dimensional attributes in Evaluation, Potency, and Activity (EPA). The EPA vectors are mapped to an affective influence value and then integrated into Long Short-term Memory (LSTM) models to highlight affective terms. Experimental results show a consistent improvement of our approach over conventional LSTM models by 1.0% to 1.5% in accuracy on three large benchmark datasets. Evaluations across a variety of algorithms have also proven the effectiveness of leveraging affective terms for deep model enhancement

Sedentism and plant cultivation in northeast China emerged during affluent conditions

The reasons and processes that led hunter-gatherers to transition into a sedentary and agricultural way of life are a fundamental unresolved question of human history. Here we present results of excavations of two single-occupation early Neolithic sites (dated to 7.9 and 7.4 ka) and two high-resolution archaeological surveys in northeast China, which capture the earliest stages of sedentism and millet cultivation in the second oldest center of domestication in the Old World. The transition to sedentism coincided with a significant transition to wetter conditions in north China, at 8.1–7.9 ka. We suggest that these wetter conditions were an empirical precondition that facilitated the complex transitional process to sedentism and eventually millet domestication in north China. Interestingly, sedentism and plant domestication followed different trajectories. The sedentary way of life and cultural norms evolved rapidly, within a few hundred years, we find complex sedentary villages inhabiting the landscape. However, the process of plant domestication, progressed slowly over several millennia. Our earliest evidence for the beginning of the domestication process appear in the context of an already complex sedentary village (late Xinglongwa culture), a half millennia after the onset of cultivation, and even in this phase domesticated plants and animals were rare, suggesting that the transition to domesticated (sensu stricto) plants in affluent areas might have not played a substantial role in the transition to sedentary societies

Molecular Genetic Features of Polyploidization and Aneuploidization Reveal Unique Patterns for Genome Duplication in Diploid Malus

Polyploidization results in genome duplication and is an important step in evolution and speciation. The Malus genome confirmed that this genus was derived through auto-polyploidization, yet the genetic and meiotic mechanisms for polyploidization, particularly for aneuploidization, are unclear in this genus or other woody perennials. In fact the contribution of aneuploidization remains poorly understood throughout Plantae. We add to this knowledge by characterization of eupolyploidization and aneuploidization in 27,542 F1 seedlings from seven diploid Malus populations using cytology and microsatellite markers. We provide the first evidence that aneuploidy exceeds eupolyploidy in the diploid crosses, suggesting aneuploidization is a leading cause of genome duplication. Gametes from diploid Malus had a unique combinational pattern; ova preserved euploidy exclusively, while spermatozoa presented both euploidy and aneuploidy. All non-reduced gametes were genetically heterozygous, indicating first-division restitution was the exclusive mode for Malus eupolyploidization and aneuploidization. Chromosome segregation pattern among aneuploids was non-uniform, however, certain chromosomes were associated for aneuploidization. This study is the first to provide molecular evidence for the contribution of heterozygous non-reduced gametes to fitness in polyploids and aneuploids. Aneuploidization can increase, while eupolyploidization may decrease genetic diversity in their newly established populations. Auto-triploidization is important for speciation in the extant Malus. The features of Malus polyploidization confer genetic stability and diversity, and present heterozygosity, heterosis and adaptability for evolutionary selection. A protocol using co-dominant markers was proposed for accelerating apple triploid breeding program. A path was postulated for evolution of numerically odd basic chromosomes. The model for Malus derivation was considerably revised. Impacts of aneuploidization on speciation and evolution, and potential applications of aneuploids and polyploids in breeding and genetics for other species were evaluated in depth. This study greatly improves our understanding of evolution, speciation, and adaptation of the Malus genus, and provides strategies to exploit polyploidization in other species

Different and unified responses of soil bacterial and fungal community composition and predicted functional potential to 3 years’ drought stress in a semiarid alpine grassland

IntroductionSoil microbial communities are key to functional processes in terrestrial ecosystems, and they serve as an important indicator of grasslands status. However, the responses of soil microbial communities and functional potential to drought stress in semiarid alpine grasslands remain unclear.MethodsHere, a field experiment was conducted under ambient precipitation as a control, −20% and −40% of precipitation to explore the responses of soil microbial diversity, community composition, and predicted functional potential to drought stress in a semiarid alpine grassland located in the northwest of China. Moreover, 16S rRNA gene and ITS sequencing were used to detect bacterial and fungal communities, and the PICRUST and FUNGuild databases were used to predict bacterial and fungal functional groups.ResultsResults showed drought stress substantially changes the community diversity of bacteria and fungi, among which the bacteria community is more sensitive to drought stress than fungi, indicating that the diversity or structure of soil bacteria community could serve as an indicator of alpine grasslands status. However, the fungal community still has difficulty maintaining resistance under excessive drought stress. Our paper also highlighted that soil moisture content, plant diversity (Shannon Wiener, Pieiou, and Simpson), and soil organic matter are the main drivers affecting soil bacterial and fungal community composition and predicted functional potential. Notably, the soil microbial functional potential could be predictable through taxonomic community profiles.ConclusionOur research provides insight for exploring the mechanisms of microbial community composition and functional response to climate change (longer drought) in a semiarid alpine grassland

AURKB in concert with REST acts as an oxygen-sensitive epigenetic regulator in hypoxic induction of MDM2

The acute response to hypoxia is mainly driven by hypoxia-inducible factors, but their effects gradually subside with time. Hypoxia-specific histone modifications may be important for the stable maintenance of long-term adaptation to hypoxia. However, little is known about the molecular mechanisms underlying the dynamic alterations of histones under hypoxic conditions. We found that the phosphorylation of histone H3 at Ser-10 (H3S10) was noticeably attenuated after hypoxic challenge, which was mediated by the inhibition of aurora kinase B (AURKB). To understand the role of AURKB in epigenetic regulation, DNA microarray and transcription factor binding site analyses combined with proteomics analysis were performed. Under normoxia, phosphorylated AURKB, in concert with the repressor element-1 silencing transcription factor (REST), phosphorylates H3S10, which allows the AURKB- REST complex to access the MDM2 proto-oncogene. REST then acts as a transcriptional repressor of MDM2 and downregulates its expression. Under hypoxia, AURKB is dephosphorylated and the AURKB- REST complex fails to access MDM2, leading to the upregulation of its expression. In this study, we present a case of hypoxia-specific epigenetic regulation of the oxygen-sensitive AURKB signaling pathway. To better understand the cellular adaptation to hypoxia, it is worthwhile to further investigate the epigenetic regulation of genes underhypoxic conditions.N