Large Language Model Alignment: A Survey

Recent years have witnessed remarkable progress made in large language models (LLMs). Such advancements, while garnering significant attention, have concurrently elicited various concerns. The potential of these models is undeniably vast; however, they may yield texts that are imprecise, misleading, or even detrimental. Consequently, it becomes paramount to employ alignment techniques to ensure these models to exhibit behaviors consistent with human values. This survey endeavors to furnish an extensive exploration of alignment methodologies designed for LLMs, in conjunction with the extant capability research in this domain. Adopting the lens of AI alignment, we categorize the prevailing methods and emergent proposals for the alignment of LLMs into outer and inner alignment. We also probe into salient issues including the models' interpretability, and potential vulnerabilities to adversarial attacks. To assess LLM alignment, we present a wide variety of benchmarks and evaluation methodologies. After discussing the state of alignment research for LLMs, we finally cast a vision toward the future, contemplating the promising avenues of research that lie ahead. Our aspiration for this survey extends beyond merely spurring research interests in this realm. We also envision bridging the gap between the AI alignment research community and the researchers engrossed in the capability exploration of LLMs for both capable and safe LLMs.Comment: 76 page

Evaluating Large Language Models: A Comprehensive Survey

Large language models (LLMs) have demonstrated remarkable capabilities across a broad spectrum of tasks. They have attracted significant attention and been deployed in numerous downstream applications. Nevertheless, akin to a double-edged sword, LLMs also present potential risks. They could suffer from private data leaks or yield inappropriate, harmful, or misleading content. Additionally, the rapid progress of LLMs raises concerns about the potential emergence of superintelligent systems without adequate safeguards. To effectively capitalize on LLM capacities as well as ensure their safe and beneficial development, it is critical to conduct a rigorous and comprehensive evaluation of LLMs. This survey endeavors to offer a panoramic perspective on the evaluation of LLMs. We categorize the evaluation of LLMs into three major groups: knowledge and capability evaluation, alignment evaluation and safety evaluation. In addition to the comprehensive review on the evaluation methodologies and benchmarks on these three aspects, we collate a compendium of evaluations pertaining to LLMs' performance in specialized domains, and discuss the construction of comprehensive evaluation platforms that cover LLM evaluations on capabilities, alignment, safety, and applicability. We hope that this comprehensive overview will stimulate further research interests in the evaluation of LLMs, with the ultimate goal of making evaluation serve as a cornerstone in guiding the responsible development of LLMs. We envision that this will channel their evolution into a direction that maximizes societal benefit while minimizing potential risks. A curated list of related papers has been publicly available at https://github.com/tjunlp-lab/Awesome-LLMs-Evaluation-Papers.Comment: 111 page

Multicolor Barcoding in a Single Upconversion Crystal

We report the synthesis of luminescent crystals based on hexagonal-phase NaYF₄ upconversion microrods. The synthetic procedure involves an epitaxial end-on growth of upconversion nanocrystals comprising different lanthanide activators onto the NaYF₄ microrods. This bottom-up method readily affords multicolor-banded crystals in gram quantity by varying the composition of the activators. Importantly, the end-on growth method using one-dimensional microrods as the template enables facile multicolor tuning in a single crystal, which is inaccessible in conventional upconversion nanoparticles. We demonstrate that these novel materials offer opportunities as optical barcodes for anticounterfeiting and multiplexed labeling applications

Multicolor Barcoding in a Single Upconversion Crystal

We report the synthesis of luminescent crystals based on hexagonal-phase NaYF₄ upconversion microrods. The synthetic procedure involves an epitaxial end-on growth of upconversion nanocrystals comprising different lanthanide activators onto the NaYF₄ microrods. This bottom-up method readily affords multicolor-banded crystals in gram quantity by varying the composition of the activators. Importantly, the end-on growth method using one-dimensional microrods as the template enables facile multicolor tuning in a single crystal, which is inaccessible in conventional upconversion nanoparticles. We demonstrate that these novel materials offer opportunities as optical barcodes for anticounterfeiting and multiplexed labeling applications

A critical role of Rap1b in B-cell trafficking and marginal zone B-cell development

B-cell development is orchestrated by complex signaling networks. Rap1 is a member of the Ras superfamily of small GTP-binding proteins and has 2 isoforms, Rap1a and Rap1b. Although Rap1 has been suggested to have an important role in a variety of cellular processes, no direct evidence demonstrates a role for Rap1 in B-cell biology. In this study, we found that Rap1b was the dominant isoform of Rap1 in B cells. We discovered that Rap1b deficiency in mice barely affected early development of B cells but markedly reduced marginal zone (MZ) B cells in the spleen and mature B cells in peripheral and mucosal lymph nodes. Rap1b-deficient B cells displayed normal survival and proliferation in vivo and in vitro. However, Rap1b-deficient B cells had impaired adhesion and reduced chemotaxis in vitro, and lessened homing to lymph nodes in vivo. Furthermore, we found that Rap1b deficiency had no marked effect on LPS-, BCR-, or SDF-1–induced activation of mitogen-activated protein kinases and AKT but clearly impaired SDF-1–mediated activation of Pyk-2, a key regulator of SDF-1–mediated B-cell migration. Thus, we have discovered a critical and distinct role of Rap1b in mature B-cell trafficking and development of MZ B cells