Measuring Value Understanding in Language Models through Discriminator-Critique Gap

Recent advancements in Large Language Models (LLMs) have heightened concerns about their potential misalignment with human values. However, evaluating their grasp of these values is complex due to their intricate and adaptable nature. We argue that truly understanding values in LLMs requires considering both "know what" and "know why". To this end, we present the Value Understanding Measurement (VUM) framework that quantitatively assesses both "know what" and "know why" by measuring the discriminator-critique gap related to human values. Using the Schwartz Value Survey, we specify our evaluation values and develop a thousand-level dialogue dataset with GPT-4. Our assessment looks at both the value alignment of LLM's outputs compared to baseline answers and how LLM responses align with reasons for value recognition versus GPT-4's annotations. We evaluate five representative LLMs and provide strong evidence that the scaling law significantly impacts "know what" but not much on "know why", which has consistently maintained a high level. This may further suggest that LLMs might craft plausible explanations based on the provided context without truly understanding their inherent value, indicating potential risks

Preparation of mitochondria to measure superoxide flashes in angiosperm flowers

Background Mitochondria are the center of energy metabolism and the production of reactive oxygen species (ROS). ROS production results in a burst of “superoxide flashes”, which is always accompanied by depolarization of mitochondrial membrane potential. Superoxide flashes have only been studied in the model plant Arabidopsis thaliana using a complex method to isolate mitochondria. In this study, we present an efficient, easier method to isolate functional mitochondria from floral tissues to measure superoxide flashes. Method We used 0.5 g samples to isolate mitochondria within <1.5 h from flowers of two non-transgenic plants (Magnolia denudata and Nelumbo nucifera) to measure superoxide flashes. Superoxide flashes were visualized by the pH-insensitive indicator MitoSOX Red, while the mitochondrial membrane potential (ΔΨ m) was labelled with TMRM. Results Mitochondria isolated using our method showed a high respiration ratio. Our results indicate that the location of ROS and mitochondria was in a good coincidence. Increased ROS together with a higher frequency of superoxide flashes was found in mitochondria isolated from the flower pistil. Furthermore, a higher rate of depolarization of the ΔΨ m was observed in the pistil. Taken together, these results demonstrate that the frequency of superoxide flashes is closely related to depolarization of the ΔΨ m in petals and pistils of flowers

Incentive Compatibility for AI Alignment in Sociotechnical Systems: Positions and Prospects

The burgeoning integration of artificial intelligence (AI) into human society brings forth significant implications for societal governance and safety. While considerable strides have been made in addressing AI alignment challenges, existing methodologies primarily focus on technical facets, often neglecting the intricate sociotechnical nature of AI systems, which can lead to a misalignment between the development and deployment contexts. To this end, we posit a new problem worth exploring: Incentive Compatibility Sociotechnical Alignment Problem (ICSAP). We hope this can call for more researchers to explore how to leverage the principles of Incentive Compatibility (IC) from game theory to bridge the gap between technical and societal components to maintain AI consensus with human societies in different contexts. We further discuss three classical game problems for achieving IC: mechanism design, contract theory, and Bayesian persuasion, in addressing the perspectives, potentials, and challenges of solving ICSAP, and provide preliminary implementation conceptions.Comment: 13 pages, 2 figure

Interface Engineering of Solution-Processed Hybrid Organohalide Perovskite Solar Cells

Engineering the interface between the perovskite absorber and the charge-transporting layers has become an important method for improving the charge extraction and open-circuit voltage ( V) of hybrid perovskite solar cells. Conjugated polymers are particularly suited to form the hole-transporting layer, but their hydrophobicity renders it difficult to solution-process the perovskite absorber on top. Herein, oxygen plasma treatment is introduced as a simple means to change the surface energy and work function of\ua0hydrophobic polymer interlayers for use as p-contacts in perovskite solar cells. We find that upon oxygen plasma treatment, the\ua0hydrophobic\ua0surfaces of different prototypical p-type polymers became sufficiently hydrophilic to enable subsequent perovskite junction processing. In addition, the oxygen plasma treatment also increased the ionization potential of the polymer such that it became closer to the valance band energy of the perovskite. It was also found that the oxygen plasma treatment could increase the electrical conductivity of the p-type polymers, facilitating more efficient charge extraction. On the basis of this concept, inverted MAPbI perovskite devices with different oxygen plasma-treated polymers such as P3HT, P3OT, polyTPD, or PTAA were fabricated with power conversion efficiencies of up to 19%

Ion-induced field screening as a dominant factor in perovskite solar cell operational stability

The presence of mobile ions in metal halide perovskites has been shown to adversely affect the intrinsic stability of perovskite solar cells (PSCs). However, the actual contribution of mobile ions to the total degradation loss compared with other factors such as trap-assisted recombination remains poorly understood. Here we reveal that mobile ion-induced internal field screening is the dominant factor in the degradation of PSCs under operational conditions. The increased field screening leads to a decrease in the steady-state efficiency, often owing to a large reduction in the current density. Instead, the efficiency at high scan speeds (>1,000 V s−1), where the ions are immobilized, is much less affected. We also show that the bulk and interface quality do not degrade upon ageing, yet the open-circuit voltage decreases owing to an increase in the mobile ion density. This work reveals the importance of ionic losses for intrinsic PSC degradation before chemical or extrinsic mechanical effects manifest