SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents

Humans are social beings; we pursue social goals in our daily interactions, which is a crucial aspect of social intelligence. Yet, AI systems' abilities in this realm remain elusive. We present SOTOPIA, an open-ended environment to simulate complex social interactions between artificial agents and evaluate their social intelligence. In our environment, agents role-play and interact under a wide variety of scenarios; they coordinate, collaborate, exchange, and compete with each other to achieve complex social goals. We simulate the role-play interaction between LLM-based agents and humans within this task space and evaluate their performance with a holistic evaluation framework called SOTOPIA-Eval. With SOTOPIA, we find significant differences between these models in terms of their social intelligence, and we identify a subset of SOTOPIA scenarios, SOTOPIA-hard, that is generally challenging for all models. We find that on this subset, GPT-4 achieves a significantly lower goal completion rate than humans and struggles to exhibit social commonsense reasoning and strategic communication skills. These findings demonstrate SOTOPIA's promise as a general platform for research on evaluating and improving social intelligence in artificial agents.Comment: Preprint, 43 pages. The first two authors contribute equall

Do Chatbots Dream of Androids? Prospects for the Technological Development of Artificial Intelligence and Robotics

The article discusses the main trends in the development of artificial intelligence systems and robotics (AI&R). The main question that is considered in this context is whether artificial systems are going to become more and more anthropomorphic, both intellectually and physically. In the current article, the author analyzes the current state and prospects of technological development of artificial intelligence and robotics, and also determines the main aspects of the impact of these technologies on society and economy, indicating the geopolitical strategic nature of this influence. The author considers various approaches to the definition of artificial intelligence and robotics, focusing on the subject-oriented and functional ones. It also compares AI&R abilities and human abilities in areas such as categorization, pattern recognition, planning and decision making, etc. Based on this comparison, we investigate in which areas AI&R’s performance is inferior to a human, and in which cases it is superior to one. The modern achievements in the field of robotics and artificial intelligence create the necessary basis for further discussion of the applicability of goal setting in engineering, in the form of a Turing test. It is shown that development of AI&R is associated with certain contradictions that impede the application of Turing’s methodology in its usual format. The basic contradictions in the development of AI&R technologies imply that there is to be a transition to a post-Turing methodology for assessing engineering implementations of artificial intelligence and robotics. In such implementations, on the one hand, the ‘Turing wall’ is removed, and on the other hand, artificial intelligence gets its physical implementation

The life of Metis: cunning maternal interventions

This paper charts the different and co-existent uses of the Greek myth and concept of Metis for feminist philosophy. I show how the move from using the myth of Metis to an engagement with the marginalised ancient Greek concept of cunning intelligence (metis) is significant in addressing problems of agency and political action in contemporary feminist debates. The paper addresses the concept of metis cunning intelligence in relation to the maternal and argues for a theory of metis charcterised by a double action, and finally links this approach to recent ideas in Deleuzian feminist theory

Why Intelligent People Live Longer

Numerous studies find a positive relationship between cognitive ability, IQ as measured in childhood or youth, and subsequent survival. Explanations range from the idea that low ability is an indicator of adverse systemic events in early life to the idea that high cognitive functioning is required continuously to maintain health and reduce threats to survival. The Wisconsin Longitudinal Study (WLS) has followed a large cohort of Wisconsin high school seniors from ages 18 to 69. As expected, in the WLS survival varies positively with adolescent IQ. However, rank in high school class accounts completely for the relationship between IQ and survival, and it has a much larger effect on survival. These findings suggest that cognitive functioning improves survival by promoting behaviours that boost health status, minimize exposure to known risks and optimize returns to health producing inputs, and that such behaviours are firmly in place by late adolescence