An Investigation of LLMs' Inefficacy in Understanding Converse Relations

Large Language Models (LLMs) have achieved remarkable success in many formal language oriented tasks, such as structural data-to-text and semantic parsing. However current benchmarks mostly follow the data distribution of the pre-training data of LLMs. Therefore, a natural question rises that do LLMs really understand the structured semantics of formal languages. In this paper, we investigate this problem on a special case, converse binary relation. We introduce a new benchmark ConvRe focusing on converse relations, which contains 17 relations and 1240 triples extracted from popular knowledge graph completion datasets. Our ConvRE features two tasks, Re2Text and Text2Re, which are formulated as multi-choice question answering to evaluate LLMs' ability to determine the matching between relations and associated text. For the evaluation protocol, apart from different prompting methods, we further introduce variants to the test text and few-shot example text. We conduct experiments on three popular LLM families and have observed various scaling trends. The results suggest that LLMs often resort to shortcut learning and still face challenges on our proposed benchmark.Comment: Accepted by EMNLP 202

Factors Determining the Strength of Organizational Culture from Togetherness, Intensity and Morale

This article discusses the factors that determine the strength of public organizational culture in terms of togetherness, intensity and morale. The method used is a mix of methods or a mixture of qualitative and quantitative. Togetherness increases if work is done together outside the room, but morale has the same inside and outside the room, but togetherness will be high if work activities are carried out outside. Organizational culture is a reflection of the formal and informal organizations formed within the organization concerned. Togetherness and group dynamics, namely encouraging their work not to be individualized and the center of power not in one hand. The main step that we really need to do is to select the best seeds or the best employees to be united into a team. However, keep in mind that good employees don't mean they don't have any shortcomings

Deafness, discourse and identity:: critical issues in deaf education

It has long been acknowledged that the main problem associated with deaf education is one of language. To remedy this issue, education polices and methods have focused on the children's inability to communicate effectively in the majority language and have imposed strict regimes within schools aimed at enabling deaf children to talk. This thesis offers a critical examination of such methods and also of the relevant discourses influencing deaf children within education. This thesis argues that the problems associated with deaf children’s experience within education starts, not at their point of entry into formal education, but at birth. My research highlights the fact that deafness is not primarily the deprivation of sound; it is the deprivation of a functional language. The arbitrary imposition of particular language policies within schools be it sign or spoken languages do not really address the underlying issues. This thesis is primarily a critique of the relevant discourses which are complemented by the experiences of the deaf children highlighted in my sample. This thesis show that without the consideration of deaf children’s views and experiences the problems inherent within deaf education will not be addressed adequatel

Issues about the Adoption of Formal Methods for Dependable Composition of Web Services

Web Services provide interoperable mechanisms for describing, locating and invoking services over the Internet; composition further enables to build complex services out of simpler ones for complex B2B applications. While current studies on these topics are mostly focused - from the technical viewpoint - on standards and protocols, this paper investigates the adoption of formal methods, especially for composition. We logically classify and analyze three different (but interconnected) kinds of important issues towards this goal, namely foundations, verification and extensions. The aim of this work is to individuate the proper questions on the adoption of formal methods for dependable composition of Web Services, not necessarily to find the optimal answers. Nevertheless, we still try to propose some tentative answers based on our proposal for a composition calculus, which we hope can animate a proper discussion

Kolmogorov Complexity in perspective. Part II: Classification, Information Processing and Duality

We survey diverse approaches to the notion of information: from Shannon entropy to Kolmogorov complexity. Two of the main applications of Kolmogorov complexity are presented: randomness and classification. The survey is divided in two parts published in a same volume. Part II is dedicated to the relation between logic and information system, within the scope of Kolmogorov algorithmic information theory. We present a recent application of Kolmogorov complexity: classification using compression, an idea with provocative implementation by authors such as Bennett, Vitanyi and Cilibrasi. This stresses how Kolmogorov complexity, besides being a foundation to randomness, is also related to classification. Another approach to classification is also considered: the so-called "Google classification". It uses another original and attractive idea which is connected to the classification using compression and to Kolmogorov complexity from a conceptual point of view. We present and unify these different approaches to classification in terms of Bottom-Up versus Top-Down operational modes, of which we point the fundamental principles and the underlying duality. We look at the way these two dual modes are used in different approaches to information system, particularly the relational model for database introduced by Codd in the 70's. This allows to point out diverse forms of a fundamental duality. These operational modes are also reinterpreted in the context of the comprehension schema of axiomatic set theory ZF. This leads us to develop how Kolmogorov's complexity is linked to intensionality, abstraction, classification and information system.Comment: 43 page

The "Artificial Mathematician" Objection: Exploring the (Im)possibility of Automating Mathematical Understanding

Reuben Hersh confided to us that, about forty years ago, the late Paul Cohen predicted to him that at some unspecified point in the future, mathematicians would be replaced by computers. Rather than focus on computers replacing mathematicians, however, our aim is to consider the (im)possibility of human mathematicians being joined by “artificial mathematicians” in the proving practice—not just as a method of inquiry but as a fellow inquirer

A teaching and support tool for building formal models of graphical user-interfaces

In this paper we propose the design of a tool that will allow the construction of a formal, textual description of a software system even if it has a graphical user-interface as a component. An important aspect of this design is that it can be used for two purposes-the teaching of first-order logic and the formal specification of graphical user-interfaces. The design has been suggested by considering a system that has already been very successful for teaching first-order logic, namely Tarski's World

Young people, political participation and trust in Britain

Young people in Britain are often characterised as disconnected from the formal political process and from democratic institutions. Certainly their rate of abstention in general election contests over the last decade has led to concerns amongst the political classes that they have a disaffection from politics that is deeply entrenched and more so than was the case with previous youth generations, and may in the future become habit-forming. In this article, we consider the results from an online national survey of 1,025 British 18 year olds conducted in 2011, and compare these with the results from a similar study conducted by one of the authors in 2002. In doing so, our aim is to assess the extent to which young people's levels of political engagement have changed over the course of the intervening years, and if so, how they have changed. The results from this comparison indicate that, contrary to popular wisdom, today's generation of young people are interested in political affairs, and they are keen to play a more active role in the political process. However, their recent experience of their first general election in 2010 has left them feeling frustrated. Indeed, our study has revealed a considerable aversion to formal, professional politics which is as deep today as it was for the predecessor 2002 youth cohort