The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models

In this study, we present an investigation into the anisotropy dynamics and intrinsic dimension of embeddings in transformer architectures, focusing on the dichotomy between encoders and decoders. Our findings reveal that the anisotropy profile in transformer decoders exhibits a distinct bell-shaped curve, with the highest anisotropy concentrations in the middle layers. This pattern diverges from the more uniformly distributed anisotropy observed in encoders. In addition, we found that the intrinsic dimension of embeddings increases in the initial phases of training, indicating an expansion into higher-dimensional space. Which is then followed by a compression phase towards the end of training with dimensionality decrease, suggesting a refinement into more compact representations. Our results provide fresh insights to the understanding of encoders and decoders embedding properties.Comment: Submitted to EACL-202

Teacher Education in Higher Education Systems during Pandemic and the Synergy of Digital Technology

In the modern world of education, the level of digital technology development plays a decisive role in the competitiveness of educational institutions. The transition to digital education is considered a key driving force for the development of any university. In recent years, pedagogical universities have made tangible progress in many areas of digital development. However, the introduction of digital technologies (DT) in the educational process reached its peak during the pandemic. This study aims to identify the distinctive features in the work of a teacher at a pedagogical university during the pandemic. The study revealed the following: the doubts of the teachers with no e-learning experience; didactically effective digital technologies in the educational process, the combined use of which ensures the synergistic effectiveness of e-learning; students’ attitude towards the quality of the e-learning process during the pandemic. Given the identified problems and positive aspects, the results of the study can be used to further develop a strategy for the digitalization of teacher education. The study proved that effective digitalization of the educational process is possible under the condition of cooperative and systematic work of all participants

LM-Polygraph: Uncertainty Estimation for Language Models

Recent advancements in the capabilities of large language models (LLMs) have paved the way for a myriad of groundbreaking applications in various fields. However, a significant challenge arises as these models often "hallucinate", i.e., fabricate facts without providing users an apparent means to discern the veracity of their statements. Uncertainty estimation (UE) methods are one path to safer, more responsible, and more effective use of LLMs. However, to date, research on UE methods for LLMs has been focused primarily on theoretical rather than engineering contributions. In this work, we tackle this issue by introducing LM-Polygraph, a framework with implementations of a battery of state-of-the-art UE methods for LLMs in text generation tasks, with unified program interfaces in Python. Additionally, it introduces an extendable benchmark for consistent evaluation of UE techniques by researchers, and a demo web application that enriches the standard chat dialog with confidence scores, empowering end-users to discern unreliable responses. LM-Polygraph is compatible with the most recent LLMs, including BLOOMz, LLaMA-2, ChatGPT, and GPT-4, and is designed to support future releases of similarly-styled LMs.Comment: Accepted at EMNLP-202

Comparative assessment of physicians’ and senior medical students’ basic knowledge in treatment of chronic obstructive pulmonary disease

Chronic obstructive pulmonary disease (COPD) is one of the most common pathologies of the respira-tory system. This disease ranks third in the group of the main causes of death in the world. The effective treatment of COPD has been developed by today. However, a significant part of physicians has an insufficient amount of education in this matter

Monetization Strategies in Free-To-Play Mobile Games : Case: From The Bench

Free-to-play mobile games are very popular amongst players because of their high accessibility. According to the Top Grossing chart in App Store, free-to-play mobile games dominate the chart of the most profitable mobile games in such regions as Russia, United States and Japan. Such statistics demonstrate that the free-to-play business model is very efficient in getting revenue. Therefore, it is an interesting subject to study. The aim of the thesis is to cover the topic of monetization strategies of free-to-play mobile games and find out how different mobile app monetization models affect each other in a free-to-play mobile game. The final goal is to provide improvement recommendation for the mobile game monetization strategy of the case company, From The Bench. The author uses a deductive reasoning throughout the thesis and collects both quantitative and qualitative data. Secondary data is gathered from published materials, books, articles, previous studies and reliable Internet sources. Primary data is collected with an interview with the case company’s representative and an online survey conducted among mobile game players in order to understand their opinions about in-game monetization methods. The thesis includes such theories as mobile application concept, monetization of mobile apps, free-to-play games and ARM Funnel. SWOT analysis was used in order to evaluate mobile game monetization strategy in the case company. The research findings prove that different monetization models may conflict with each other in one free-to-play mobile game. Also, due to the specificity of the audience, the case company can focus on the in-app purchase monetization model and partially remove in-app advertising from the mobile games. Taking into consideration the empirical findings and the theoretical analysis, the recommendations to the case company are provided

Linguistic Means of Image Development of Gerhard Chroeder in the Run up to and After First Year in Office

This article is dedicated to the analysis of the linguistic means that influenced image development of the German Chancellor Gerhard Schroeder in the run-up and during the first year in office. Based on printed Media materials, this survey educed the linkage between the evolution of journalists' assessments of personality and activities of G. Schroeder and his public support at the elections in 1998 and parliamentary elections in 1999. The analysis of the articles about the Chancellor showed a great number linguistic means that were used to describe him and that contributed to his image development. Linguistic means with positive connotation were primarily used to describe G. Schroeder in the run-up, since he was reliant on. In contrast, the journalists became more skeptical about the Chancellor after his first year in office and started to describe him with linguistic means with negative connotation. Metaphor is the most widely used linguistic means before and after elections. Beside it, the journalists often used antonomasia, epithets, and similes to form the positive image of the politician. The use of antithesis was connected with the desire to put up Schroeder in a positive light against his predecessor. With growing disappointment with the Chancellor many metaphors and epithets receive their antonymous meaning. The survey results are presented in the table

Linguistic Means of Image Development of Gerhard Chroeder in the Run up to and After First Year in Office

This article is dedicated to the analysis of the linguistic means that influenced image development of the German Chancellor Gerhard Schroeder in the run-up and during the first year in office. Based on printed Media materials, this survey educed the linkage between the evolution of journalists' assessments of personality and activities of G. Schroeder and his public support at the elections in 1998 and parliamentary elections in 1999. The analysis of the articles about the Chancellor showed a great number linguistic means that were used to describe him and that contributed to his image development. Linguistic means with positive connotation were primarily used to describe G. Schroeder in the run-up, since he was reliant on. In contrast, the journalists became more skeptical about the Chancellor after his first year in office and started to describe him with linguistic means with negative connotation. Metaphor is the most widely used linguistic means before and after elections. Beside it, the journalists often used antonomasia, epithets, and similes to form the positive image of the politician. The use of antithesis was connected with the desire to put up Schroeder in a positive light against his predecessor. With growing disappointment with the Chancellor many metaphors and epithets receive their antonymous meaning. The survey results are presented in the table

Scientific review of climate science: A bibliometric analysis of trends

This research analyses the metadata of 15550 climatology publications indexed in the OpenAlex data catalogue of the types ‘article’ (95%), ‘book’ (3%) and ‘book-chapter’ (2%). The research covers the period from 1851 to the present. Bibliometrix and VOSviewer software tools were used for data processing and analysis, and Scimago Graphica was used to visualise the results. As a result of the research, new data on the periods of authors' publication activity by subject, supported by the systematisation of the main scientific achievements and changes of those times, were obtained. The structure of access to publications in climatology and its impact on the attention of the scientific community, thematic diversity and the most relevant current research areas were also analysed

Peculiarities of gender identity of deviant adolescents

The article is devoted to the study of the formation and manifestation of gender identity in deviant adolescents. The authors analyzed the works devoted to the psychological development of adolescents, taking into account the acceptance or rejection of existing social roles. Special attention is paid to deviant behavior, which partly influences the formation of a person's identity. The authors conducted a study to identify the tendency towards victim behavior in adolescents and correlated them with the data obtained on the definition of character accentuation in students of a regular school and a boarding school. The results of the study confirmed the fact that adolescents with deviant behavior have specific characteristics that make their relationships with their peers and with adults especially difficult. The formation of the gender culture of adolescents takes place on the basis of physical, cognitive development in their relationship with peers and parents, taking into account their psycho-emotional state during puberty