The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models

In this study, we present an investigation into the anisotropy dynamics and intrinsic dimension of embeddings in transformer architectures, focusing on the dichotomy between encoders and decoders. Our findings reveal that the anisotropy profile in transformer decoders exhibits a distinct bell-shaped curve, with the highest anisotropy concentrations in the middle layers. This pattern diverges from the more uniformly distributed anisotropy observed in encoders. In addition, we found that the intrinsic dimension of embeddings increases in the initial phases of training, indicating an expansion into higher-dimensional space. Which is then followed by a compression phase towards the end of training with dimensionality decrease, suggesting a refinement into more compact representations. Our results provide fresh insights to the understanding of encoders and decoders embedding properties.Comment: Submitted to EACL-202

Teacher Education in Higher Education Systems during Pandemic and the Synergy of Digital Technology

In the modern world of education, the level of digital technology development plays a decisive role in the competitiveness of educational institutions. The transition to digital education is considered a key driving force for the development of any university. In recent years, pedagogical universities have made tangible progress in many areas of digital development. However, the introduction of digital technologies (DT) in the educational process reached its peak during the pandemic. This study aims to identify the distinctive features in the work of a teacher at a pedagogical university during the pandemic. The study revealed the following: the doubts of the teachers with no e-learning experience; didactically effective digital technologies in the educational process, the combined use of which ensures the synergistic effectiveness of e-learning; students’ attitude towards the quality of the e-learning process during the pandemic. Given the identified problems and positive aspects, the results of the study can be used to further develop a strategy for the digitalization of teacher education. The study proved that effective digitalization of the educational process is possible under the condition of cooperative and systematic work of all participants

LM-Polygraph: Uncertainty Estimation for Language Models

Recent advancements in the capabilities of large language models (LLMs) have paved the way for a myriad of groundbreaking applications in various fields. However, a significant challenge arises as these models often "hallucinate", i.e., fabricate facts without providing users an apparent means to discern the veracity of their statements. Uncertainty estimation (UE) methods are one path to safer, more responsible, and more effective use of LLMs. However, to date, research on UE methods for LLMs has been focused primarily on theoretical rather than engineering contributions. In this work, we tackle this issue by introducing LM-Polygraph, a framework with implementations of a battery of state-of-the-art UE methods for LLMs in text generation tasks, with unified program interfaces in Python. Additionally, it introduces an extendable benchmark for consistent evaluation of UE techniques by researchers, and a demo web application that enriches the standard chat dialog with confidence scores, empowering end-users to discern unreliable responses. LM-Polygraph is compatible with the most recent LLMs, including BLOOMz, LLaMA-2, ChatGPT, and GPT-4, and is designed to support future releases of similarly-styled LMs.Comment: Accepted at EMNLP-202

Comparative assessment of physicians’ and senior medical students’ basic knowledge in treatment of chronic obstructive pulmonary disease

Chronic obstructive pulmonary disease (COPD) is one of the most common pathologies of the respira-tory system. This disease ranks third in the group of the main causes of death in the world. The effective treatment of COPD has been developed by today. However, a significant part of physicians has an insufficient amount of education in this matter

Monetization Strategies in Free-To-Play Mobile Games : Case: From The Bench

Free-to-play mobile games are very popular amongst players because of their high accessibility. According to the Top Grossing chart in App Store, free-to-play mobile games dominate the chart of the most profitable mobile games in such regions as Russia, United States and Japan. Such statistics demonstrate that the free-to-play business model is very efficient in getting revenue. Therefore, it is an interesting subject to study. The aim of the thesis is to cover the topic of monetization strategies of free-to-play mobile games and find out how different mobile app monetization models affect each other in a free-to-play mobile game. The final goal is to provide improvement recommendation for the mobile game monetization strategy of the case company, From The Bench. The author uses a deductive reasoning throughout the thesis and collects both quantitative and qualitative data. Secondary data is gathered from published materials, books, articles, previous studies and reliable Internet sources. Primary data is collected with an interview with the case company’s representative and an online survey conducted among mobile game players in order to understand their opinions about in-game monetization methods. The thesis includes such theories as mobile application concept, monetization of mobile apps, free-to-play games and ARM Funnel. SWOT analysis was used in order to evaluate mobile game monetization strategy in the case company. The research findings prove that different monetization models may conflict with each other in one free-to-play mobile game. Also, due to the specificity of the audience, the case company can focus on the in-app purchase monetization model and partially remove in-app advertising from the mobile games. Taking into consideration the empirical findings and the theoretical analysis, the recommendations to the case company are provided

Linguistic Means of Image Development of Gerhard Chroeder in the Run up to and After First Year in Office

This article is dedicated to the analysis of the linguistic means that influenced image development of the German Chancellor Gerhard Schroeder in the run-up and during the first year in office. Based on printed Media materials, this survey educed the linkage between the evolution of journalists' assessments of personality and activities of G. Schroeder and his public support at the elections in 1998 and parliamentary elections in 1999. The analysis of the articles about the Chancellor showed a great number linguistic means that were used to describe him and that contributed to his image development. Linguistic means with positive connotation were primarily used to describe G. Schroeder in the run-up, since he was reliant on. In contrast, the journalists became more skeptical about the Chancellor after his first year in office and started to describe him with linguistic means with negative connotation. Metaphor is the most widely used linguistic means before and after elections. Beside it, the journalists often used antonomasia, epithets, and similes to form the positive image of the politician. The use of antithesis was connected with the desire to put up Schroeder in a positive light against his predecessor. With growing disappointment with the Chancellor many metaphors and epithets receive their antonymous meaning. The survey results are presented in the table

Linguistic Means of Image Development of Gerhard Chroeder in the Run up to and After First Year in Office

This article is dedicated to the analysis of the linguistic means that influenced image development of the German Chancellor Gerhard Schroeder in the run-up and during the first year in office. Based on printed Media materials, this survey educed the linkage between the evolution of journalists' assessments of personality and activities of G. Schroeder and his public support at the elections in 1998 and parliamentary elections in 1999. The analysis of the articles about the Chancellor showed a great number linguistic means that were used to describe him and that contributed to his image development. Linguistic means with positive connotation were primarily used to describe G. Schroeder in the run-up, since he was reliant on. In contrast, the journalists became more skeptical about the Chancellor after his first year in office and started to describe him with linguistic means with negative connotation. Metaphor is the most widely used linguistic means before and after elections. Beside it, the journalists often used antonomasia, epithets, and similes to form the positive image of the politician. The use of antithesis was connected with the desire to put up Schroeder in a positive light against his predecessor. With growing disappointment with the Chancellor many metaphors and epithets receive their antonymous meaning. The survey results are presented in the table

Peculiarities of gender identity of deviant adolescents

The article is devoted to the study of the formation and manifestation of gender identity in deviant adolescents. The authors analyzed the works devoted to the psychological development of adolescents, taking into account the acceptance or rejection of existing social roles. Special attention is paid to deviant behavior, which partly influences the formation of a person's identity. The authors conducted a study to identify the tendency towards victim behavior in adolescents and correlated them with the data obtained on the definition of character accentuation in students of a regular school and a boarding school. The results of the study confirmed the fact that adolescents with deviant behavior have specific characteristics that make their relationships with their peers and with adults especially difficult. The formation of the gender culture of adolescents takes place on the basis of physical, cognitive development in their relationship with peers and parents, taking into account their psycho-emotional state during puberty

Going global: The scientometric development path of Russian academic journals in international reference databases

We attempt to answer the question that has persisted since the introduction of partial restrictions on access to international reference databases (IRDs) for Russian researchers: is it still reasonable for national scientific journals to strive to be indexed in these databases or does it make sense for them to tread their development path at the national level? The study tests the hypothesis that indexation of Russian academic journals in the Web of Science and Scopus databases affects their scientometric indicators. Scientometric management and data management approaches constitute the theoretical framework of the paper. The key research method is scientometric analysis of bibliographic data. An extensive list of journals’ scientometric indicators was addressed, including those used when compiling the Science Index ranking until 20232. The research data were retrieved from the scientific electronic library eLibrary and Scopus and the Web of Science databases. The sample of the study is comprised of Russian academic journals indexed in the IRDs and classified in the State Classifier of Scientific and Technical Information (GRNTI) as the socio-humanitarian block. The analysis of the sample indicates that the effect expected from journals’ indexation in the IRDs, which suggests expanding the international pool of authors and a growing global interest, is overestimated, since it is largely ensured by an increase in the national academic audience. We substantiate that, despite the positive correlation between the rise in scientometric indicators and journals’ indexation in the IRDs, the mere fact of entering these databases is not the primary condition for success and the ultimate goal of development. The paper formulates recommendations stating that interaction between journals and the IRDs should be organized in accordance with editors’ goals and plans for the development of periodicals