PanDA Workload Management System Meta-data Segmentation

AbstractThe PanDA (Production and Distributed Analysis) workload management system (WMS) was developed to meet the scale and complexity of LHC distributed computing for the ATLAS experiment. PanDA currently distributes jobs among more than 100,000 cores at well over 120 Grid sites, supercomputing centers, commercial and academic clouds. ATLAS physicists submit more than 1.5M data processing, simulation and analysis PanDA jobs per day, and the system keeps all meta-information about job submissions and execution events in Oracle RDBMS. The above information is used for monitoring and accounting purposes. One of the most challenging monitoring issues is tracking errors that has occurred during the execution of the jobs. Current meta-data storage technology doesn’t support inner tools for data aggregation, needed to build error summary tables, charts and graphs. Delegating these tasks to the monitor slows down the execution of requests.We will describe a project aimed at optimizing interaction between PanDA front-end and back-end, by meta-data storage segmentation into two parts – operational and archived. Active meta-data are remained in Oracle database (operational part), due to the high requirements for data integrity. Historical (read-only) meta-data used for the system analysis and accounting are exported to NoSQL storage (archived part). New data model based on usage of Cassandra as the NoSQL backend has been designed as a set of query-specific data structures. This allowed to remove most of data preparation workload from PanDA Monitor and improve its scalability and performance. Segmentation and synchronization between operational and archived parts of jobs meta-data is provided by a Hybrid Meta-data Storage Framework (HMSF). PanDA monitor was partly adopted to interact with HMSF. The operational data queries are forwarded to the primary SQL-based repository and the analytic data requests are processed by NoSQL database. The results of performance and scalability tests of HMSF-adopted part of PanDA Monitor shows that presented method of optimization, in conjunction with a properly configured NoSQL database and reasonable data model, provides performance improvements and scalability

К ЭВОЛЮЦИИ ЭСТЕТИЧЕСКИХ ДОСТОИНСТВ КУЛЬТУРНЫХ ЛАНДШАФТОВ

The goal is to substantiate the change in the social significance of the cultural landscape in the development of new aspects of human activity (the development of the tourism cluster), leading to the formation of a new kind of aesthetic potential of the cultural landscape. Materials and methods. The objects of study were artificial waterways (canals and dams) of the islands of the Solovki archipelago in northern Russia, Longji rice terraces in China and lupine fields in the floodplains of New Zealand rivers. For a quantitative assessment of the aesthetic properties of landscapes, a scale of assessments of the landscape-aesthetic value of cultural landscapes was used. Discussion. The aesthetic functions of the landscape, the integrative connections between the aesthetic potential of the landscape and a comfortable favorable habitat, the role of the historical and cultural landscape in preserving the historical memory of society are considered. The quantitative and qualitative assessments of the aesthetic functions of landscapes are proposed, allowing to argue the organization of the economic system of their preservation, maintenance and restoration. It is shown that the preservation and development of the aesthetic potential of cultural landscapes can lead to a change in their development, a change in the method of nature management and the formation of a completely new type of aesthetic perception of the landscape. Conclusion. Currently, the aesthetic component of cultural landscapes has become a more significant factor than the economic functions for which they were created.El objetivo es corroborar el cambio en la importancia social del paisaje cultural en el desarrollo de nuevos aspectos de la actividad humana (el desarrollo del grupo turístico), lo que lleva a la formación de un nuevo tipo de potencial estético del paisaje cultural. Materiales y métodos. Los objetos de estudio fueron vías fluviales artificiales (canales y presas) de las islas del archipiélago Solovki en el norte de Rusia, terrazas de arroz Longji en China y campos de altramuces en las llanuras aluviales de los ríos de Nueva Zelanda. Para una evaluación cuantitativa de las propiedades estéticas de los paisajes, se utilizó una escala de evaluaciones del valor paisajístico-estético de los paisajes culturales. Discusión. Se consideran las funciones estéticas del paisaje, las conexiones integradoras entre el potencial estético del paisaje y un hábitat cómodo y favorable, el papel del paisaje histórico y cultural en la preservación de la memoria histórica de la sociedad. Se proponen las evaluaciones cuantitativas y cualitativas de las funciones estéticas de los paisajes, lo que permite argumentar la organización del sistema económico de su preservación, mantenimiento y restauración. Se muestra que la preservación y el desarrollo del potencial estético de los paisajes culturales puede conducir a un cambio en su desarrollo, un cambio en el método de gestión de la naturaleza y la formación de un tipo completamente nuevo de percepción estética del paisaje. Conclusión. Actualmente, el componente estético de los paisajes culturales se ha convertido en un factor más significativo que las funciones económicas para las que fueron creados.Целью является обоснование смены общественной значимости культурного ландшафта при развитии новых сторон деятельности человека (развитие туристического кластера), приводящее к формированию нового вида эстетического потенциала культурного ландшафта. Материалы и методы. Объектами исследования были искусственные водные пути (каналы и дамбы) островов Соловецкого архипелага на севере России, рисовые террасы Лунцзи в Китае и люпиновые поля в поймах рек Новой Зеландии. Для количественной оценки эстетических свойств ландшафтов использована шкала оценок пейзажно-эстетической ценности культурных ландшафтов. Обсуждение. Рассмотрены эстетические функции ландшафта, интегративные связи между эстетическим потенциалом ландшафта и комфортной, благоприятной среды обитания, роль историко-культурного ландшафта в сохранении исторической памяти общества. Предложены количественная и качественная оценки эстетических функций ландшафтов, позволяющие аргументировать организацию экономической системы их сохранения, поддержания и восстановления. Показано, что сохранение и развитие эстетического потенциала культурных ландшафтов может приводить к изменению их освоения, смене способа природопользования и к формированию совершенно нового типа эстетического восприятия ландшафта. Заключение. В настоящее время эстетическая составляющая культурных ландшафтов стала более значимым фактором, чем те хозяйственные функции, ради которых они создавались

Formation of quasi-periodic nano- and microstructures on silicon surface under IR and UV femtosecond laser pulses

Quasi-periodic nano- and microstructures have been formed on silicon surface using IR ( λ ≈ 744 nm) and UV ( λ ≈ 248 nm) femtosecond laser pulses. The influence of the incident laser fluence and the number of pulses on the structured surface topology has been investigatedyesBelgorod State Universit

Surface texturing of steel by femtosecond laser and accompanying structure/ phase transformations

Topography, structure, and phase composition of surface layers of AISI 321 stainless steel textured by 1030-nm 320-fs-laser pulses were studied by scanning electron microscopy and X-ray diffraction analysis. Variation in single-pulse fluence and the number of pulses was found to change the laser-produced surface texture from onedimensional quasi-periodic nanograting to microrelief of various roughnes

Regularities of formation and degradation of the microstructure and properties of new ultrafine-grained low-modulus Ti-Nb-Mo-Zr alloys

Regularities of the formation of ultrafine-grained (UFG) and submicrocrystalline (SMC) structures in new nickel-free low-modulus Ti-Nb-Mo-Zr titanium β alloys under the action of plastic deformation have been studied. Temperature-time ranges of the development of dynamic recrystallization processes under the simultaneous action of temperature and plastic deformation are determined. A type-II recrystallization diagram of the Ti-28Nb-8Mo-12Zr alloy is constructed and analyze

Development of DKB ETL module in case of data conversion

Modern scientific experiments involve the producing of huge volumes of data that requires new approaches in data processing and storage. These data themselves, as well as their processing and storage, are accompanied by a valuable amount of additional information, called metadata, distributed over multiple informational systems and repositories, and having a complicated, heterogeneous structure. Gathering these metadata for experiments in the field of high energy nuclear physics (HENP) is a complex issue, requiring the quest for solutions outside the box. One of the tasks is to integrate metadata from different repositories into some kind of a central storage. During the integration process, metadata taken from original source repositories go through several processing steps: metadata aggregation, transformation according to the current data model and loading it to the general storage in a standardized form. The R&D project of ATLAS experiment on LHC, Data Knowledge Base, is aimed to provide fast and easy access to significant information about LHC experiments for the scientific community. The data integration subsystem, being developed for the DKB project, can be represented as a number of particular pipelines, arranging data flow from data sources to the main DKB storage. The data transformation process, represented by a single pipeline, can be considered as a number of successive data transformation steps, where each step is implemented as an individual program module. This article outlines the specifics of program modules, used in the dataflow, and describes one of the modules developed and integrated into the data integration subsystem of DKB

Development of DKB ETL module in case of data conversion

Modern scientific experiments involve the producing of huge volumes of data that requires new approaches in data processing and storage. These data themselves, as well as their processing and storage, are accompanied by a valuable amount of additional information, called metadata, distributed over multiple informational systems and repositories, and having a complicated, heterogeneous structure. Gathering these metadata for experiments in the field of high energy nuclear physics (HENP) is a complex issue, requiring the quest for solutions outside the box. One of the tasks is to integrate metadata from different repositories into some kind of a central storage. During the integration process, metadata taken from original source repositories go through several processing steps: metadata aggregation, transformation according to the current data model and loading it to the general storage in a standardized form. The R&D project of ATLAS experiment on LHC, Data Knowledge Base, is aimed to provide fast and easy access to significant information about LHC experiments for the scientific community. The data integration subsystem, being developed for the DKB project, can be represented as a number of particular pipelines, arranging data flow from data sources to the main DKB storage. The data transformation process, represented by a single pipeline, can be considered as a number of successive data transformation steps, where each step is implemented as an individual program module. This article outlines the specifics of program modules, used in the dataflow, and describes one of the modules developed and integrated into the data integration subsystem of DKB

ЧИСЛЕННОЕ МОДЕЛИРОВАНИЕ ГРУНТОВЫХ СРЕД

The authors have created the numerical realization of a variant of finite element method to detect shifts and tensions in the soil mass. The software is based on mathematical apparatus of Fourier transform of compact functions.Разработана численная реализация варианта метода конечных элементов для определения перемещений и напряжений в массиве грунта. Программный комплекс построен на базе математического аппарата преобразования Фурье финитных функций

Synchronization of multi-phase oscillators: An Axelrod-inspired model

Inspired by Axelrod's model of culture dissemination, we introduce and analyze a model for a population of coupled oscillators where different levels of synchronization can be assimilated to different degrees of cultural organization. The state of each oscillator is represented by a set of phases, and the interaction --which occurs between homologous phases-- is weighted by a decreasing function of the distance between individual states. Both ordered arrays and random networks are considered. We find that the transition between synchronization and incoherent behaviour is mediated by a clustering regime with rich organizational structure, where some of the phases of a given oscillator can be synchronized to a certain cluster, while its other phases are synchronized to different clusters.Comment: 6 pages, 5 figure