ПОЄДНАННЯ ГРІД-ТЕХНОЛОГІЙ ASTRO-WISE І EGEE

В даній статті описано інтеграцію Грід-рішення, що реалізоване в інформаційній системі Astro-WISE з застосуванням EGEE Grid і портування програмних додатків Astro-WISE на EGEE. Astro-WISE це середовище, що складається з апаратного та програмного забезпечення. Описані переваги та недоліки цих технологій. Показано архітектуру Astro-WISE Grid, визначено проблеми для інтеграції Грід-інфраструктур і вирішення цих проблем. Причиною для об'єднання Astro-WISE і EGEE є впровадження міжнародних стандартів, які використовуються EGEE Грід в систему Astro-WISE, який полегшує будь-яке майбутнє підключення до інших мереж.Ключові слова: Грід-системи, інформаційна система, інтеграція, розширення можливостей, переваги.студент, Кливода И.В. соединение Грид-технологий ASTRO-WISE и EGEE / Национальный технический университет Украины «Киевский политехнический институт», Украина, КиевВ данной статье описано интеграцию Грид-решения, реализованое в информационной системе Astro-WISE с применением EGEE Grid и портирование приложений Astro-WISE на EGEE. Astro-WISE это среда, состоящая из аппаратного и программного обеспечения. Описанные преимущества и недостатки этих технологий. Показано архитектуру Astro-WISE Grid, определены проблемы для интеграции Грид-инфраструктур и решения этих проблем. Причиной для объединения Astro-WISE и EGEE является внедрение международных стандартов, используемых EGEE Грид в систему Astro-WISE, который облегчает любое будущее подключения к другим сетям.Ключевые слова: Грид-системы, информационная система, интеграция, расширение возможностей, преимущества.student, Klivoda I.V. Confluence Grid Technologies: Astro-WISE and EGEE / National Technical University of Ukraine "Kyiv Polytechnic Institute", Ukraine, KievThis paper describes the integration of Grid solutions, implemented in the information system Astro-WISE using EGEE Grid and porting software applications Astro-WISE on EGEE. Astro-WISE is an environment that consists of hardware and software. Describe the advantages and disadvantages of these technologies. Architecture shown Astro-WISE Grid, defined problem to integrate Grid infrastructures and address these problems. The reason for the association Astro-WISE and EGEE is introduction of international standards used EGEE Grid in Astro-WISE, which facilitates any future connection to other networks.Keywords: Grid system, information system, integration, empowerment, benefits

MDia and POTS - The Munich Difference Imaging Analysis for the pre-OmegaTranS Project

We describe the Munich Difference Imaging Analysis pipeline that we developed and implemented in the framework of the Astro-WISE package to automatically measure high precision light curves of a large number of stellar objects using the difference imaging approach. Combined with programs to detect time variability, this software can be used to search for planetary systems or binary stars with the transit method and for variable stars of different kinds. As a first scientific application, we discuss the data reduction and analysis performed with Astro-WISE on the pre-OmegaTranS data set, that we collected during a monitoring campaign of a dense stellar field with the Wide Field Imager at the ESO 2.2m telescope.Comment: 10 pages, 5 figures, accepted for publication in topical issue of Experimental Astronomy on Astro-WISE information syste

Implementation of PhotoZ under Astro-WISE - A photometric redshift code for large datasets

We describe the implementation of the PhotoZ code in the framework of the Astro-WISE package and as part of the Photometric Classification Server of the PanSTARRS pipeline. Both systems allow the automatic measurement of photometric redshifts for the millions of objects being observed in the PanSTARRS project or expected to be observed by future surveys like KIDS, DES or EUCLID.Comment: Accepted for publication in topical issue of Experimental Astronomy on Astro-WISE information system, references update

The Astro-WISE approach to quality control for astronomical data

We present a novel approach to quality control during the processing of astronomical data. Quality control in the Astro-WISE Information System is integral to all aspects of data handing and provides transparent access to quality estimators for all stages of data reduction from the raw image to the final catalog. The implementation of quality control mechanisms relies on the core features in this Astro-WISE Environment (AWE): an object-oriented framework, full data lineage, and both forward and backward chaining. Quality control information can be accessed via the command-line awe-prompt and the web-based Quality-WISE service. The quality control system is described and qualified using archive data from the 8-CCD Wide Field Imager (WFI) instrument (http://www.eso.org/lasilla/instruments/wfi/) on the 2.2-m MPG/ESO telescope at La Silla and (pre-)survey data from the 32-CCD OmegaCAM instrument (http://www.astro-wise.org/~omegacam/) on the VST telescope at Paranal.Comment: Accepted for publication in topical issue of Experimental Astronomy on Astro-WISE information syste

Merging Grid Technologies

This paper reports the integration of the astronomical Grid solution realised in the Astro-WISE information system with the EGEE Grid and the porting of Astro-WISE applications on EGEE. We review the architecture of the Astro-WISE Grid, define the problems for the integration of the Grid infrastructures and our solution to these problems. We give examples of applications running on Astro-WISE and EGEE and review future development of the merged system

Astro-WISE processing of wide-field images and other data

Astro-WISE is the Astronomical Wide-field Imaging System for Europe. It is a scientific information system which consists of hardware and software federated over about a dozen institutes throughout Europe. It has been developed to exploit the ever increasing avalanche of data produced by astronomical surveys and data intensive scientific experiments in general. The demo explains the architecture of the Astro-WISE information system and shows the use of Astro-WISE interfaces. Wide-field astronomical images are derived from the raw image to the final catalog according to the user's request. The demo is based on the standard Astro-WISE guided tour, which can be accessed from the Astro-WISE website. The typical Astro-WISE data processing chain is shown, which can be used for data handling for a variety of different instruments, currently 14, including OmegaCAM, MegaCam, WFI, WFC, ACS/HST, etc.Comment: 4 pages, Procedings of ADASS XXI, ASP Conference Serie

Astro-WISE: Chaining to the Universe

The recent explosion of recorded digital data and its processed derivatives threatens to overwhelm researchers when analysing their experimental data or when looking up data items in archives and file systems. While current hardware developments allow to acquire, process and store 100s of terabytes of data at the cost of a modern sports car, the software systems to handle these data are lagging behind. This general problem is recognized and addressed by various scientific communities, e.g., DATAGRID/EGEE federates compute and storage power over the high-energy physical community, while the astronomical community is building an Internet geared Virtual Observatory, connecting archival data. These large projects either focus on a specific distribution aspect or aim to connect many sub-communities and have a relatively long trajectory for setting standards and a common layer. Here, we report "first light" of a very different solution to the problem initiated by a smaller astronomical IT community. It provides the abstract "scientific information layer" which integrates distributed scientific analysis with distributed processing and federated archiving and publishing. By designing new abstractions and mixing in old ones, a Science Information System with fully scalable cornerstones has been achieved, transforming data systems into knowledge systems. This break-through is facilitated by the full end-to-end linking of all dependent data items, which allows full backward chaining from the observer/researcher to the experiment. Key is the notion that information is intrinsic in nature and thus is the data acquired by a scientific experiment. The new abstraction is that software systems guide the user to that intrinsic information by forcing full backward and forward chaining in the data modelling.Comment: To be published in ADASS XVI ASP Conference Series, 2006, R. Shaw, F. Hill and D. Bell, ed

Target and (Astro-)WISE technologies - Data federations and its applications

After its first implementation in 2003 the Astro-WISE technology has been rolled out in several European countries and is used for the production of the KiDS survey data. In the multi-disciplinary Target initiative this technology, nicknamed WISE technology, has been further applied to a large number of projects. Here, we highlight the data handling of other astronomical applications, such as VLT-MUSE and LOFAR, together with some non-astronomical applications such as the medical projects Lifelines and GLIMPS, the MONK handwritten text recognition system, and business applications, by amongst others, the Target Holding. We describe some of the most important lessons learned and describe the application of the data-centric WISE type of approach to the Science Ground Segment of the Euclid satellite.Comment: 9 pages, 5 figures, Proceedngs IAU Symposium No 325 Astroinformatics 201