19,933 research outputs found
Running a distributed virtual observatory: US Virtual Astronomical Observatory operations
Operation of the US Virtual Astronomical Observatory shares some issues with
modern physical observatories, e.g., intimidating data volumes and rapid
technological change, and must also address unique concerns like the lack of
direct control of the underlying and scattered data resources, and the
distributed nature of the observatory itself. In this paper we discuss how the
VAO has addressed these challenges to provide the astronomical community with a
coherent set of science-enabling tools and services. The distributed nature of
our virtual observatory-with data and personnel spanning geographic,
institutional and regime boundaries-is simultaneously a major operational
headache and the primary science motivation for the VAO. Most astronomy today
uses data from many resources. Facilitation of matching heterogeneous datasets
is a fundamental reason for the virtual observatory. Key aspects of our
approach include continuous monitoring and validation of VAO and VO services
and the datasets provided by the community, monitoring of user requests to
optimize access, caching for large datasets, and providing distributed storage
services that allow user to collect results near large data repositories. Some
elements are now fully implemented, while others are planned for subsequent
years. The distributed nature of the VAO requires careful attention to what can
be a straightforward operation at a conventional observatory, e.g., the
organization of the web site or the collection and combined analysis of logs.
Many of these strategies use and extend protocols developed by the
international virtual observatory community.Comment: 7 pages with 2 figures included within PD
VisIVO - Integrated Tools and Services for Large-Scale Astrophysical Visualization
VisIVO is an integrated suite of tools and services specifically designed for
the Virtual Observatory. This suite constitutes a software framework for
effective visual discovery in currently available (and next-generation) very
large-scale astrophysical datasets. VisIVO consists of VisiVO Desktop - a stand
alone application for interactive visualization on standard PCs, VisIVO Server
- a grid-enabled platform for high performance visualization and VisIVO Web - a
custom designed web portal supporting services based on the VisIVO Server
functionality. The main characteristic of VisIVO is support for
high-performance, multidimensional visualization of very large-scale
astrophysical datasets. Users can obtain meaningful visualizations rapidly
while preserving full and intuitive control of the relevant visualization
parameters. This paper focuses on newly developed integrated tools in VisIVO
Server allowing intuitive visual discovery with 3D views being created from
data tables. VisIVO Server can be installed easily on any web server with a
database repository. We discuss briefly aspects of our implementation of VisiVO
Server on a computational grid and also outline the functionality of the
services offered by VisIVO Web. Finally we conclude with a summary of our work
and pointers to future developments
Interactive 3D visualization for theoretical Virtual Observatories
Virtual Observatories (VOs) are online hubs of scientific knowledge. They
encompass a collection of platforms dedicated to the storage and dissemination
of astronomical data, from simple data archives to e-research platforms
offering advanced tools for data exploration and analysis. Whilst the more
mature platforms within VOs primarily serve the observational community, there
are also services fulfilling a similar role for theoretical data. Scientific
visualization can be an effective tool for analysis and exploration of datasets
made accessible through web platforms for theoretical data, which often contain
spatial dimensions and properties inherently suitable for visualization via
e.g. mock imaging in 2d or volume rendering in 3d. We analyze the current state
of 3d visualization for big theoretical astronomical datasets through
scientific web portals and virtual observatory services. We discuss some of the
challenges for interactive 3d visualization and how it can augment the workflow
of users in a virtual observatory context. Finally we showcase a lightweight
client-server visualization tool for particle-based datasets allowing
quantitative visualization via data filtering, highlighting two example use
cases within the Theoretical Astrophysical Observatory.Comment: 10 Pages, 13 Figures, Accepted for Publication in Monthly Notices of
the Royal Astronomical Societ
IVOA Recommendation: Resource Metadata for the Virtual Observatory Version 1.12
An essential capability of the Virtual Observatory is a means for describing
what data and computational facilities are available where, and once
identified, how to use them. The data themselves have associated metadata
(e.g., FITS keywords), and similarly we require metadata about data collections
and data services so that VO users can easily find information of interest.
Furthermore, such metadata are needed in order to manage distributed queries
efficiently; if a user is interested in finding x-ray images there is no point
in querying the HST archive, for example. In this document we suggest an
architecture for resource and service metadata and describe the relationship of
this architecture to emerging Web Services standards. We also define an initial
set of metadata concepts
Grist: Grid-based Data Mining for Astronomy
The Grist project is developing a grid-technology based system as a research environment for astronomy with massive and complex datasets. This knowledge extraction system will consist of a library of distributed grid services controlled by a work ow system, compliant with standards emerging from the grid computing, web services, and virtual observatory communities. This new technology is being used to find high redshift quasars, study peculiar variable objects, search for transients in real time, and fit SDSS QSO spectra to measure black hole masses. Grist services are also a component of the "hyperatlas" project to serve high-resolution multi-wavelength imagery over the Internet. In support of these science and outreach objectives, the Grist framework will provide the enabling fabric to tie together distributed grid services in the areas of data access, federation, mining, subsetting, source extraction, image mosaicking, statistics, and visualization
CASAS: A tool for composing automatically and semantically astrophysical services
Multiple astronomical datasets are available through internet and the astrophysical Distributed Computing Infrastructure (DCI) called Virtual Observatory (VO). Some scientific workflow technologies exist for retrieving and combining data from those sources. However selection of relevant services, automation of the workflows composition and the lack of user-friendly platforms remain a concern. This paper presents CASAS, a tool for semantic web services composition in astrophysics. This tool proposes automatic composition of astrophysical web services and brings a semantics-based, automatic composition of workflows. It widens the services choice and eases the use of heterogeneous services. Semantic web services composition relies on ontologies for elaborating the services composition; this work is based on Astrophysical Services ONtology (ASON). ASON had its structure mostly inherited from the VO services capacities. Nevertheless, our approach is not limited to the VO and brings VO plus non-VO services together without the need for premade recipes. CASAS is available for use through a simple web interface
The Virtual Astronomical Observatory: Re-engineering access to astronomical data
The US Virtual Astronomical Observatory was a software infrastructure and development project designed both to begin the establishment of an operational Virtual Observatory (VO) and to provide the US coordination with the international VO effort. The concept of the VO is to provide the means by which an astronomer is able to discover, access, and process data seamlessly, regardless of its physical location. This paper describes the origins of the VAO, including the predecessor efforts within the US National Virtual Observatory, and summarizes its main accomplishments. These accomplishments include the development of both scripting toolkits that allow scientists to incorporate VO data directly into their reduction and analysis environments and high-level science applications for data discovery, integration, analysis, and catalog cross-comparison. Working with the international community, and based on the experience from the software development, the VAO was a major contributor to international standards within the International Virtual Observatory Alliance. The VAO also demonstrated how an operational virtual observatory could be deployed, providing a robust operational environment in which VO services worldwide were routinely checked for aliveness and compliance with international standards. Finally, the VAO engaged in community outreach, developing a comprehensive web site with on-line tutorials, announcements, links to both US and internationally developed tools and services, and exhibits and hands-on training at annual meetings of the American Astronomical Society and through summer schools and community days. All digital products of the VAO Project, including software, documentation, and tutorials, are stored in a repository for community access. The enduring legacy of the VAO is an increasing expectation that new telescopes and facilities incorporate VO capabilities during the design of their data management systems
- …