Data compression for data archival, browse or quick-look

Soon after space and Earth science data is collected, it is stored in one or more archival facilities for later retrieval and analysis. Since the purpose of the archival process is to keep an accurate and complete record of data, any data compression used in an archival system must be lossless, and protect against propagation of error in the storage media. A browse capability for space and Earth science data is needed to enable scientists to check the appropriateness and quality of particular data sets before obtaining the full data set(s) for detailed analysis. Browse data produced for these purposes could be used to facilitate the retrieval of data from an archival facility. Quick-look data is data obtained directly from the sensor for either previewing the data or for an application that requires very timely analysis of the space or Earth science data. Two main differences between data compression techniques appropriate to browse and quick-look cases, are that quick-look can be more specifically tailored, and it must be limited in complexity by the relatively limited computational power available on space platforms

NASA Center for Climate Simulation (NCCS) Advanced Technology AT5 Virtualized Infiniband Report

The NCCS is part of the Computational and Information Sciences and Technology Office (CISTO) of Goddard Space Flight Center's (GSFC) Sciences and Exploration Directorate. The NCCS's mission is to enable scientists to increase their understanding of the Earth, the solar system, and the universe by supplying state-of-the-art high performance computing (HPC) solutions. To accomplish this mission, the NCCS (https://www.nccs.nasa.gov) provides high performance compute engines, mass storage, and network solutions to meet the specialized needs of the Earth and space science user communitie

Developing an e-Research infrastructure for Australian earth sciences: the NCRIS 5.13 AuScope Grid

On the 27 November 2006 the Minister for the Department of Education, Science and Technology announced that under the National Collaborative Research Infrastructure Strategy (NCRIS) $42.8 million would go to Australian Earth Sciences to help build an integrated national infrastructure system called AuScope. A key element of AuScope is the AuScope Grid, which comprises an Earth Science Data Grid and a Compute Grid. Combined both provide a distributed computational e-Research infrastructure that will enable the construction of a dynamic updateable 4D Australian Earth Model. The goal of the AuScope Compute Grid is to facilitate quantitative geoscience analysis by providing an infrastructure and tools for advanced data mining, simulation and computational modelling. The AuScope Earth Science Data Grid is a proposed national geoscience data network, which aims to use international standards to allow real time access to data, information and knowledge stored in distributed repositories from academia, industry and government. The Data grid will be also built on ‘end-to-end’ Science principles (aka open access principles) whereby there will be access to the highly processed information and knowledge, as well as the original raw data and the processing programs used to generate the results

On the Origin of the Living State

abstract: The origin of Life on Earth is the greatest unsolved mystery in the history of science. In spite of progress in almost every scientific endeavor, we still have no clear theory, model, or framework to understand the processes that led to the emergence of life on Earth. Understanding such a processes would provide key insights into astrobiology, planetary science, geochemistry, evolutionary biology, physics, and philosophy. To date, most research on the origin of life has focused on characterizing and synthesizing the molecular building blocks of living systems. This bottom-up approach assumes that living systems are characterized by their component parts, however many of the essential features of life are system level properties which only manifest in the collective behavior of many components. In order to make progress towards solving the origin of life new modeling techniques are needed. In this dissertation I review historical approaches to modeling the origin of life. I proceed to elaborate on new approaches to understanding biology that are derived from statistical physics and prioritize the collective properties of living systems rather than the component parts. In order to study these collective properties of living systems, I develop computational models of chemical systems. Using these computational models I characterize several system level processes which have important implications for understanding the origin of life on Earth. First, I investigate a model of molecular replicators and demonstrate the existence of a phase transition which occurs dynamically in replicating systems. I characterize the properties of the phase transition and argue that living systems can be understood as a non-equilibrium state of matter with unique dynamical properties. Then I develop a model of molecular assembly based on a ribonucleic acid (RNA) system, which has been characterized in laboratory experiments. Using this model I demonstrate how the energetic properties of hydrogen bonding dictate the population level dynamics of that RNA system. Finally I return to a model of replication in which replicators are strongly coupled to their environment. I demonstrate that this dynamic coupling results in qualitatively different evolutionary dynamics than those expected in static environments. A key difference is that when environmental coupling is included, evolutionary processes do not select a single replicating species but rather a dynamically stable community which consists of many species. Finally, I conclude with a discussion of how these computational models can inform future research on the origins of life.Dissertation/ThesisDoctoral Dissertation Physics 201

Negotiation-based Choreography of Data-intensive Applications in the C3Grid Project

We present a negotiation and agreement strategy and protocol for the efficient scheduling of data intensive jobs in the Grid. It was developed with the background of the Collaborative Climate Community Data and Processing Grid (C3Grid), which provides a comprehensive infrastructure for solving computational problems in Earth System Science. The presented solution is a subset of the overall C3Grid architecture and especially focuses on the collaboration of Data Management and Workflow Scheduling. We evaluate our approach on a case study representing a complex application typical for climate research. Finally, extensions for future work – especially on standardization efforts – are reviewed

Rule-Based System Architecting of Earth Observing Systems: Earth Science Decadal Survey

This paper presents a methodology to explore the architectural trade space of Earth observing satellite systems, and applies it to the Earth Science Decadal Survey. The architecting problem is formulated as a combinatorial optimization problem with three sets of architectural decisions: instrument selection, assignment of instruments to satellites, and mission scheduling. A computational tool was created to automatically synthesize architectures based on valid combinations of options for these three decisions and evaluate them according to several figures of merit, including satisfaction of program requirements, data continuity, affordability, and proxies for fairness, technical, and programmatic risk. A population-based heuristic search algorithm is used to search the trade space. The novelty of the tool is that it uses a rule-based expert system to model the knowledge-intensive components of the problem, such as scientific requirements, and to capture the nonlinear positive and negative interactions between instruments (synergies and interferences), which drive both requirement satisfaction and cost. The tool is first demonstrated on the past NASA Earth Observing System program and then applied to the Decadal Survey. Results suggest that the Decadal Survey architecture is dominated by other more distributed architectures in which DESDYNI and CLARREO are consistently broken down into individual instruments."La Caixa" FoundationCharles Stark Draper LaboratoryGoddard Space Flight Cente

Earth Science Informatics - Overview

Over the last 10-15 years, significant advances have been made in information management, there are an increasing number of individuals entering the field of information management as it applies to Geoscience and Remote Sensing data, and the field of informatics has come to its own. Informatics is the science and technology of applying computers and computational methods to the systematic analysis, management, interchange, and representation of science data, information, and knowledge. Informatics also includes the use of computers and computational methods to support decision making and applications. Earth Science Informatics (ESI, a.k.a. geoinformatics) is the application of informatics in the Earth science domain. ESI is a rapidly developing discipline integrating computer science, information science, and Earth science. Major national and international research and infrastructure projects in ESI have been carried out or are on-going. Notable among these are: the Global Earth Observation System of Systems (GEOSS), the European Commissions INSPIRE, the U.S. NSDI and Geospatial One-Stop, the NASA EOSDIS, and the NSF DataONE, EarthCube and Cyberinfrastructure for Geoinformatics. More than 18 departments and agencies in the U.S. federal government have been active in Earth science informatics. All major space agencies in the world, have been involved in ESI research and application activities. In the United States, the Federation of Earth Science Information Partners (ESIP), whose membership includes nearly 150 organizations (government, academic and commercial) dedicated to managing, delivering and applying Earth science data, has been working on many ESI topics since 1998. The Committee on Earth Observation Satellites (CEOS)s Working Group on Information Systems and Services (WGISS) has been actively coordinating the ESI activities among the space agencies. Remote Sensing; Earth Science Informatics, Data Systems; Data Services; Metadat

Storage and network bandwidth requirements through the year 2000 for the NASA Center for Computational Sciences

The data storage and retrieval demands of space and Earth sciences researchers have made the NASA Center for Computational Sciences (NCCS) Mass Data Storage and Delivery System (MDSDS) one of the world's most active Convex UniTree systems. Science researchers formed the NCCS's Computer Environments and Research Requirements Committee (CERRC) to relate their projected supercomputing and mass storage requirements through the year 2000. Using the CERRC guidelines and observations of current usage, some detailed projections of requirements for MDSDS network bandwidth and mass storage capacity and performance are presented