A Compiler and Runtime Infrastructure for Automatic Program Distribution

This paper presents the design and the implementation of a compiler and runtime infrastructure for automatic program distribution. We are building a research infrastructure that enables experimentation with various program partitioning and mapping strategies and the study of automatic distribution's effect on resource consumption (e.g., CPU, memory, communication). Since many optimization techniques are faced with conflicting optimization targets (e.g., memory and communication), we believe that it is important to be able to study their interaction. We present a set of techniques that enable flexible resource modeling and program distribution. These are: dependence analysis, weighted graph partitioning, code and communication generation, and profiling. We have developed these ideas in the context of the Java language. We present in detail the design and implementation of each of the techniques as part of our compiler and runtime infrastructure. Then, we evaluate our design and present preliminary experimental data for each component, as well as for the entire system

Toward improved streamflow forecasts: Value of semidistributed modeling

The focus of this study is to assess the performance improvements of semidistributed applications of the U.S. National Weather Service Sacramento Soil Moisture Accounting model on a watershed using radar-based remotely sensed precipitation data. Specifically, performance comparisons are made within an automated multicriteria calibration framework to evaluate the benefit of "spatial distribution" of the model input (precipitation), structural components (soil moisture and streamflow routing computations), and surface characteristics (parameters). A comparison of these results is made with those obtained through manual calibration. Results indicate that for the study watershed, there are performance improvements associated with semidistributed model applications when the watershed is partitioned into three subwatersheds; however, no additional benefit is gained from increasing the number of subwatersheds from three to eight. Improvements in model performance are demonstrably related to the spatial distribution of the model input and streamflow routing. Surprisingly, there is no improvement associated with the distribution of the surface characteristics (model parameters)

Autonomic log/restore for advanced optimistic simulation systems

In this paper we address state recoverability in optimistic simulation systems by presenting an autonomic log/restore architecture. Our proposal is unique in that it jointly provides the following features: (i) log/restore operations are carried out in a completely transparent manner to the application programmer, (ii) the simulation-object state can be scattered across dynamically allocated non-contiguous memory chunks, (iii) two differentiated operating modes, incremental vs non-incremental, coexist via transparent, optimized run-time management of dual versions of the same application layer, with dynamic selection of the best suited operating mode in different phases of the optimistic simulation run, and (iv) determinationof the best suited mode for any time frame is carried out on the basis of an innovative modeling/optimization approach that takes into account stability of each operating mode vs variations of the model execution parameters. © 2010 IEEE