Reducing synchronization in distributed parallel programs

Developers of scalable libraries and applications for distributed-memory parallel systems face many challenges to attaining high performance. These challenges include communication latency, critical path delay, suboptimal scheduling, load imbalance, and system noise. These challenges are often defined and measured relative to points of broad synchronization in the program’s execution. Given the way in which many algorithms are defined and systems are implemented, gauging the above challenges at synchronization points is not unreasonable. In this thesis, I attempt to demonstrate that in many cases, those synchronization points are themselves the core issue behind these challenges. In some cases, the synchronizing operations cause a program to incur the costs from these challenges. In other cases, the presence of synchronization potentially exacerbates these problems. Through a simple performance model, I demonstrate that making synchronization less frequent can greatly mitigate performance issues. My work and several results in the literature show that many motifs and whole applications can be successfully redesigned to operate with asymptotically less synchronization than their naïve starting points. In exploring these issues, I have identified recurrent patterns across many applications and multiple environments that can guide future efforts more directly toward synchronization-avoiding designs. Thus, I attempt to offer developers the beginnings of a high-level play-book to follow rather than having to rediscover application-specific instances of the patterns

HPCCP/CAS Workshop Proceedings 1998

This publication is a collection of extended abstracts of presentations given at the HPCCP/CAS (High Performance Computing and Communications Program/Computational Aerosciences Project) Workshop held on August 24-26, 1998, at NASA Ames Research Center, Moffett Field, California. The objective of the Workshop was to bring together the aerospace high performance computing community, consisting of airframe and propulsion companies, independent software vendors, university researchers, and government scientists and engineers. The Workshop was sponsored by the HPCCP Office at NASA Ames Research Center. The Workshop consisted of over 40 presentations, including an overview of NASA's High Performance Computing and Communications Program and the Computational Aerosciences Project; ten sessions of papers representative of the high performance computing research conducted within the Program by the aerospace industry, academia, NASA, and other government laboratories; two panel sessions; and a special presentation by Mr. James Bailey

Interactive physically-based sound simulation

The realization of interactive, immersive virtual worlds requires the ability to present a realistic audio experience that convincingly compliments their visual rendering. Physical simulation is a natural way to achieve such realism, enabling deeply immersive virtual worlds. However, physically-based sound simulation is very computationally expensive owing to the high-frequency, transient oscillations underlying audible sounds. The increasing computational power of desktop computers has served to reduce the gap between required and available computation, and it has become possible to bridge this gap further by using a combination of algorithmic improvements that exploit the physical, as well as perceptual properties of audible sounds. My thesis is a step in this direction. My dissertation concentrates on developing real-time techniques for both sub-problems of sound simulation: synthesis and propagation. Sound synthesis is concerned with generating the sounds produced by objects due to elastic surface vibrations upon interaction with the environment, such as collisions. I present novel techniques that exploit human auditory perception to simulate scenes with hundreds of sounding objects undergoing impact and rolling in real time. Sound propagation is the complementary problem of modeling the high-order scattering and diffraction of sound in an environment as it travels from source to listener. I discuss my work on a novel numerical acoustic simulator (ARD) that is hundred times faster and consumes ten times less memory than a high-accuracy finite-difference technique, allowing acoustic simulations on previously intractable spaces, such as a cathedral, on a desktop computer. Lastly, I present my work on interactive sound propagation that leverages my ARD simulator to render the acoustics of arbitrary static scenes for multiple moving sources and listener in real time, while accounting for scene-dependent effects such as low-pass filtering and smooth attenuation behind obstructions, reverberation, scattering from complex geometry and sound focusing. This is enabled by a novel compact representation that takes a thousand times less memory than a direct scheme, thus reducing memory footprints to within available main memory. To the best of my knowledge, this is the only technique and system in existence to demonstrate auralization of physical wave-based effects in real-time on large, complex 3D scenes

Design and Fabrication of Scalable Multifunctional Multimaterial Fibers and Textiles

Multimaterial fibers eschew the traditional mono-material structures typical of traditional optical fibers for novel internal architectures that combine disparate materials with distinct optical, mechanical, and electronic properties, thereby enabling novel optoelectronic functionalities delivered in the form factor of an extended fiber. This new class of fibers developed over the past two decades is attracting interest from researchers in such different fields as optics, textiles, and biomedicine. The juxtaposition of multiple materials integrated at micro- and nanoscales in complex geometries while ensuring intimate smooth interfaces extending continuously for kilometers facilitates unique applications such as non-invasive laser surgery, self-monitoring fibers, e-textiles, and extreme-environment tethers. In this work, I focus on the scalable manufacturing of novel multimaterial fibers that make possible the fabrication of hundreds of kilometers of optical micro-cables and producing fibers at volumes commensurate with the needs of the textile and apparel industry. Although a multiplicity of fabrication schemes exists, I have investigated thermal drawing and melt-extrusion for thermo-forming of multimaterial fibers. Such fibers can be readily integrated with a broad range of downstream processes and techniques, such as textile weaving, precision-winding of fiber micro-cables, and inline functional coating. Specifically, I have developed a hybrid fabrication approach to produce robust optical fibers for single-mode and multi-mode mid-infrared transmission with the added possibility of high-power-handling capability. Second, I describe an optoelectronic fiber in which an electrically conductive composite glass is thermally co-drawn in a transparent glass matrix with a crystalline semiconductor and metallic conductors, which is the first fully integrated thermally drawn optoelectronic fiber making use of a traditional semiconductor. Third, I appropriate the industry-proven system of multicomponent melt-extrusion traditionally utilized for the scalable production of textile yarns and non-woven fabrics to produce our multimaterial fiber structures previously fabricated via thermal drawing. This has enabled melt-spinning of user-controlled color-changing fibers that are subsequently woven into active color-changing fabrics. I additionally report the design and prototyping of structured capacitive fibers for potential integration into advanced functional e-textiles. Finally, I have produced a new class of optical scattering materials based on designer composite microspheres by exploiting a recently discovered capillary instability in multimaterial fibers produced by thermal drawing, multifilament yarn spinning, and melt-extruded non-woven fabrics

1992 NASA/ASEE Summer Faculty Fellowship Program

For the 28th consecutive year, a NASA/ASEE Summer Faculty Fellowship Program was conducted at the Marshall Space Flight Center (MSFC). The program was conducted by the University of Alabama and MSFC during the period June 1, 1992 through August 7, 1992. Operated under the auspices of the American Society for Engineering Education, the MSFC program, was well as those at other centers, was sponsored by the Office of Educational Affairs, NASA Headquarters, Washington, DC. The basic objectives of the programs, which are the 29th year of operation nationally, are (1) to further the professional knowledge of qualified engineering and science faculty members; (2) to stimulate and exchange ideas between participants and NASA; (3) to enrich and refresh the research and teaching activities of the participants' institutions; and (4) to contribute to the research objectives of the NASA centers

Parallel and Distributed Computing

The 14 chapters presented in this book cover a wide variety of representative works ranging from hardware design to application development. Particularly, the topics that are addressed are programmable and reconfigurable devices and systems, dependability of GPUs (General Purpose Units), network topologies, cache coherence protocols, resource allocation, scheduling algorithms, peertopeer networks, largescale network simulation, and parallel routines and algorithms. In this way, the articles included in this book constitute an excellent reference for engineers and researchers who have particular interests in each of these topics in parallel and distributed computing