Advanced techniques and technology for efficient data storage, access, and transfer

Advanced techniques for efficiently representing most forms of data are being implemented in practical hardware and software form through the joint efforts of three NASA centers. These techniques adapt to local statistical variations to continually provide near optimum code efficiency when representing data without error. Demonstrated in several earlier space applications, these techniques are the basis of initial NASA data compression standards specifications. Since the techniques clearly apply to most NASA science data, NASA invested in the development of both hardware and software implementations for general use. This investment includes high-speed single-chip very large scale integration (VLSI) coding and decoding modules as well as machine-transferrable software routines. The hardware chips were tested in the laboratory at data rates as high as 700 Mbits/s. A coding module's definition includes a predictive preprocessing stage and a powerful adaptive coding stage. The function of the preprocessor is to optimally process incoming data into a standard form data source that the second stage can handle.The built-in preprocessor of the VLSI coder chips is ideal for high-speed sampled data applications such as imaging and high-quality audio, but additionally, the second stage adaptive coder can be used separately with any source that can be externally preprocessed into the 'standard form'. This generic functionality assures that the applicability of these techniques and their recent high-speed implementations should be equally broad outside of NASA

Noiseless coding for the magnetometer

Future unmanned space missions will continue to seek a full understanding of magnetic fields throughout the solar system. Severely constrained data rates during certain portions of these missions could limit the possible science return. This publication investigates the application of universal noiseless coding techniques to more efficiently represent magnetometer data without any loss in data integrity. Performance results indicated that compression factors of 2:1 to 6:1 can be expected. Feasibility for general deep space application was demonstrated by implementing a microprocessor breadboard coder/decoder using the Intel 8086 processor. The Comet Rendezvous Asteroid Flyby mission will incorporate these techniques in a buffer feedback, rate-controlled configuration. The characteristics of this system are discussed

Algorithms for a very high speed universal noiseless coding module

The algorithmic definitions and performance characterizations are presented for a high performance adaptive coding module. Operation of at least one of these (single chip) implementations is expected to exceed 500 Mbits/s under laboratory conditions. Operation of a companion decoding module should operate at up to half the coder's rate. The module incorporates a powerful noiseless coder for Standard Form Data Sources (i.e., sources whose symbols can be represented by uncorrelated non-negative integers where the smaller integers are more likely than the larger ones). Performance close to data entropies can be expected over a Dynamic Range of from 1.5 to 12 to 14 bits/sample (depending on the implementation)

Paper Session III-A - Data Compression and Error-Protection Coding

Data Compression and Error-protection coding are two of the now widely heard but not well understood terms associated with the Information Super Highway. But this was not always so. Their familiarity is a consequence of developments which were initiated nearly 50 years ago with the introduction of modern information theory by Claude Shannon. Both concepts and techniques which can dramatically improve the representation, storage and communication of digital data - the underlying component of modern information systems. Although often invisible to individual users, the commercial applications of compression and coding, which affect Our daily lives now, have become extremely broad. Few of these applications can claim they were not directly or indirectly influenced by prior investments in this technology by NASA and the military. This paper describes important specific ongoing NASA direct technology transfers of data compression and error-protection coding techniques/technology. First jointly used to improve the return of Voyager images from Uranus and Neptune by a factor of 4, these techniques and their NASA sponsored custom high-speed microcircuits are now independently enjoying widespread use. A simplified laymen\u27s description of these techniques and their performance characteristics is followed by a status on their technology transfer

On the optimality of code options for a universal noiseless coder

A universal noiseless coding structure was developed that provides efficient performance over an extremely broad range of source entropy. This is accomplished by adaptively selecting the best of several easily implemented variable length coding algorithms. Custom VLSI coder and decoder modules capable of processing over 20 million samples per second are currently under development. The first of the code options used in this module development is shown to be equivalent to a class of Huffman code under the Humblet condition, other options are shown to be equivalent to the Huffman codes of a modified Laplacian symbol set, at specified symbol entropy values. Simulation results are obtained on actual aerial imagery, and they confirm the optimality of the scheme. On sources having Gaussian or Poisson distributions, coder performance is also projected through analysis and simulation

Some practical universal noiseless coding techniques, part 3, module PSl14,K+

The algorithmic definitions, performance characterizations, and application notes for a high-performance adaptive noiseless coding module are provided. Subsets of these algorithms are currently under development in custom very large scale integration (VLSI) at three NASA centers. The generality of coding algorithms recently reported is extended. The module incorporates a powerful adaptive noiseless coder for Standard Data Sources (i.e., sources whose symbols can be represented by uncorrelated non-negative integers, where smaller integers are more likely than the larger ones). Coders can be specified to provide performance close to the data entropy over any desired dynamic range (of entropy) above 0.75 bit/sample. This is accomplished by adaptively choosing the best of many efficient variable-length coding options to use on each short block of data (e.g., 16 samples) All code options used for entropies above 1.5 bits/sample are 'Huffman Equivalent', but they require no table lookups to implement. The coding can be performed directly on data that have been preprocessed to exhibit the characteristics of a standard source. Alternatively, a built-in predictive preprocessor can be used where applicable. This built-in preprocessor includes the familiar 1-D predictor followed by a function that maps the prediction error sequences into the desired standard form. Additionally, an external prediction can be substituted if desired. A broad range of issues dealing with the interface between the coding module and the data systems it might serve are further addressed. These issues include: multidimensional prediction, archival access, sensor noise, rate control, code rate improvements outside the module, and the optimality of certain internal code options

The implementation of a lossless data compression module in an advanced orbiting system: Analysis and development

Data compression has been proposed for several flight missions as a means of either reducing on board mass data storage, increasing science data return through a bandwidth constrained channel, reducing TDRSS access time, or easing ground archival mass storage requirement. Several issues arise with the implementation of this technology. These include the requirement of a clean channel, onboard smoothing buffer, onboard processing hardware and on the algorithm itself, the adaptability to scene changes and maybe even versatility to the various mission types. This paper gives an overview of an ongoing effort being performed at Goddard Space Flight Center for implementing a lossless data compression scheme for space flight. We will provide analysis results on several data systems issues, the performance of the selected lossless compression scheme, the status of the hardware processor and current development plan

Deducing signaling pathways from parallel actions of arsenite and antimonite in human epidermal keratinocytes.

Inorganic arsenic oxides have been identified as carcinogens in several human tissues, including epidermis. Due to the chemical similarity between trivalent inorganic arsenic (arsenite) and antimony (antimonite), we hypothesized that common intracellular targets lead to similarities in cellular responses. Indeed, transcriptional and proteomic profiling revealed remarkable similarities in differentially expressed genes and proteins resulting from exposure of cultured human epidermal keratinocytes to arsenite and antimonite in contrast to comparisons of arsenite with other metal compounds. These data were analyzed to predict upstream regulators and affected signaling pathways following arsenite and antimonite treatments. A majority of the top findings in each category were identical after treatment with either compound. Inspection of the predicted upstream regulators led to previously unsuspected roles for oncostatin M, corticosteroids and ephrins in mediating cellular response. The influence of these predicted mediators was then experimentally verified. Together with predictions of transcription factor effects more generally, the analysis has led to model signaling networks largely accounting for arsenite and antimonite action. The striking parallels between responses to arsenite and antimonite indicate the skin carcinogenic risk of exposure to antimonite merits close scrutiny

Observation and analysis of in situ carbonaceous matter in Nakhla: Part I

New analyses of indigenous secondary material in the martian meteorite Nakhla reveal amorphous carbon-rich veins and dendrites. The texture and chemistry of this material resembles that of biogenically altered sub-ocean basaltic glasses