Settling the Reward Hypothesis

The reward hypothesis posits that, "all of what we mean by goals and purposes can be well thought of as maximization of the expected value of the cumulative sum of a received scalar signal (reward)." We aim to fully settle this hypothesis. This will not conclude with a simple affirmation or refutation, but rather specify completely the implicit requirements on goals and purposes under which the hypothesis holds

High-Rate Data-Capture for an Airborne Lidar System

A high-rate data system was required to capture the data for an airborne lidar system. A data system was developed that achieved up to 22 million (64-bit) events per second sustained data rate (1408 million bits per second), as well as short bursts (less than 4 s) at higher rates. All hardware used for the system was off the shelf, but carefully selected to achieve these rates. The system was used to capture laser fire, single-photon detection, and GPS data for the Slope Imaging Multi-polarization Photo-counting Lidar (SIMPL). However, the system has applications for other laser altimeter systems (waveform-recording), mass spectroscopy, xray radiometry imaging, high-background- rate ranging lidar, and other similar areas where very high-speed data capture is needed. The data capture software was used for the SIMPL instrument that employs a micropulse, single-photon ranging measurement approach and has 16 data channels. The detected single photons are from two sources those reflected from the target and solar background photons. The instrument is non-gated, so background photons are acquired for a range window of 13 km and can comprise many times the number of target photons. The highest background rate occurs when the atmosphere is clear, the Sun is high, and the target is a highly reflective surface such as snow. Under these conditions, the total data rate for the 16 channels combined is expected to be approximately 22 million events per second. For each photon detection event, the data capture software reads the relative time of receipt, with respect to a one-per-second absolute time pulse from a GPS receiver, from an event timer card with 0.1-ns precision, and records that information to a RAID (Redundant Array of Independent Disks) storage device. The relative time of laser pulse firings must also be read and recorded with the same precision. Each of the four event timer cards handles the throughput from four of the channels. For each detection event, a flag is recorded that indicates the source channel. To accommodate the expected maximum count rate and also handle the other extreme of very low rates occurring during nighttime operations, the software requests a set amount of data from each of the event timer cards and buffers the data. The software notes if any of the cards did not return all the data requested and then accommodates that lower rate. The data is buffered to minimize the I/O overhead of writing the data to storage. Care was taken to optimize the reads from the cards, the speed of the I/O bus, and RAID configuration

Laser Transmitter Design and Performance for the Slope Imaging Multi-Polarization Photon-Counting Lidar (SIMPL) Instrument

The Slope Imaging Multi-polarization Photon-counting Lidar (SIMPL) instrument is a polarimetric, two-color, multibeam push broom laser altimeter developed through the NASA Earth Science Technology Office Instrument Incubator Program and has been flown successfully on multiple airborne platforms since 2008. In this talk we will discuss the laser transmitter performance and present recent science data collected over the Greenland ice sheet and sea ice in support of the NASA Ice Cloud and land Elevation Satellite 2 (ICESat-2) mission to be launched in 2017

Rainbow: Combining Improvements in Deep Reinforcement Learning

The deep reinforcement learning community has made several independent improvements to the DQN algorithm. However, it is unclear which of these extensions are complementary and can be fruitfully combined. This paper examines six extensions to the DQN algorithm and empirically studies their combination. Our experiments show that the combination provides state-of-the-art performance on the Atari 2600 benchmark, both in terms of data efficiency and final performance. We also provide results from a detailed ablation study that shows the contribution of each component to overall performance.Comment: Under review as a conference paper at AAAI 201

Advanced Solid-State Array Spectrometer (ASAS) data sets from the 1990 field season: A unique look at two forested ecosystems

The Advanced Solid-state Array Spectrometer (ASAS) is a pointable imaging spectrometer which uses a solid-state array to acquire imagery of terrestrial targets in 29 spectral bands from .4 to .8 microns. Performance and calibration of the instrument are described. The ASAS data sets obtained in 1990 provide a unique look at forest canopies from two different forest regions of the North America continent under varying temporal, spectral, and bidirectional conditions. These data sets will be used to study such parameters as the albedo of forest canopies, the dynamics of scene radiation due to factors such as canopy architecture, moisture stress, leaf chemistry, topography, and understory composition

Airborne Polarimetric, Two-Color Laser Altimeter Measurements of Lake Ice Cover: A Pathfinder for NASA's ICESat-2 Spaceflight Mission

The ICESat-2 mission will continue NASA's spaceflight laser altimeter measurements of ice sheets, sea ice and vegetation using a new measurement approach: micropulse, single photon ranging at 532 nm. Differential penetration of green laser energy into snow, ice and water could introduce errors in sea ice freeboard determination used for estimation of ice thickness. Laser pulse scattering from these surface types, and resulting range biasing due to pulse broadening, is assessed using SIMPL airborne data acquired over icecovered Lake Erie. SIMPL acquires polarimetric lidar measurements at 1064 and 532 nm using the micropulse, single photon ranging measurement approach

Performance Considerations for the SIMPL Single Photon, Polarimetric, Two-Color Laser Altimeter as Applied to Measurements of Forest Canopy Structure and Composition

The Slope Imaging Multi-polarization Photon-counting Lidar (SIMPL) is a multi-beam, micropulse airborne laser altimeter that acquires active and passive polarimetric optical remote sensing measurements at visible and near-infrared wavelengths. SIMPL was developed to demonstrate advanced measurement approaches of potential benefit for improved, more efficient spaceflight laser altimeter missions. SIMPL data have been acquired for wide diversity of forest types in the summers of 2010 and 2011 in order to assess the potential of its novel capabilities for characterization of vegetation structure and composition. On each of its four beams SIMPL provides highly-resolved measurements of forest canopy structure by detecting single-photons with 15 cm ranging precision using a narrow-beam system operating at a laser repetition rate of 11 kHz. Associated with that ranging data SIMPL provides eight amplitude parameters per beam unlike the single amplitude provided by typical laser altimeters. Those eight parameters are received energy that is parallel and perpendicular to that of the plane-polarized transmit pulse at 532 nm (green) and 1064 nm (near IR), for both the active laser backscatter retro-reflectance and the passive solar bi-directional reflectance. This poster presentation will cover the instrument architecture and highlight the performance of the SIMPL instrument with examples taken from measurements for several sites with distinct canopy structures and compositions. Specific performance areas such as probability of detection, after pulsing, and dead time, will be highlighted and addressed, along with examples of their impact on the measurements and how they limit the ability to accurately model and recover the canopy properties. To assess the sensitivity of SIMPL's measurements to canopy properties an instrument model has been implemented in the FLIGHT radiative transfer code, based on Monte Carlo simulation of photon transport. SIMPL data collected in 2010 over the Smithsonian Environmental Research Center, MD are currently being modelled and compared to other remote sensing and in situ data sets. Results on the adaptation of FLIGHT to model micropulse, single'photon ranging measurements are presented elsewhere at this conference. NASA's ICESat-2 spaceflight mission, scheduled for launch in 2016, will utilize a multi-beam, micropulse, single-photon ranging measurement approach (although non-polarimetric and only at 532 nm). Insights gained from the analysis and modelling of SIMPL data will help guide preparations for that mission, including development of calibration/validation plans and algorithms for the estimation of forest biophysical parameters