A New Optimal Stepsize For Approximate Dynamic Programming

Approximate dynamic programming (ADP) has proven itself in a wide range of applications spanning large-scale transportation problems, health care, revenue management, and energy systems. The design of effective ADP algorithms has many dimensions, but one crucial factor is the stepsize rule used to update a value function approximation. Many operations research applications are computationally intensive, and it is important to obtain good results quickly. Furthermore, the most popular stepsize formulas use tunable parameters and can produce very poor results if tuned improperly. We derive a new stepsize rule that optimizes the prediction error in order to improve the short-term performance of an ADP algorithm. With only one, relatively insensitive tunable parameter, the new rule adapts to the level of noise in the problem and produces faster convergence in numerical experiments.Comment: Matlab files are included with the paper sourc

Beta measurements

The second year's results of the BETA project research are presented. The program is divided into two areas, aerosol modification and climatology in the trade wind region and the climatology of BETA (CO2) on remote mountain top locations. Limited data is available on the aerosol climatology of the marine free troposphere (MFT) in the trade wind region. In order to study the effects of cumulus convection on the MFT values of BETA, a cloud model was developed to simulate the evolution of a typical Pacific trade wind cumulus cloud. The stages involved in this development are outlined. The assembly of the major optical components of the lidar was made. Tests were run of the spectral bandwidth of the Synrad laser when a portion of the beam is mixed with a component which has traveled 450 meters corresponding to a delay of 1.5 microsecs. The bandwidth of the beat signal was measured to be 3 KHz. The data processing system based on a parallel processing filter bank analyzer using true time squaring detectors at each filter was completed

An assessment of inductive coupling roadway powered vehicles

The technical concept underlying the roadway powered vehicle system is the combination of an electrical power source embedded in the roadway and a vehicle-mounted power pickup that is inductively coupled to the roadway power source. The feasibility of such a system, implemented on a large scale was investigated. Factors considered included current and potential transportation modes and requirements, economics, energy, technology, social and institutional issues. These factors interrelate in highly complex ways, and a firm understanding of each of them does not yet exist. The study therefore was structured to manipulate known data in equally complex ways to produce a schema of options and useful questions that can form a basis for further, harder research. A dialectical inquiry technique was used in which two adversary teams, mediated by a third-party team, debated each factor and its interrelationship with the whole of the known information on the topic

Long-time evolution of magnetic fields in relativistic GRB shocks

We investigate the long-time evolution of magnetic fields generated by the two-stream instability at ultra- and sub-relativistic astrophysical collisionless shocks. Based on 3D PIC simulation results, we introduce a 2D toy model of interacting current filaments. Within the framework of this model, we demonstrate that the field correlation scale in the region far downstream the shock grows nearly as the light crossing time, lambda(t) ~ ct, thus making the diffusive field dissipation inefficient. The obtained theoretical scaling is tested using numerical PIC simulations. This result extends our understanding of the structure of collisionless shocks in gamma-ray bursts and other astrophysical objects.Comment: 5 pages. 2 figures. Submitted to ApJ