Evolutionary Algorithms for Reinforcement Learning

There are two distinct approaches to solving reinforcement learning problems, namely, searching in value function space and searching in policy space. Temporal difference methods and evolutionary algorithms are well-known examples of these approaches. Kaelbling, Littman and Moore recently provided an informative survey of temporal difference methods. This article focuses on the application of evolutionary algorithms to the reinforcement learning problem, emphasizing alternative policy representations, credit assignment methods, and problem-specific genetic operators. Strengths and weaknesses of the evolutionary approach to reinforcement learning are presented, along with a survey of representative applications

The gradational history of southern Ismenius Lacus

Two epochs of accelerated gradation affected the geomorphic evolution of southern Ismenius Lacus. These periods of enhanced gradational activity were likely related to periods of more clement climate induced by release of either recycled exogenic or juvenile endogenic atmospheric volatiles. Variations in the intensity and duration of gradation during the second epoch are indicated by the variability in the timing of cessation and degree of air fall deposit removal across the study area. Overall intensity of gradation decreased through successive epochs based on: (1) the decreasing diameter at which cumulative statistics from the respective surfaces cease to follow the expected production function; and (2) the decrease in size/increase in density of preserved valley networks incised into surfaces of differing age. A comparable decrease in valley density with time has been noted in the Isidis region

Characteristics of ejecta and alluvial deposits at Meteor Crater, Arizona and Odessa Craters, Texas: Results from ground penetrating radar

Previous ground penetrating radar (GRP) studies around 50,000 year old Meteor Crater revealed the potential for rapid, inexpensive, and non-destructive sub-surface investigations for deep reflectors (generally greater than 10 m). New GRP results are summarized focusing the shallow sub-surfaces (1-2 m) around Meteor Crater and the main crater at Odessa. The following subject areas are covered: (1) the thickness, distribution, and nature of the contact between surrounding alluvial deposits and distal ejecta; and (2) stratigraphic relationships between both the ejecta and alluvium derived from both pre and post crater drainages. These results support previous conclusions indicating limited vertical lowering (less than 1 m) of the distal ejecta at Meteor Crater and allow initial assessment of the gradational state if the Odessa craters

Combustion of coal gas fuels in a staged combustor

Gaseous fuels produced from coal resources generally have heating values much lower than natural gas; the low heating value could result in unstable or inefficient combustion. Coal gas fuels may contain ammonia which if oxidized in an uncontrolled manner could result in unacceptable nitrogen oxide exhaust emission levels. Previous investigations indicate that staged, rich-lean combustion represents a desirable approach to achieve stable, efficient, low nitrogen oxide emission operation for coal-derived liquid fuels contaning up to 0.8-wt pct nitrogen. An experimental program was conducted to determine whether this fuel tolerance can be extended to include coal-derived gaseous fuels. The results of tests with three nitrogen-free fuels having heating values of 100, 250, and 350 Btu/scf and a 250 Btu/scf heating value doped to contain 0.7 pct ammonia are presented

Fluorine toxicosis in the Albino rat

The toxicity of fluorine compounds once considered of little general importance is no longer so regarded. The increasing use of fluorides as insecticides, the discovery that fluorine may be a component of many foodstuffs and the work of Dr. Margaret Cammack Smith and associates (77·88) in proving that potable waters containing as little as 0.9 parts per million of fluorine may produce mottled teeth in growing children when regularly ingested over periods of several years, has excited much popular as well as scientific interest in fluorine toxicoses. Ostrem, Nelson, Greenwood and Wilhelm (55) have shown that this mottling of teeth is endemic in certain sections in Iowa

Ionospheric simulator survey

Evaluation of D and E region ionospheric simulation technique

Domain structure of epitaxial Co films with perpendicular anisotropy

Epitaxial hcp Cobalt films with pronounced c-axis texture have been prepared by pulsed lased deposition (PLD) either directly onto Al2O3 (0001) single crystal substrates or with an intermediate Ruthenium buffer layer. The crystal structure and epitaxial growth relation was studied by XRD, pole figure measurements and reciprocal space mapping. Detailed VSM analysis shows that the perpendicular anisotropy of these highly textured Co films reaches the magnetocrystalline anisotropy of hcp-Co single crystal material. Films were prepared with thickness t of 20 nm < t < 100 nm to study the crossover from in-plane magnetization to out-of-plane magnetization in detail. The analysis of the periodic domain pattern observed by magnetic force microscopy allows to determine the critical minimum thickness below which the domains adopt a pure in-plane orientation. Above the critical thickness the width of the stripe domains is evaluated as a function of the film thickness and compared with domain theory. Especially the discrepancies at smallest film thicknesses show that the system is in an intermediate state between in-plane and out-of-plane domains, which is not described by existing analytical domain models

Reversible strain effect on the magnetization of LaCoO3 films

The magnetization of ferromagnetic LaCoO3 films grown epitaxially on piezoelectric substrates has been found to systematically decrease with the reduction of tensile strain. The magnetization change induced by the reversible strain variation reveals an increase of the Co magnetic moment with tensile strain. The biaxial strain dependence of the Curie temperature is estimated to be below 4K/% in the as-grown tensile strain state of our films. This is in agreement with results from statically strained films on various substrates