Self-Modification of Policy and Utility Function in Rational Agents

Any agent that is part of the environment it interacts with and has versatile actuators (such as arms and fingers), will in principle have the ability to self-modify -- for example by changing its own source code. As we continue to create more and more intelligent agents, chances increase that they will learn about this ability. The question is: will they want to use it? For example, highly intelligent systems may find ways to change their goals to something more easily achievable, thereby `escaping' the control of their designers. In an important paper, Omohundro (2008) argued that goal preservation is a fundamental drive of any intelligent system, since a goal is more likely to be achieved if future versions of the agent strive towards the same goal. In this paper, we formalise this argument in general reinforcement learning, and explore situations where it fails. Our conclusion is that the self-modification possibility is harmless if and only if the value function of the agent anticipates the consequences of self-modifications and use the current utility function when evaluating the future.Comment: Artificial General Intelligence (AGI) 201

ESO 381-47, an early-type galaxy with extended HI and a star forming ring

ESO 381-47 is an early type galaxy with an extended HI disk. GALEX and very deep optical images reveal a distinct stellar ring far outside the optical body with a diameter of ~30 kpc, which has undergone recent star formation at 1.8 x 10^-4 Msun/yr/kpc^-2, consistent with other new results which detect low level star formation below the traditional Kennicutt relation in the outer parts of spiral galaxies. The morphology of this galaxy resembles the recently identified class of ultraviolet objects called extended ultraviolet disks, or XUV-disks. New HI observations of this galaxy taken at the ATCA and in the CnB array at the VLA show that the cold gas lies in an extended (diameter ~90 kpc) ring around the central S0 galaxy. The HI data cube can be well modeled by a warped ring. The faint ionized gas in the inner parts of the galaxy is kinematically decoupled from the stars and instead appears to exhibit velocities consistent with the rotation of the HI ring at larger radius. The peak of the stellar ring, as seen in the optical and UV, is slightly displaced to the inside relative to the peak of the HI ring. We discuss the manner in which this offset could be caused by the propagation of a radial density wave through an existing stellar disk, perhaps triggered by a galaxy collision at the center of the disk, or possibly due to a spiral density wave set up at early times in a disk too hot to form a stellar bar. Gas accretion and resonance effects due to a bar which has since dissolved are also considered to explain the presence of the star forming ring seen in the GALEX and deep optical data.Comment: 48 pages, 16 figures, 4 tables. Accepted for publication in the Astronomical Journa

Extended Emission Line Gas in Radio Galaxies - PKS0349-27

PKS0349-27 is a classical FRII radio galaxy with an AGN host which has a spectacular, spiral-like structure in its extended emission line gas (EELG). We have measured the velocity field in this gas and find that it splits into 2 cloud groups separated by radial velocities which at some points approach 400 km/s Measurements of the diagnostic emission line ratios [OIII]5007/H-beta, [SII]6716+6731/H-alpha, and [NII]6583/H-alpha in these clouds show no evidence for the type of HII region emission associated with starburst activity in either velocity system. The measured emission line ratios are similar to those found in the nuclei of narrow-line radio galaxies, but the extended ionization/excitation cannot be produced by continuum emission from the active nucleus alone. We present arguments which suggest that the velocity disturbances seen in the EELG are most likely the result of a galaxy-galaxy collision or merger but cannot completely rule out the possibility that the gas has been disrupted by the passage of a radio jet.Comment: 12 pages, 3 fig pages, to appear in the Astrophys.

Principles And Practices Fostering Inclusive Excellence: Lessons From The Howard Hughes Medical Institute’s Capstone Institutions

Best-practices pedagogy in science, technology, engineering, and mathematics (STEM) aims for inclusive excellence that fosters student persistence. This paper describes principles of inclusivity across 11 primarily undergraduate institutions designated as Capstone Awardees in Howard Hughes Medical Institute’s (HHMI) 2012 competition. The Capstones represent a range of institutional missions, student profiles, and geographical locations. Each successfully directed activities toward persistence of STEM students, especially those from traditionally underrepresented groups, through a set of common elements: mentoring programs to build community; research experiences to strengthen scientific skill/identity; attention to quantitative skills; and outreach/bridge programs to broaden the student pool. This paper grounds these program elements in learning theory, emphasizing their essential principles with examples of how they were implemented within institutional contexts. We also describe common assessment approaches that in many cases informed programming and created traction for stakeholder buy-in. The lessons learned from our shared experiences in pursuit of inclusive excellence, including the resources housed on our companion website, can inform others’ efforts to increase access to and persistence in STEM in higher education

A New Distance to The Antennae Galaxies (NGC 4038/39) Based on the Type Ia Supernova 2007sr

Traditionally, the distance to NGC 4038/39 has been derived from the systemic recession velocity, yielding about 20 Mpc for H_0 = 72 km/s/Mpc. Recently, this widely adopted distance has been challenged based on photometry of the presumed tip of the red giant branch (TRGB), which seems to yield a shorter distance of 13.3+-1.0 Mpc and, with it, nearly 1 mag lower luminosities and smaller radii for objects in this prototypical merger. Here we present a new distance estimate based on observations of the Type Ia supernova (SN) 2007sr in the southern tail, made at Las Campanas Observatory as part of the Carnegie Supernova Project. The resulting distance of D(SN Ia) = 22.3+-2.8 Mpc [(m-M)_0 = 31.74+-0.27 mag] is in good agreement with a refined distance estimate based on the recession velocity and the large-scale flow model developed by Tonry and collaborators, D(flow) = 22.5+-2.8 Mpc. We point out three serious problems that a short distance of 13.3 Mpc would entail, and trace the claimed short distance to a likely misidentification of the TRGB. Reanalyzing Hubble Space Telescope (HST) data in the Archive with an improved method, we find a TRGB fainter by 0.9 mag and derive from it a preliminary new TRGB distance of D(TRGB) = 20.0+-1.6 Mpc. Finally, assessing our three distance estimates we recommend using a conservative, rounded value of D = 22+-3 Mpc as the best currently available distance to The Antennae.Comment: 8 pages, 5 figures, 1 table (emulateapj; uses amsmath package). Accepted for publication in The Astronomical Journal, Vol. 136. Figs. 1 & 2 degraded to reduce file size

Dynamical Modeling of Galaxy Mergers Using Identikit

We present dynamical models of four interacting systems: NGC 5257/8, The Mice, the Antennae, and NGC 2623. The parameter space of the encounters are constrained using the Identikit model-matching and visualization tool. Identikit utilizes hybrid N-body and test particle simulations to enable rapid exploration of the parameter space of galaxy mergers. The Identikit-derived matches of these systems are reproduced with self-consistent collisionless simulations which show very similar results. The models generally reproduce the observed morphology and H I kinematics of the tidal tails in these systems with reasonable properties inferred for the progenitor galaxies. The models presented here are the first to appear in the literature for NGC 5257/8 and NGC 2623, and The Mice and the Antennae are compared with previously published models. Based on the assumed mass model and our derived initial conditions, the models indicate that the four systems are currently being viewed 175-260 Myr after first passage and cover a wide range of merger stages. In some instances there are mismatches between the models and the data (e.g., in the length of a tail); these are likely due to our adoption of a single mass model for all galaxies. Despite the use of a single mass model, these results demonstrate the utility of Identikit in constraining the parameter space for galaxy mergers when applied to real data

Spitzer IRS Spectral Mapping of the Toomre Sequence: Spatial Variations of PAH, Gas, and Dust Properties in Nearby Major Mergers

We have mapped the key mid-IR diagnostics in eight major merger systems of the Toomre Sequence (NGC4676, NGC7592, NGC6621, NGC2623, NGC6240, NGC520, NGC3921, and NGC7252) using the Spitzer Infrared Spectrograph (IRS). With these maps, we explore the variation of the ionized-gas, PAH, and warm-gas (H_2) properties across the sequence and within the galaxies. While the global PAH interband strength and ionized gas flux ratios ([Ne III]/[Ne II]) are similar to those of normal star forming galaxies, the distribution of the spatially resolved PAH and fine structure line flux ratios is significant different from one system to the other. Rather than a constant H_2/PAH flux ratio, we find that the relation between the H_2 and PAH fluxes is characterized by a power law with a roughly constant exponent (0.61+/-0.05) over all merger components and spatial scales. While following the same power law on local scales, three galaxies have a factor of ten larger integrated (i.e. global) H_2/PAH flux ratio than the rest of the sample, even larger than what it is in most nearby AGNs. These findings suggest a common dominant excitation mechanism for H_2 emission over a large range of global H_2/PAH flux ratios in major mergers. Early merger systems show a different distribution between the cold (CO J=1-0) and warm (H_2) molecular gas component, which is likely due to the merger interaction. Strong evidence for buried star formation in the overlap region of the merging galaxies is found in two merger systems (NGC6621 and NGC7592) as seen in the PAH, [Ne II], [Ne III], and warm gas line emission, but with no apparent corresponding CO (J=1-0) emission. Our findings also demonstrate that the variations of the physical conditions within a merger are much larger than any systematic trends along the Toomre Sequence.Comment: 35 pages, accepted for publication in ApJ

A 180 Kpc Tidal Tail in the Luminous Infrared Merger Arp 299

We present VLA HI observations and UH88 deep optical B- and R-band observations of the IR luminous merger Arp 299 (= NGC 3690 + IC 694). These data reveal a gas-rich, optically faint tidal tail with a length of over 180 kpc. The size of this tidal feature necessitates an old interaction age for the merger (~750 Myr since first periapse), which is currently experiencing a very young star burst (~20 Myr). The observations reveal a most remarkable structure within the tidal tail: it appears to be composed of two parallel filaments separated by ~20 kpc. One of the filaments is gas rich with little if any starlight, while the other is gas poor. We believe that this bifurcation results from a warped disk in one of the progenitors. The quantities and kinematics of the tidal HI suggest that Arp 299 results from the collision of a retrograde Sab-Sb galaxy (IC 694) and a prograde Sbc-Sc galaxy (NGC 3690) that occurred 750 Myr ago and which will merge into a single object in ~60 Myr. We suggest that the present IR luminous phase in this system is due in part to the retrograde spin of IC 694. Finally, we discuss the apparent lack of tidal dwarf galaxies within the tail.Comment: LaTex, 14 pages, 11 figures, 4 tables, uses emulateapj.sty. Accepted to AJ for July 1999. For version with full-resolution images see http://www.cv.nrao.edu/~jhibbard/a299/HIpaper/a299HI.htm