Stereotype and skew: Quantifying gender bias in pre-trained and fine-tuned language models

This paper proposes two intuitive metrics, skew and stereotype, that quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun resolution task. We find evidence that gender stereotype correlates approximately negatively with gender skew in out-of-the-box models, suggesting that there is a trade-off between these two forms of bias. We investigate two methods to mitigate bias. The first approach is an online method which is effective at removing skew at the expense of stereotype. The second, inspired by previous work on ELMo, involves the fine-tuning of BERT using an augmented gender-balanced dataset. We show that this reduces both skew and stereotype relative to its unaugmented fine-tuned counterpart. However, we find that existing gender bias benchmarks do not fully probe professional bias as pronoun resolution may be obfuscated by cross-correlations from other manifestations of gender prejudice. Our code is available online

Radiative Shock-Induced Collapse of Intergalactic Clouds

Accumulating observational evidence for a number of radio galaxies suggests an association between their jets and regions of active star formation. The standard picture is that shocks generated by the jet propagate through an inhomogeneous medium and trigger the collapse of overdense clouds, which then become active star-forming regions. In this contribution, we report on recent hydrodynamic simulations of radiative shock-cloud interactions using two different cooling models: an equilibrium cooling-curve model assuming solar metallicities and a non-equilibrium chemistry model appropriate for primordial gas clouds. We consider a range of initial cloud densities and shock speeds in order to quantify the role of cooling in the evolution. Our results indicate that for moderate cloud densities (>1 cm^{-3}) and shock Mach numbers (<20), cooling processes can be highly efficient and result in more than 50% of the initial cloud mass cooling to below 100 K. We also use our results to estimate the final H_2 mass fraction for the simulations that use the non-equilibrium chemistry package. This is an important measurement, since H_2 is the dominant coolant for a primordial gas cloud. We find peak H_2 mass fractions of >0.01 and total H_2 mass fractions of >10^{-5} for the cloud gas. Finally, we compare our results with the observations of jet-induced star formation in ``Minkowski's Object.'' We conclude that its morphology, star formation rate (~ 0.3M_solar/yr) and stellar mass (~ 1.2 x 10^7 M_solar) can be explained by the interaction of a 90,000 km/s jet with an ensemble of moderately dense (~ 10 cm^{-3}), warm (10^4 K) intergalactic clouds in the vicinity of its associated radio galaxy at the center of the galaxy cluster.Comment: 30 pages, 7 figures, submitted to Astrophysical Journa

The Nascent Red Sequence at z~2

We present new constraints on the evolution of the early-type galaxy color-magnitude relation (CMR) based on deep near-infrared imaging of a galaxy protocluster at z=2.16 obtained using NICMOS on-board the Hubble Space Telescope. This field contains a spectroscopically confirmed space-overdensity of Lyman-alpha and H-alpha emitting galaxies which surrounds the powerful radio galaxy MRC 1138-262. Using these NICMOS data we identify a significant surface-overdensity (= 6.2x) of red J-H galaxies in the color-magnitude diagram (when compared with deep NICMOS imaging from the HDF-N and UDF). The optical-NIR colors of these prospective red-sequence galaxies indicate the presence of on-going dust-obscured star-formation or recently formed (<~ 1.5 Gyr)stellar populations in a majority of the red galaxies. We measure the slope and intrinsic scatter of the CMR for three different red galaxy samples selected by a wide color cut, and using photometric redshifts both with and without restrictions on rest-frame optical morphology. In all three cases both the rest-frame $U-B$ slope and intrinsic color scatter are considerably higher than corresponding values for lower redshift galaxy clusters. These results suggest that while some relatively quiescent galaxies do exist in this protocluster both the majority of the galaxy population and hence the color-magnitude relation are still in the process of forming, as expected.Comment: 8 pages, 7 figures, accepted for publication in ApJ (to appear June 1, 2008, v679n2

CO(4-3) and dust emission in two powerful high-z radio galaxies, and CO lines at high redshifts

We report the detection of sub-mm emission from dust at 850 microns and of the 12CO J=4-3 line in the two distant powerful radio galaxies 4C 60.07 (z=3.79) and 6C 1909+722 (z=3.53). In the case of 4C 60.07 the dust emission is also detected at 1.25 mm. The estimated molecular gas masses are large, of the order of ~(0.5-1)x10^{11} Solar. The large FIR luminosities (L_fir ~ 10^{13} Solar) suggest that we are witnessing two major starburst phenomena, while the observed large velocity widths (FWHM > 500 km/sec) are characteristic of mergers. In the case of 4C 60.07 the CO emission extends over ~30 kpc and spans a velocity range of >1000 km/sec. It consists of two distinct features with FWHM of >= 550 km/sec and ~150 km/sec and line centers separated by >=700 km/sec The least massive of these components is probably very gas-rich with potentially >=60% of its dynamical mass in the form of molecular gas. The extraordinary morphology of the CO emission in this object suggests that it is not just a scaled-up version of a local Ultra Luminous Infrared Galaxy, and it may be a formative stage of the elliptical host of the residing radio-loud AGN. Finally we briefly explore the effects of the wide range of gas excitation conditions expected for starburst environments on the luminosity of high-J CO lines. We conclude that in unlensed objects, CO (J+1-->J), J+1>3 lines can be significantly weak with respect to CO J=1-0 and this can hinder their detection even in the presence of substantial molecular gas masses.Comment: 34 pages, 5 figures, accepted for publication in The Astrophysical Journa

Protoclusters associated with z > 2 radio galaxies. I. Characteristics of high redshift protoclusters

[Abridged] We present the results of a large program conducted with the Very Large Telescope and Keck telescope to search for forming clusters of galaxies near powerful radio galaxies at 2.0 < z < 5.2. We obtained narrow- and broad-band images of nine radio galaxies and their surroundings. The imaging was used to select candidate Lyman alpha emitting galaxies in ~3x3 Mpc^2 areas near the radio galaxies. A total of 337 candidate emitters were found with a rest-frame Lyman alpha equivalent width of EW_0 > 15 A and Sigma = EW_0/Delta EW_0 > 3. Follow-up spectroscopy confirmed 168 Lyman alpha emitters near eight radio galaxies. The success rate of our selection procedure is 91%. At least six of our eight fields are overdense in Lyman alpha emitters by a factor 3-5. Also, the emitters show significant clustering in velocity space. In the overdense fields, the width of the velocity distributions of the emitters is a factor 2-5 smaller than the width of the narrow-band filters. Taken together, we conclude that we have discovered six forming clusters of galaxies (protoclusters). We estimate that roughly 75% of powerful (L_2.7GHz > 10^33 erg/s/Hz/sr) high redshift radio galaxies reside in a protocluster, with a sizes of at least 1.75 Mpc. We estimate that the protoclusters have masses in the range 2-9 x 10^14 Msun and they are likely to be progenitors of present-day (massive) clusters of galaxies. For the first time, we have been able to estimate the velocity dispersion of cluster progenitors from z~5 to ~2. The velocity dispersion of the emitters increases with cosmic time, in agreement with the dark matter velocity dispersion in numerical simulations of forming massive clusters.Comment: 30 pages, 20 figures. Published in A&A. The article with high resolution figures is available at http://www.ast.cam.ac.uk/~venemans/research/datapaper/index.htm

Quantifying Timing Leaks and Cost Optimisation

We develop a new notion of security against timing attacks where the attacker is able to simultaneously observe the execution time of a program and the probability of the values of low variables. We then show how to measure the security of a program with respect to this notion via a computable estimate of the timing leakage and use this estimate for cost optimisation.Comment: 16 pages, 2 figures, 4 tables. A shorter version is included in the proceedings of ICICS'08 - 10th International Conference on Information and Communications Security, 20-22 October, 2008 Birmingham, U

The Extended Line Region of 3C 299

We present results of HST observations of the radio galaxy 3C 299. The broad-band F702W (R) and F555W (V) images (WFPC2/PC) show an elliptical galaxy, with a comet-like structure extending to the NE in the radio jet direction. The [OIII]$\lambda$5007 emission line map, shows a bi-conical structure centered on the nucleus, that overlaps the structure found in the broad-band filters. The radio core coincides with the center of the bi-conical structure and the radio axes are aligned with the direction of the cones. These data show clear evidence of a strong interaction between the radio jet and the NE morphology of the galaxy. We show evidence that this NE region is an ENLR; the line-ratio diagnostics show that models involving gas shocked by the radio-jet plus ionization from a precursor HII region, produced itself by the ionizing photons of the postshocked gas on the preshocked gas provide a good match to the observations. We investigate the spatial behavior of the ionizing parameter $U$, by determining the [OIII]/[OII] line ratio which is sensitive to the change of the ionization parameter, and trace its behavior over the ENLR along the radio jet direction. We find that [OIII]/[OII] does not follow a simple dilution model, but rather that it is approximately constant over a large range of distance from the nucleus thus requiring a local source of ionization which seems to be compatible with the shock models driven by the radio jet.Comment: 17 pages, 9 Postscript figures, ApJ accepted, uses aaspp.st

Insights into the impacts of rural honey hunting in Zambia

This is the author accepted manuscript. The final version is available from Wiley via the DOI in this recordData Availability Statement: The data that support the findings of this study are available from the corresponding author upon reasonable request

Keck Adaptive Optics Observations of the Radio Galaxy 3C294: A Merging System at z = 1.786?

We present seeing-limited and adaptive optics (AO) images of the z = 1.786 radio galaxy 3C294 in the H and K' infrared bands obtained at Keck Observatory. The infrared emission of 3C294 is dominated by two distinct components separated by ~1" (9 kpc). The eastern knot contains an unresolved core that contributes ~4% of the K'-band light; we identify this core with the active nucleus. The western component is about 2.5 times brighter. The most plausible interpretation of the near-infrared morphology is an ongoing merger event, with the active nucleus located in the less massive of the two galaxies.Comment: Accepted for Publication in Astrophysical Journa