Visual Reasoning with Multi-hop Feature Modulation

Recent breakthroughs in computer vision and natural language processing have spurred interest in challenging multi-modal tasks such as visual question-answering and visual dialogue. For such tasks, one successful approach is to condition image-based convolutional network computation on language via Feature-wise Linear Modulation (FiLM) layers, i.e., per-channel scaling and shifting. We propose to generate the parameters of FiLM layers going up the hierarchy of a convolutional network in a multi-hop fashion rather than all at once, as in prior work. By alternating between attending to the language input and generating FiLM layer parameters, this approach is better able to scale to settings with longer input sequences such as dialogue. We demonstrate that multi-hop FiLM generation achieves state-of-the-art for the short input sequence task ReferIt --- on-par with single-hop FiLM generation --- while also significantly outperforming prior state-of-the-art and single-hop FiLM generation on the GuessWhat?! visual dialogue task.Comment: In Proc of ECCV 201

A search for damped Lyman-alpha systems towards radio-loud quasars I: The optical survey

We present the results from the optical component of a survey for damped Lyman-alpha systems (DLAs) towards radio-loud quasars. Our quasar sample is drawn from the Texas radio survey with the following primary selection criteria: z_em > 2.4, optical magnitudes B < 22 and 365 MHz flux density S_365 > 400 mJy. We obtained spectra for a sample of 45 QSOs with the William Herschel Telescope, Very Large Telescope and Gemini-North, resulting in a survey redshift path Delta z = 38.79. We detect nine DLAs and one sub-DLA with a mean absorption redshift = 2.44. The DLA number density is n(z) = 0.23^{+0.11}_{-0.07}, in good agreement with the value derived for DLAs detected in the Sloan Digital Sky Survey at this redshift. The DLA number density of our sample is also in good agreement with optically-complete radio-selected samples, supporting previous claims that n(z) is not significantly affected by dust obscuration bias. We present N(HI) column density determinations and metal line equivalent width measurements for all our DLAs. The low frequency flux density selection criterion used for the quasar sample implies that all absorbers will be suitable for follow-up absorption spectroscopy in the redshifted HI 21 cm line. A following paper (Kanekar et al.) will present HI 21 cm absorption studies of, and spin temperature determinations for, our DLA sample.Comment: Accepted for publication in the MNRA

Multi-messenger observations of a binary neutron star merger

On 2017 August 17 a binary neutron star coalescence candidate (later designated GW170817) with merger time 12:41:04 UTC was observed through gravitational waves by the Advanced LIGO and Advanced Virgo detectors. The Fermi Gamma-ray Burst Monitor independently detected a gamma-ray burst (GRB 170817A) with a time delay of ~1.7 s with respect to the merger time. From the gravitational-wave signal, the source was initially localized to a sky region of 31 deg2 at a luminosity distance of 40+8-8 Mpc and with component masses consistent with neutron stars. The component masses were later measured to be in the range 0.86 to 2.26 Mo. An extensive observing campaign was launched across the electromagnetic spectrum leading to the discovery of a bright optical transient (SSS17a, now with the IAU identification of AT 2017gfo) in NGC 4993 (at ~40 Mpc) less than 11 hours after the merger by the One- Meter, Two Hemisphere (1M2H) team using the 1 m Swope Telescope. The optical transient was independently detected by multiple teams within an hour. Subsequent observations targeted the object and its environment. Early ultraviolet observations revealed a blue transient that faded within 48 hours. Optical and infrared observations showed a redward evolution over ~10 days. Following early non-detections, X-ray and radio emission were discovered at the transient’s position ~9 and ~16 days, respectively, after the merger. Both the X-ray and radio emission likely arise from a physical process that is distinct from the one that generates the UV/optical/near-infrared emission. No ultra-high-energy gamma-rays and no neutrino candidates consistent with the source were found in follow-up searches. These observations support the hypothesis that GW170817 was produced by the merger of two neutron stars in NGC4993 followed by a short gamma-ray burst (GRB 170817A) and a kilonova/macronova powered by the radioactive decay of r-process nuclei synthesized in the ejecta