Alignment and preliminary outcomes of an ELT-size instrument to a very large telescope: LINC-NIRVANA at LBT

LINC-NIRVANA (LN) is a high resolution, near infrared imager that uses a multiple field-of-view, layer-oriented, multi-conjugate AO system, consisting of four multi-pyramid wavefront sensors (two for each arm of the Large Binocular Telescope, each conjugated to a different altitude). The system employs up to 40 star probes, looking at up to 20 natural guide stars simultaneously. Its final goal is to perform Fizeau interferometric imaging, thereby achieving ELT-like spatial resolution (22.8 m baseline resolution). For this reason, LN is also equipped with a fringe tracker, a beam combiner and a NIR science camera, for a total of more than 250 optical components and an overall size of approximately 6x4x4.5 meters. This paper describes the tradeoffs evaluated in order to achieve the alignment of the system to the telescope. We note that LN is comparable in size to planned ELT instrumentation. The impact of such alignment strategies will be compared and the selected procedure, where the LBT telescope is, in fact, aligned to the instrument, will be described. Furthermore, results coming from early night-time commissioning of the system will be presented.Comment: 8 pages, 6 pages, AO4ELT5 Proceedings, 201

Adaptive auditory risk assessment in the dogbane tiger moth when pursued by bats

Moths and butterflies flying in search of mates risk detection by numerous aerial predators; under the cover of night, the greatest threat will often be from insectivorous bats. During such encounters, the toxic dogbane tiger moth, Cycnia tenera uses the received intensity, duration and emission pattern of the bat's echolocation calls to determine when, and how many, defensive ultrasonic clicks to produce in return. These clicks, which constitute an acoustic startle response, act as warning signals against bats in flight. Using an integrated test of stimulus generalization and dishabituation, here we show that C. tenera is able to discriminate between the echolocation calls characteristic of a bat that has only just detected it versus those of a bat actively in pursuit of it. We also show that C. tenera habituates more profoundly to the former stimulus train (‘early attack’) than to the latter (‘late attack’), even though it was initially equally responsive to both stimuli. Matched sensory and behavioural data indicate that reduced responsiveness reflects habituation and is not merely attributable to sensory adaptation or motor fatigue. In search of mates in the face of bats, C. tenera's ability to discriminate between attacking bats representing different levels of risk, and to habituate less so to those most dangerous, should function as an adaptive cost–benefit trade-off mechanism in nature

A Data Driven Approach to Audiovisual Speech Mapping

The concept of using visual information as part of audio speech processing has been of significant recent interest. This paper presents a data driven approach that considers estimating audio speech acoustics using only temporal visual information without considering linguistic features such as phonemes and visemes. Audio (log filterbank) and visual (2D-DCT) features are extracted, and various configurations of MLP and datasets are used to identify optimal results, showing that given a sequence of prior visual frames an equivalent reasonably accurate audio frame estimation can be mapped

Foley Music: Learning to Generate Music from Videos

In this paper, we introduce Foley Music, a system that can synthesize plausible music for a silent video clip about people playing musical instruments. We first identify two key intermediate representations for a successful video to music generator: body keypoints from videos and MIDI events from audio recordings. We then formulate music generation from videos as a motion-to-MIDI translation problem. We present a Graph$-$Transformer framework that can accurately predict MIDI event sequences in accordance with the body movements. The MIDI event can then be converted to realistic music using an off-the-shelf music synthesizer tool. We demonstrate the effectiveness of our models on videos containing a variety of music performances. Experimental results show that our model outperforms several existing systems in generating music that is pleasant to listen to. More importantly, the MIDI representations are fully interpretable and transparent, thus enabling us to perform music editing flexibly. We encourage the readers to watch the demo video with audio turned on to experience the results.Comment: ECCV 2020. Project page: http://foley-music.csail.mit.ed

Heterogeneity among Isolates Reveals that Fitness in Low Oxygen Correlates with Aspergillus fumigatus Virulence

Previous work has shown that environmental and clinical isolates of Aspergillus fumigatus represent a diverse population that occupies a variety of niches, has extensive genetic diversity, and exhibits virulence heterogeneity in a number of animal models of invasive pulmonary aspergillosis (IPA). However, mechanisms explaining differences in virulence among A. fumigatus isolates remain enigmatic. Here, we report a significant difference in virulence of two common lab strains, CEA10 and AF293, in the murine triamcinolone immunosuppression model of IPA, in which we previously identified severe low oxygen microenvironments surrounding fungal lesions. Therefore, we hypothesize that the ability to thrive within these lesions of low oxygen promotes virulence of A. fumigatus in this model. To test this hypothesis, we performed in vitro fitness and in vivo virulence analyses in the triamcinolone murine model of IPA with 14 environmental and clinical isolates of A. fumigatus Among these isolates, we observed a strong correlation between fitness in low oxygen in vitro and virulence. In further support of our hypothesis, experimental evolution of AF293, a strain that exhibits reduced fitness in low oxygen and reduced virulence in the triamcinolone model of IPA, results in a strain (EVOL20) that has increased hypoxia fitness and a corresponding increase in virulence. Thus, the ability to thrive in low oxygen correlates with virulence of A. fumigatus isolates in the context of steroid-mediated murin