Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors

We present MindEye, a novel fMRI-to-image approach to retrieve and reconstruct viewed images from brain activity. Our model comprises two parallel submodules that are specialized for retrieval (using contrastive learning) and reconstruction (using a diffusion prior). MindEye can map fMRI brain activity to any high dimensional multimodal latent space, like CLIP image space, enabling image reconstruction using generative models that accept embeddings from this latent space. We comprehensively compare our approach with other existing methods, using both qualitative side-by-side comparisons and quantitative evaluations, and show that MindEye achieves state-of-the-art performance in both reconstruction and retrieval tasks. In particular, MindEye can retrieve the exact original image even among highly similar candidates indicating that its brain embeddings retain fine-grained image-specific information. This allows us to accurately retrieve images even from large-scale databases like LAION-5B. We demonstrate through ablations that MindEye's performance improvements over previous methods result from specialized submodules for retrieval and reconstruction, improved training techniques, and training models with orders of magnitude more parameters. Furthermore, we show that MindEye can better preserve low-level image features in the reconstructions by using img2img, with outputs from a separate autoencoder. All code is available on GitHub.Comment: Project Page at https://medarc-ai.github.io/mindeye-website/. Code at https://github.com/MedARC-AI/fMRI-reconstruction-NSD

Interactions between downslope flows and a developing cold-air pool

A numerical model has been used to characterize the development of a region of enhanced cooling in an alpine valley with a width of order (Formula presented.) km, under decoupled stable conditions. The region of enhanced cooling develops largely as a region of relatively dry air which partitions the valley atmosphere dynamics into two volumes, with airflow partially trapped within the valley by a developing elevated inversion. Complex interactions between the region of enhanced cooling and the downslope flows are quantified. The cooling within the region of enhanced cooling and the elevated inversion is almost equally partitioned between radiative and dynamic effects. By the end of the simulation, the different valley atmospheric regions approach a state of thermal equilibrium with one another, though this cannot be said of the valley atmosphere and its external environment.Peer reviewe

PerR Confers Phagocytic Killing Resistance and Allows Pharyngeal Colonization by Group A Streptococcus

The peroxide response transcriptional regulator, PerR, is thought to contribute to virulence of group A Streptococcus (GAS); however, the specific mechanism through which it enhances adaptation for survival in the human host remains unknown. Here, we identify a critical role of PerR-regulated gene expression in GAS phagocytosis resistance and in virulence during pharyngeal infection. Deletion of perR in M-type 3 strain 003Sm was associated with reduced resistance to phagocytic killing in human blood and by murine macrophages in vitro. The increased phagocytic killing of the perR mutant was abrogated in the presence of the general oxidative burst inhibitor diphenyleneiodonium chloride (DPI), a result that suggests PerR-dependent gene expression counteracts the phagocyte oxidative burst. Moreover, an isogenic perR mutant was severely attenuated in a baboon model of GAS pharyngitis. In competitive infection experiments, the perR mutant was cleared from two animals at 24 h and from four of five animals by day 14, in sharp contrast to wild-type bacteria that persisted in the same five animals for 28 to 42 d. GAS genomic microarrays were used to compare wild-type and perR mutant transcriptomes in order to characterize the PerR regulon of GAS. These studies identified 42 PerR-dependent loci, the majority of which had not been previously recognized. Surprisingly, a large proportion of these loci are involved in sugar utilization and transport, in addition to oxidative stress adaptive responses and virulence. This finding suggests a novel role for PerR in mediating sugar uptake and utilization that, together with phagocytic killing resistance, may contribute to GAS fitness in the infected host. We conclude that PerR controls expression of a diverse regulon that enhances GAS resistance to phagocytic killing and allows adaptation for survival in the pharynx

From insect to man: Photorhabdus sheds light on the emergence of human pathogenicity

Photorhabdus are highly effective insect pathogenic bacteria that exist in a mutualistic relationship with Heterorhabditid nematodes. Unlike other members of the genus, Photorhabdus asymbiotica can also infect humans. Most Photorhabdus cannot replicate above 34°C, limiting their host-range to poikilothermic invertebrates. In contrast, P. asymbiotica must necessarily be able to replicate at 37°C or above. Many well-studied mammalian pathogens use the elevated temperature of their host as a signal to regulate the necessary changes in gene expression required for infection. Here we use RNA-seq, proteomics and phenotype microarrays to examine temperature dependent differences in transcription, translation and phenotype of P. asymbiotica at 28°C versus 37°C, relevant to the insect or human hosts respectively. Our findings reveal relatively few temperature dependant differences in gene expression. There is however a striking difference in metabolism at 37°C, with a significant reduction in the range of carbon and nitrogen sources that otherwise support respiration at 28°C. We propose that the key adaptation that enables P. asymbiotica to infect humans is to aggressively acquire amino acids, peptides and other nutrients from the human host, employing a so called “nutritional virulence” strategy. This would simultaneously cripple the host immune response while providing nutrients sufficient for reproduction. This might explain the severity of ulcerated lesions observed in clinical cases of Photorhabdosis. Furthermore, while P. asymbiotica can invade mammalian cells they must also resist immediate killing by humoral immunity components in serum. We observed an increase in the production of the insect Phenol-oxidase inhibitor Rhabduscin normally deployed to inhibit the melanisation immune cascade. Crucially we demonstrated this molecule also facilitates protection against killing by the alternative human complement pathway

The Roadmap to the POEMMA mission

The Probe Of Extreme Multi-Messenger Astrophysics (POEMMA) is designed to observe ultrahigh-energy cosmic rays (UHECRs) and cosmic neutrinos from space with sensitivity over the full celestial sky. Developed as a NASA Astrophysics Probe-class mission, POEMMA consists of two identical telescopes orbiting the Earth in a loose formation designed to observe extensive air showers (EAS) via air fluorescence and Cherenkov emissions. UHECRs and UHE neutrinos above 20 EeV are observed with the stereo fluorescence technique, while tau neutrinos above 20 PeV are observed via the optical Cherenkov signals produced by up-going EAS generated by the decay of Earth-emerging tau-leptons. The POEMMA satellites are designed to quickly re-orientate to follow up transient cosmic neutrino candidate sources and obtain unparalleled neutrino flux sensitivity. Both observation techniques and the instrument design are being validated by current and upcoming missions, such as Mini-EUSO and EUSO-SPB as part of the JEM-EUSO program, and the Terzina instrument onboard the NUSES SmallSat mission. We discuss the POEMMA science performance and the current roadmap to the POEMMA mission

Prospects for Cross-correlations of UHECR Events with Astrophysical Sources with Upcoming Space-based Experiments

Ultra-high energy cosmic rays (UHECRs) are the messengers of the most extreme physics in the cosmos; however, efforts to identify their origins have thus far been thwarted by the fact that they don’t point back to their sources. Using statistical studies cross-correlating UHECR arrival directions with astrophysical catalogs, the ground-based Pierre Auger Observatory has reported hints of a correlation with nearby starburst galaxies, as well as lower-significance correlations with other classes of astrophysical sources. Space-based UHECR experiments, such as POEMMA and ZAP, will monitor large interaction volumes on the Earth or the Moon. Within a few years of mission operation time, both missions will achieve unprecedented exposures at energies above 40 EeV across the entire sky. We present studies of the cross-correlation between UHECR event arrival directions and astrophysical catalogs as motivated by expectations for the detector performance for POEMMA and ZAP. We find that both POEMMA and ZAP will achieve 5σ discovery reach for many plausible astrophysical scenarios

Comprehensive genetic dissection of wood properties in a widely-grown tropical tree: Eucalyptus

Background: Eucalyptus is an important genus in industrial plantations throughout the world and is grown for use as timber, pulp, paper and charcoal. Several breeding programmes have been launched worldwide to concomitantly improve growth performance and wood properties (WPs). In this study, an interspecific cross between Eucalyptus urophylla and E. grandis was used to identify major genomic regions (Quantitative Trait Loci, QTL) controlling the variability of WPs. Results: Linkage maps were generated for both parent species. A total of 117 QTLs were detected for a series of wood and end-use related traits, including chemical, technological, physical, mechanical and anatomical properties. The QTLs were mainly clustered into five linkage groups. In terms of distribution of QTL effects, our result agrees with the typical L-shape reported in most QTL studies, i.e. most WP QTLs had limited effects and only a few (13) had major effects (phenotypic variance explained > 15%). The co-locations of QTLs for different WPs as well as QTLs and candidate genes are discussed in terms of phenotypic correlations between traits, and of the function of the candidate genes. The major wood property QTL harbours a gene encoding a Cinnamoyl CoA reductase (CCR), a structural enzyme of the monolignol-specific biosynthesis pathway. Conclusions: Given the number of traits analysed, this study provides a comprehensive understanding of the genetic architecture of wood properties in this Eucalyptus full-sib pedigree. At the dawn of Eucalyptus genome sequence, it will provide a framework to identify the nature of genes underlying these important quantitative traits. (Résumé d'auteur

EUSO-SPB1 mission and science

The Extreme Universe Space Observatory on a Super Pressure Balloon 1 (EUSO-SPB1) was launched in 2017 April from Wanaka, New Zealand. The plan of this mission of opportunity on a NASA super pressure balloon test flight was to circle the southern hemisphere. The primary scientific goal was to make the first observations of ultra-high-energy cosmic-ray extensive air showers (EASs) by looking down on the atmosphere with an ultraviolet (UV) fluorescence telescope from suborbital altitude (33 km). After 12 days and 4 h aloft, the flight was terminated prematurely in the Pacific Ocean. Before the flight, the instrument was tested extensively in the West Desert of Utah, USA, with UV point sources and lasers. The test results indicated that the instrument had sensitivity to EASs of ⪆ 3 EeV. Simulations of the telescope system, telescope on time, and realized flight trajectory predicted an observation of about 1 event assuming clear sky conditions. The effects of high clouds were estimated to reduce this value by approximately a factor of 2. A manual search and a machine-learning-based search did not find any EAS signals in these data. Here we review the EUSO-SPB1 instrument and flight and the EAS search

Simulation studies for the Mini-EUSO detector

Mini-EUSO is a mission of the JEM-EUSO program flying onboard the International Space Station since August 2019. Since the first data acquisition in October 2019, more than 35 sessions have been performed for a total of 52 hours of observations. The detector has been observing Earth at night-time in the UV range and detected a wide variety of transient sources all of which have been modeled through Monte Carlo simulations. Mini-EUSO is also capable of detecting meteors and potentially space debris and we performed simulations for such events to estimate their impact on future missions for cosmic ray science from space. We show here examples of the simulation work done in this framework to analyze the Mini-EUSO data. The expected response of Mini-EUSO with respect to ultra high energy cosmic ray showers has been studied. The efficiency curve of Mini-EUSO as a function of primary energy has been estimated and the energy threshold for Cosmic Rays has been placed to be above 10$^{21}$ eV. We compared the morphology of several transient events detected during the mission with cosmic ray simulations and excluded that they can be due to cosmic ray showers. To validate the energy threshold of the detector, a system of ground based flashers is being used for end-to-end calibration purposes. We therefore implemented a parameterization of such flashers into the JEM-EUSO simulation framework and studied the response of the detector with respect to such sources