Self-supervised vision-language pretraining for Medical visual question answering

Medical image visual question answering (VQA) is a task to answer clinical questions, given a radiographic image, which is a challenging problem that requires a model to integrate both vision and language information. To solve medical VQA problems with a limited number of training data, pretrain-finetune paradigm is widely used to improve the model generalization. In this paper, we propose a self-supervised method that applies Masked image modeling, Masked language modeling, Image text matching and Image text alignment via contrastive learning (M2I2) for pretraining on medical image caption dataset, and finetunes to downstream medical VQA tasks. The proposed method achieves state-of-the-art performance on all the three public medical VQA datasets. Our codes and models are available at https://github.com/pengfeiliHEU/M2I2.Comment: 5 pages, 3 figure

Potential of resveratrol in the treatment of interstitial lung disease

Interstitial lung disease (ILD) is a heterogeneous group of diseases characterized by lung injury caused by lung fibroblast proliferation, interstitial inflammation, and fibrosis. Different cell signal transduction pathways are activated in response to various proinflammatory or fibrotic cytokines, such as IL-6, and these cytokines are increased in different ILDs. The overexpressed cytokines and growth factors in ILD can activate TGF-β/Smad2/3/4, NF-κB, and JAK/STAT signal transduction pathways, promote the activation of immune cells, increase the release of pro-inflammatory and pro-fibrotic factors, differentiate fibroblasts into myofibroblasts, and promote the occurrence and development of ILD. This finding suggests the importance of signal transduction pathways in patients with ILD. Recent evidence suggests that resveratrol (RSV) attenuates excessive inflammation and pulmonary fibrosis by inhibiting the TGF-β/Smad2/3/4, NF-κB, and JAK/STAT signal transduction pathways and overactivation of immune cells. In this review, advances in lung protection and the underlying mechanisms of RSV are summarized, and the potential efficacy of RSV as a promising treatment option for ILD is highlighted

Holistic spectroscopy: complete reconstruction of a wide-field, multiobject spectroscopic image using a photonic comb

The primary goal of Galactic archaeology is to learn about the origin of the Milky Way from the detailed chemistry and kinematics of millions of stars. Wide-field multifibre spectrographs are increasingly used to obtain spectral information for huge samples of stars. Some surveys (e.g. GALAH) are attempting to measure up to 30 separate elements per star. Stellar abundance spectroscopy is a subtle art that requires a very high degree of spectral uniformity across each of the fibres. However, wide-field spectrographs are notoriously non-uniform due to the fast output optics necessary to image many fibre outputs on to the detector. We show that precise spectroscopy is possible with such instruments across all fibres by employing a photonic comb – a device that produces uniformly spaced spots of light on the CCD to precisely map complex aberrations. Aberrations are parametrized by a set of orthogonal moments with ∼100 independent parameters. We then reproduce the observed image by convolving high-resolution spectral templates with measured aberrations as opposed to extracting the spectra from the observed image. Such a forward modelling approach also trivializes some spectroscopic reduction problems like fibre cross-talk, and reliably extracts spectra with a resolution ∼2.3 times above the nominal resolution of the instrument. Our rigorous treatment of optical aberrations also encourages a less conservative spectrograph design in the future

The GALAH survey and Gaia DR2: (non-)existence of five sparse high-latitude open clusters

Sparse open clusters can be found at high galactic latitudes where loosely populated clusters are more easily detected against the lower stellar background. Because most star formation takes place in the thin disc, the observed population of clusters far from the Galactic plane is hard to explain. We combined spectral parameters from the GALAH survey with the Gaia DR2 catalogue to study the dynamics and chemistry of five old sparse high-latitude clusters in more detail. We find that four of them (NGC 1252, NGC 6994, NGC 7772, NGC 7826) – originally classified in 1888 – are not clusters but are instead chance projections on the sky. Member stars quoted in the literature for these four clusters are unrelated in our multidimensional physical parameter space; the quoted cluster properties in the literature are therefore meaningless. We confirm the existence of visually similar NGC 1901 for which we provide a probabilistic membership analysis. An overdensity in three spatial dimensions proves to be enough to reliably detect sparse clusters, but the whole six-dimensional space must be used to identify members with high confidence, as demonstrated in the case of NGC 1901

Environmental Justice Assessment of Fine Particles, Ozone, and Mercury over the Pearl River Delta Region, China

Assessment of environmental justice (EJ, a concept related to the distributional fairness of environmental risks) is a crucial component in environmental risk management. However, the risks associated with air pollutants and toxins have rarely been evaluated jointly. Therefore, using an approach integrating modeling, data fusion, and health benefits analysis, we performed an EJ assessment on the mortalities caused by fine particle (PM2.5) and ozone (O3) concentrations and mercury (Hg) deposition over the Pearl River Delta (PRD) region. The concentration index (CI) was used to measure EJ in low-income distributions and age structures, and a larger value implied a greater EJ issue. The results revealed that the CIs of PM2.5, O3, and Hg were 0.35, 0.32, and 0.16, respectively, based on the percentage of the low-income population, and 0.39, 0.36, and 0.23, respectively, based on the elderly and children, indicating that environmental injustice was more prominent for PM2.5 and more reflected in the elderly and children. The center (e.g., Guangzhou) and some marginal areas (e.g., northeast of Jiangmen) in the PRD were overburdened areas with PM2.5, O3, and Hg pollution due to their intensive source emissions. Moreover, cumulative environmental risk (CER) corrected by population vulnerability exhibited significant differences among the cities; for example, cumulative environmental risk scores (CERSs) in Jiangmen, Huizhou, and Zhaoqing were 14.18 to 32.98 times higher than that in Shenzhen. Hence, the implementation of multipollutant control policies for local PM2.5, O3, and Hg in overburdened areas is recommended to further promote EJ in the PRD

The GALAH survey: accurate radial velocities and library of observed stellar template spectra

GALAH is a large-scale magnitude-limited southern stellar spectroscopic survey. Its second data release (GALAH DR2) provides values of stellar parameters and abundances of 23 elements for 342 682 stars (Buder et al.). Here we add a description of the public release of radial velocities with a typical accuracy of 0.1 km s−1 for 336 215 of these stars, achievable due to the large wavelength coverage, high resolving power, and good signal-to-noise ratio of the observed spectra, but also because convective motions in stellar atmosphere and gravitational redshift from the star to the observer are taken into account. In the process we derive medians of observed spectra that are nearly noiseless, as they are obtained from between 100 and 1116 observed spectra belonging to the same bin with a width of 50 K in temperature, 0.2 dex in gravity, and 0.1 dex in metallicity. Publicly released 1181 median spectra have a resolving power of 28 000 and trace the well-populated stellar types with metallicities between −0.6 and +0.3. Note that radial velocities from GALAH are an excellent match to the accuracy of velocity components along the sky plane derived by Gaia for the same stars. The level of accuracy achieved here is adequate for studies of dynamics within stellar clusters, associations, and streams in the Galaxy. So it may be relevant for studies of the distribution of dark matter.TZ, GT, and KC acknowledge financial support of ˇ the Slovenian Research Agency (research core funding No. P1-0188 and project N1-0040). TZ acknowledges the grant from the distinguished visitor programme of the RSAA at the Australian National University. JK is supported by a Discovery Project grant from the Australian Research Council (DP150104667) awarded to J. BlandHawthorn and T. Bedding. ARC acknowledges support through the Australian Research Council through grant DP160100637. LD, KF, and Y-ST are grateful for support from Australian Research Council grant DP160103747. SLM acknowledges support from the Australian Research Council through grant DE140100598. LC is the recipient of an ARC Future Fellowship (project number FT160100402). Parts of this research were conducted by the Australian Research Council Centre of Excellence for All Sky Astrophysics in 3 Dimensions (ASTRO 3D), through project number CE17010001

The GALAH survey: Properties of the Galactic disc(s) in the solar neighbourhood

Using data from the GALAH pilot survey, we determine properties of the Galactic thin and thick discs near the solar neighbourhood. The data cover a small range of Galactocentric radius (7.9 RGC 9.5 kpc), but extend up to 4 kpc in height from the Galactic plane, and several kpc in the direction of Galactic anti-rotation (at longitude 260◦ ≤ ≤ 280◦). This allows us to reliably measure the vertical density and abundance profiles of the chemically and kinematically defined ‘thick’ and ‘thin’ discs of the Galaxy. The thin disc (low-α population) exhibits a steep negative vertical metallicity gradient, at d[M/H]/dz = −0.18 ± 0.01 dex kpc−1, which is broadly consistent with previous studies. In contrast, its vertical α-abundance profile is almost flat, with a gradient of d[α/M]/dz = 0.008 ± 0.002 dex kpc−1. The steep vertical metallicity gradient of the low-α population is in agreement with models where radial migration has a major role in the evolution of the thin disc. The thick disc (high-α population) has a weaker vertical metallicity gradient d[M/H]/dz = −0.058 ± 0.003 dex kpc−1. The αabundance of the thick disc is nearly constant with height, d[α/M]/dz = 0.007 ± 0.002 dex kpc−1. The negative gradient in metallicity and the small gradient in [α/M] indicate that the high-α population experienced a settling phase, but also formed prior to the onset of major Type Ia supernova enrichment. We explore the implications of the distinct α-enrichments and narrow [α/M] range of the sub-populations in the context of thick disc formation.LD and MA acknowledge funding from the Australian Government through ARC Laureate Fellowship FL110100012. LD, KCF, and RFGW acknowledge support from ARC grant DP160103747. LC gratefully acknowledges support from the Australian Research Council (grants DP150100250, FT160100402). DMN was supported by the Allan C. and Dorothy H. Davis Fellowship. DS is the recipient of an Australian Research Council Future Fellowship (project number FT1400147). TZ acknowledges financial support from the Slovenian Research Agency (research core funding No. P1-0188). Part of this research was supported by the Munich Institute for Astro- and Particle Physics (MIAPP) of the DFG cluster of excellence ‘Origin and Structure of the Universe’

The GALAH survey: Stellar streams and how stellar velocity distributions vary with Galactic longitude, hemisphere, and metallicity

Using GALAH (GALactic Archaeology with HERMES) survey data of nearby stars, we look at how structure in the planar (u, v) velocity distribution depends on metallicity and on viewing direction within the Galaxy. In nearby stars with distance d≲1 kpc, the Hercules stream is most strongly seen in higher metallicity stars [Fe/H] > 0.2. The Hercules stream peak v value depends on viewed galactic longitude, which we interpret as due to the gap between the stellar stream and more circular orbits being associated with a specific angular momentum value of about 1640 km s−1 kpc. The association of the gap with a particular angular momentum value supports a bar resonant model for the Hercules stream. Moving groups previously identified in Hipparcos(HIgh Precision Parallax COllecting Satellite) observations are easiest to see in stars nearer than 250 pc, and their visibility and peak velocities in the velocity distributions depends on both viewing direction (galactic longitude and hemisphere) and metallicity. We infer that there is fine structure in local velocity distributions that varies over distances of a few hundred pc in the Galaxy.Parts of this research were conducted by the Australian Research Council (ARC) Centre of Excellence for All Sky Astrophysics in 3 Dimensions (ASTRO 3D), through project number CE170100013. JB-H acknowledges a Miller Professorship from the Miller Institute, UC Berkeley, and an ARC Laureate Fellowship which also supports GDS and SS. SM acknowledges support from the ARC through DECRA Fellowship DE140100598. JK is supported by an ARC DP grant awarded to JB-H and TB. MH is supported by ASTRO 3D Centre of Excellence funding to the University of Sydney and an ARC DP grant awarded to KF. LD gratefully acknowledges a scholarship from Zonta International District 24. LD and KF acknowledge support from ARC grant DP160103747. LC is the recipient of an ARC Future Fellowship (project number FT160100402)