Learning Visual Question Answering by Bootstrapping Hard Attention

Attention mechanisms in biological perception are thought to select subsets of perceptual information for more sophisticated processing which would be prohibitive to perform on all sensory inputs. In computer vision, however, there has been relatively little exploration of hard attention, where some information is selectively ignored, in spite of the success of soft attention, where information is re-weighted and aggregated, but never filtered out. Here, we introduce a new approach for hard attention and find it achieves very competitive performance on a recently-released visual question answering datasets, equalling and in some cases surpassing similar soft attention architectures while entirely ignoring some features. Even though the hard attention mechanism is thought to be non-differentiable, we found that the feature magnitudes correlate with semantic relevance, and provide a useful signal for our mechanism's attentional selection criterion. Because hard attention selects important features of the input information, it can also be more efficient than analogous soft attention mechanisms. This is especially important for recent approaches that use non-local pairwise operations, whereby computational and memory costs are quadratic in the size of the set of features.Comment: ECCV 201

Clustering in large networks does not promote upstream reciprocity

Upstream reciprocity (also called generalized reciprocity) is a putative mechanism for cooperation in social dilemma situations with which players help others when they are helped by somebody else. It is a type of indirect reciprocity. Although upstream reciprocity is often observed in experiments, most theories suggest that it is operative only when players form short cycles such as triangles, implying a small population size, or when it is combined with other mechanisms that promote cooperation on their own. An expectation is that real social networks, which are known to be full of triangles and other short cycles, may accommodate upstream reciprocity. In this study, I extend the upstream reciprocity game proposed for a directed cycle by Boyd and Richerson to the case of general networks. The model is not evolutionary and concerns the conditions under which the unanimity of cooperative players is a Nash equilibrium. I show that an abundance of triangles or other short cycles in a network does little to promote upstream reciprocity. Cooperation is less likely for a larger population size even if triangles are abundant in the network. In addition, in contrast to the results for evolutionary social dilemma games on networks, scale-free networks lead to less cooperation than networks with a homogeneous degree distribution.Comment: 5 figure

Fetal Window of Vulnerability to Airborne Polycyclic Aromatic Hydrocarbons on Proportional Intrauterine Growth Restriction

Background: Although the entire duration of fetal development is generally considered a highly susceptible period, it is of public health interest to determine a narrower window of heightened vulnerability to polycyclic aromatic hydrocarbons (PAHs) in humans. We posited that exposure to PAHs during the first trimester impairs fetal growth more severely than a similar level of exposure during the subsequent trimesters. Methods: In a group of healthy, non-smoking pregnant women with no known risks of adverse birth outcomes, personal exposure to eight airborne PAHs was monitored once during the second trimester for the entire cohort (n = 344), and once each trimester within a subset (n = 77). Both air monitoring and self-reported PAH exposure data were used in order to statistically estimate PAH exposure during the entire gestational period for each individual newborn. Results: One natural-log unit increase in prenatal exposure to the eight summed PAHs during the first trimester was associated with the largest decrement in the Fetal Growth Ratio (FGR) (23%, 95 % Confidence Interval (CI), 25 to20%), birthweight (2105 g, 95 % CI, 2188 to 222 g), and birth length (20.78 cm, 95 % CI, 21.30 to 20.26 cm), compared to the unit effects of PAHs during the subsequent trimesters, after accounting for confounders. Furthermore, a unit exposure during the first trimester was associated with the largest elevation in Cephalization Index (head to weight ratio) (3 mm/g, 95 % CI, 1 to 5 mm/g). PAH exposure was not associated with evidence of asymmetric growth restriction in this cohort

Meditation and cognitive ageing: The role of mindfulness meditation in building cognitive reserve

Mindfulness-related meditation practices engage various cognitive skills including the ability to focus and sustain attention, which in itself requires several interacting attentional sub-functions. There is increasing behavioural and neuroscientific evidence that mindfulness meditation improves these functions and associated neural processes. More so than other cognitive training programmes, the effects of meditation appear to generalise to other cognitive tasks, thus demonstrating far transfer effects. As these attentional functions have been linked to age-related cognitive decline, there is growing interest in the question whether meditation can slow-down or even prevent such decline. The cognitive reserve hypothesis builds on evidence that various lifestyle factors can lead to better cognitive performance in older age than would be predicted by the existing degree of brain pathology. We argue that mindfulness meditation, as a combination of brain network and brain state training, may increase cognitive reserve capacity and may mitigate age-related declines in cognitive functions. We consider available direct and indirect evidence from the perspective of cognitive reserve theory. The limited available evidence suggests that MM may enhance cognitive reserve capacity directly through the repeated activation of attentional functions and of the multiple demand system and indirectly through the improvement of physiological mechanisms associated with stress and immune function. The article concludes with outlining research strategies for addressing underlying empirical questions in more substantial ways

Modulation of vascular reactivity by perivascular adipose tissue (PVAT)

Purpose of Review: In this review we discuss the role of perivascular adipose tissue (PVAT) in the modulation of vascular contractility and arterial pressure, focusing on the role of the renin-angiotensin-aldosterone system and oxidative stress/inflammation. Recent Findings: PVAT possesses an relevant endocrine-paracrine activity, which may be altered in several pathophysiological and clinical conditions. During the last two decades it has been shown PVAT may modulate vascular reactivity. It has also been previously demonstrated that inflammation in adipose tissue may be implicated in vascular dysfunction. In particular, adipocytes secrete a number of adipokines with various functions, as well as several vasoactive factors, together with components of the renin-angiotensin system which may act at local or at systemic level. It has been shown that the anticontractile effect of PVAT is lost in obesity, probably as a consequence of the development of adipocyte hypertrophy, inflammation, and oxidative stress. Summary: Adipose tissue dysfunction is interrelated with inflammation and oxidative stress, thus contributing to endothelial dysfunction observed in several pathological and clinical conditions such as obesity and hypertension. Decreased local adiponectin level, macrophage recruitment and infiltration, and activation of renin-angiotensin-aldosterone system could play an important role in this regards

Meta-Analysis of Genome-Wide Association Studies for Abdominal Aortic Aneurysm Identifies Four New Disease-Specific Risk Loci

Rationale: Abdominal aortic aneurysm (AAA) is a complex disease with both genetic and environmental risk factors. Together, 6 previously identified risk loci only explain a small proportion of the heritability of AAA. Objective: To identify additional AAA risk loci using data from all available genome-wide association studies (GWAS). Methods and Results: Through a meta-analysis of 6 GWAS datasets and a validation study totalling 10,204 cases and 107,766 controls we identified 4 new AAA risk loci: 1q32.3 (SMYD2), 13q12.11 (LINC00540), 20q13.12 (near PCIF1/MMP9/ZNF335), and 21q22.2 (ERG). In various database searches we observed no new associations between the lead AAA SNPs and coronary artery disease, blood pressure, lipids or diabetes. Network analyses identified ERG, IL6R and LDLR as modifiers of MMP9, with a direct interaction between ERG and MMP9. Conclusions: The 4 new risk loci for AAA appear to be specific for AAA compared with other cardiovascular diseases and related traits suggesting that traditional cardiovascular risk factor management may only have limited value in preventing the progression of aneurysmal disease

Plant-symbiotic fungi as chemical engineers: multi-genome analysis of the Clavicipitaceae reveals dynamics of alkaloid Loci

The fungal family Clavicipitaceae includes plant symbionts and parasites that produce several psychoactive and bioprotective alkaloids. The family includes grass symbionts in the epichloae clade (Epichloë and Neotyphodium species), which are extraordinarily diverse both in their host interactions and in their alkaloid profiles. Epichloae produce alkaloids of four distinct classes, all of which deter insects, and some—including the infamous ergot alkaloids—have potent effects on mammals. The exceptional chemotypic diversity of the epichloae may relate to their broad range of host interactions, whereby some are pathogenic and contagious, others are mutualistic and vertically transmitted (seed-borne), and still others vary in pathogenic or mutualistic behavior. We profiled the alkaloids and sequenced the genomes of 10 epichloae, three ergot fungi (Claviceps species), a morning-glory symbiont (Periglandula ipomoeae), and a bamboo pathogen (Aciculosporium take), and compared the gene clusters for four classes of alkaloids. Results indicated a strong tendency for alkaloid loci to have conserved cores that specify the skeleton structures and peripheral genes that determine chemical variations that are known to affect their pharmacological specificities. Generally, gene locations in cluster peripheries positioned them near to transposon-derived, AT-rich repeat blocks, which were probably involved in gene losses, duplications, and neofunctionalizations. The alkaloid loci in the epichloae had unusual structures riddled with large, complex, and dynamic repeat blocks. This feature was not reflective of overall differences in repeat contents in the genomes, nor was it characteristic of most other specialized metabolism loci. The organization and dynamics of alkaloid loci and abundant repeat blocks in the epichloae suggested that these fungi are under selection for alkaloid diversification. We suggest that such selection is related to the variable life histories of the epichloae, their protective roles as symbionts, and their associations with the highly speciose and ecologically diverse cool-season grasses