Learning Visual Question Answering by Bootstrapping Hard Attention

Attention mechanisms in biological perception are thought to select subsets of perceptual information for more sophisticated processing which would be prohibitive to perform on all sensory inputs. In computer vision, however, there has been relatively little exploration of hard attention, where some information is selectively ignored, in spite of the success of soft attention, where information is re-weighted and aggregated, but never filtered out. Here, we introduce a new approach for hard attention and find it achieves very competitive performance on a recently-released visual question answering datasets, equalling and in some cases surpassing similar soft attention architectures while entirely ignoring some features. Even though the hard attention mechanism is thought to be non-differentiable, we found that the feature magnitudes correlate with semantic relevance, and provide a useful signal for our mechanism's attentional selection criterion. Because hard attention selects important features of the input information, it can also be more efficient than analogous soft attention mechanisms. This is especially important for recent approaches that use non-local pairwise operations, whereby computational and memory costs are quadratic in the size of the set of features.Comment: ECCV 201

Isolation and Mechanical Measurements of Myofibrils from Human Induced Pluripotent Stem Cell-Derived Cardiomyocytes.

Summary: Tension production and contractile properties are poorly characterized aspects of excitation-contraction coupling of human induced pluripotent stem cell-derived cardiomyocytes (hiPSC-CMs). Previous approaches have been limited due to the small size and structural immaturity of early-stage hiPSC-CMs. We developed a substrate nanopatterning approach to produce hiPSC-CMs in culture with adult-like dimensions, T-tubule-like structures, and aligned myofibrils. We then isolated myofibrils from hiPSC-CMs and measured the tension and kinetics of activation and relaxation using a custom-built apparatus with fast solution switching. The contractile properties and ultrastructure of myofibrils more closely resembled human fetal myofibrils of similar gestational age than adult preparations. We also demonstrated the ability to study the development of contractile dysfunction of myofibrils from a patient-derived hiPSC-CM cell line carrying the familial cardiomyopathy MYH7 mutation (E848G). These methods can bring new insights to understanding cardiomyocyte maturation and developmental mechanical dysfunction of hiPSC-CMs with cardiomyopathic mutations. : In this article, Pioner and colleagues reported contractile properties of isolated myofibrils from hiPSC-CMs with highly mature morphology. This approach permits quantitative assessment of maturation and contractile properties of hiPSC-CMs and can be used to study the development of contractile dysfunction in genetically based cardiac diseases. The authors present a patient-derived cell line carrying a novel familial cardiomyopathy MYH7 mutation (E848G)

Hypofractionated radiotherapy has the potential for second cancer reduction

<p>Abstract</p> <p>Background and Purpose</p> <p>A model for carcinoma and sarcoma induction was used to study the dependence of carcinogenesis after radiotherapy on fractionation.</p> <p>Materials and methods</p> <p>A cancer induction model for radiotherapy doses including fractionation was used to model carcinoma and sarcoma induction after a radiation treatment. For different fractionation schemes the dose response relationships were obtained. Tumor induction was studied as a function of dose per fraction.</p> <p>Results</p> <p>If it is assumed that the tumor is treated up to the same biologically equivalent dose it was found that large dose fractions could decrease second cancer induction. The risk decreases approximately linear with increasing fraction size and is more pronounced for sarcoma induction. Carcinoma induction decreases by around 10% per 1 Gy increase in fraction dose. Sarcoma risk is decreased by about 15% per 1 Gy increase in fractionation. It is also found that tissue which is irradiated using large dose fractions to dose levels lower than 10% of the target dose potentially develop less sarcomas when compared to tissues irradiated to all dose levels. This is not observed for carcinoma induction.</p> <p>Conclusions</p> <p>It was found that carcinoma as well as sarcoma risk decreases with increasing fractionation dose. The reduction of sarcoma risk is even more pronounced than carcinoma risk. Hypofractionation is potentially beneficial with regard to second cancer induction.</p

Association of MC1R Variants and host phenotypes with melanoma risk in CDKN2A mutation carriers: a GenoMEL study

&lt;p&gt;&lt;b&gt;Background&lt;/b&gt; Carrying the cyclin-dependent kinase inhibitor 2A (CDKN2A) germline mutations is associated with a high risk for melanoma. Penetrance of CDKN2A mutations is modified by pigmentation characteristics, nevus phenotypes, and some variants of the melanocortin-1 receptor gene (MC1R), which is known to have a role in the pigmentation process. However, investigation of the associations of both MC1R variants and host phenotypes with melanoma risk has been limited.&lt;/p&gt; &lt;p&gt;&lt;b&gt;Methods&lt;/b&gt; We included 815 CDKN2A mutation carriers (473 affected, and 342 unaffected, with melanoma) from 186 families from 15 centers in Europe, North America, and Australia who participated in the Melanoma Genetics Consortium. In this family-based study, we assessed the associations of the four most frequent MC1R variants (V60L, V92M, R151C, and R160W) and the number of variants (1, &#8805;2 variants), alone or jointly with the host phenotypes (hair color, propensity to sunburn, and number of nevi), with melanoma risk in CDKN2A mutation carriers. These associations were estimated and tested using generalized estimating equations. All statistical tests were two-sided.&lt;/p&gt; &lt;p&gt;&lt;b&gt;Results&lt;/b&gt; Carrying any one of the four most frequent MC1R variants (V60L, V92M, R151C, R160W) in CDKN2A mutation carriers was associated with a statistically significantly increased risk for melanoma across all continents (1.24 × 10−6 &#8804; P &#8804; .0007). A consistent pattern of increase in melanoma risk was also associated with increase in number of MC1R variants. The risk of melanoma associated with at least two MC1R variants was 2.6-fold higher than the risk associated with only one variant (odds ratio = 5.83 [95% confidence interval = 3.60 to 9.46] vs 2.25 [95% confidence interval = 1.44 to 3.52]; Ptrend = 1.86 × 10−8). The joint analysis of MC1R variants and host phenotypes showed statistically significant associations of melanoma risk, together with MC1R variants (.0001 &#8804; P &#8804; .04), hair color (.006 &#8804; P &#8804; .06), and number of nevi (6.9 × 10−6 &#8804; P &#8804; .02).&lt;/p&gt; &lt;p&gt;&lt;b&gt;Conclusion&lt;/b&gt; Results show that MC1R variants, hair color, and number of nevi were jointly associated with melanoma risk in CDKN2A mutation carriers. This joint association may have important consequences for risk assessments in familial settings.&lt;/p&gt

Abundance, rarity and invasion debt among exotic species in a patchy ecosystem

Community assembly through species invasions is a long-term process, for which vital information regarding future trends can be contained in current patterns. Using comparative analyses of native and exotic plant assemblages from meadow patches on islands in British Columbia, Canada, we examined multiple lines of evidence for ‘invasion debt’, a latent expansion of exotic species populations. We show that: (1) short-dispersing species are underrepresented compared to their long-dispersing counterparts in exotic species only; (2) among species that are invasive elsewhere in North America, a greater proportion of long dispersers are common in the study area and a greater proportion of short dispersers are rare; and (3) time since arrival in the study region is positively related to number of occurrences in exotic species. In addition, we show that a suite of exotic species possesses the facility of rapid long-distance dispersal and ability to establish viable populations on even the most isolated and least disturbed patches. While some highly-dispersive exotic species can rapidly colonize new areas, short dispersers appear to exhibit invasion debt, with their potential distributions only being realized in the long term. Removing or even reducing populations of many rapid colonizers could be extremely difficult; however, for species exhibiting patterns most consistent with invasion debt, an opportunity exists for monitoring and removal to help reduce potential competition with native species

CNS Expression of B7-H1 Regulates Pro-Inflammatory Cytokine Production and Alters Severity of Theiler's Virus-Induced Demyelinating Disease

The CNS is a unique organ due to its limited capacity for immune surveillance. As macrophages of the CNS, microglia represent a population originally known for the ability to assist neuronal stability, are now appreciated for their role in initiating and regulating immune responses in the brain. Theiler's murine encephalomyelitis virus (TMEV)-induced demyelinating disease is a mouse model of multiple sclerosis (MS). In response to TMEV infection in vitro, microglia produce high levels of inflammatory cytokines and chemokines, and are efficient antigen-presenting cells (APCs) for activating CD4+ T cells. However, the regulatory function of microglia and other CNS-infiltrating APCs in response to TMEV in vivo remains unclear. Here we demonstrate that microglia increase expression of proliferating cell nuclear antigen (PCNA), and phenotypically express high levels of major histocompatibility complex (MHC)-Class I and II in response to acute infection with TMEV in SJL/J mice. Microglia increase expression of the inhibitory co-stimulatory molecule, B7-H1 as early as day 5 post-infection, while CNS-infiltrating CD11b+CD11c−CD45HIGH monocytes/macrophages and CD11b+CD11c+CD45HIGH dendritic cells upregulate expression of B7-H1 by day 3 post-infection. Utilizing a neutralizing antibody, we demonstrate that B7-H1 negatively regulates TMEV-specific ex vivo production of interferon (IFN)-γ, interleukin (IL)-17, IL-10, and IL-2 from CD4+ and CD8+ T cells. In vivo blockade of B7-H1 in SJL/J mice significantly exacerbates clinical disease symptoms during the chronic autoimmune stage of TMEV-IDD, but only has minimal effects on viral clearance. Collectively, these results suggest that CNS expression of B7-H1 regulates activation of TMEV-specific T cells, which affects protection against TMEV-IDD

Householders’ Mental Models of Domestic Energy Consumption: Using a Sort-And-Cluster Method to Identify Shared Concepts of Appliance Similarity

If in-home displays and other interventions are to successfully influence people's energy consumption, they need to communicate about energy in terms that make sense to users. Here we explore householders' perceptions of energy consumption, using a novel combination of card-sorting and clustering to reveal shared patterns in the way people think about domestic energy consumption. The data suggest that, when participants were asked to group appliances which they felt naturally 'went together', there are relatively few shared ideas about which appliances are conceptually related. To the extent participants agreed on which appliances belonged together, these groupings were based on activities (e.g., entertainment) and location within the home (e.g., kitchen); energy consumption was not an important factor in people's categorisations. This suggests messages about behaviour change aimed at reducing energy consumption might better be tied to social practices than to consumption itself

Pathological and Biological Differences Between Screen-Detected and Interval Ductal Carcinoma in situ of the Breast

Background: The incidence of ductal carcinoma in situ (DCIS) has risen dramatically with the introduction of screening mammography. The aim was to evaluate differences in pathological and biological characteristics between patients with screen-detected and interval DCIS. Methods: From January 1992 to December 2001, 128 consecutive patients had been treated for pure DCIS at our institute. From these, 102 had been attending the Dutch breast cancer screening program. Sufficient paraffin-embedded tissue was available in 74 out of the 102 cases to evaluate biological marker expression (Her2/neu, ER, PR, p53 and cyclin D1) on tissue microarrays (TMA group). Differences in clinicopathological characteristics and marker expression between screen-detected and interval patients were evaluated. Screen-detected DCIS was classified as DCIS detected by screening mammography, when the two-year earlier examination failed to reveal an abnormality. Interval patients were classified as patients with DCIS detected within the two-year interval between two subsequent screening rounds. Results: Screen-detected DCIS was related with linear branching and coarse granular microcalcifications on mammography (p < .001) and with high-grade DCIS according to the Van Nuys classification (p = .025). In univariate analysis, screen-detected DCIS was related with Her2/neu overexpression (odds ratio [OR] = 6.5; 95%CI 1.3-31.0; p = .020), and interval DCIS was associated with low-grade (Van Nuys, OR = 7.3; 95% CI 1.6-33.3; p = .010) and PR positivity (OR = 0.3; 95%CI 0.1-1.0; p = .042). The multivariate analysis displayed an independent relation of Her2/neu overexpression with screen-detected DCIS (OR = 12.8; 95%CI 1.6-104.0; p = .018). Conclusions: These findings suggest that screen-detected DCIS is biologically more aggressive than interval DCIS and should not be regarded as overdiagnosis