Learning Visual Question Answering by Bootstrapping Hard Attention

Attention mechanisms in biological perception are thought to select subsets of perceptual information for more sophisticated processing which would be prohibitive to perform on all sensory inputs. In computer vision, however, there has been relatively little exploration of hard attention, where some information is selectively ignored, in spite of the success of soft attention, where information is re-weighted and aggregated, but never filtered out. Here, we introduce a new approach for hard attention and find it achieves very competitive performance on a recently-released visual question answering datasets, equalling and in some cases surpassing similar soft attention architectures while entirely ignoring some features. Even though the hard attention mechanism is thought to be non-differentiable, we found that the feature magnitudes correlate with semantic relevance, and provide a useful signal for our mechanism's attentional selection criterion. Because hard attention selects important features of the input information, it can also be more efficient than analogous soft attention mechanisms. This is especially important for recent approaches that use non-local pairwise operations, whereby computational and memory costs are quadratic in the size of the set of features.Comment: ECCV 201

Neural representation of action sequences: how far can a simple snippet-matching model take us?

The macaque Superior Temporal Sulcus (STS) is a brain area that receives and integrates inputs from both the ventral and dorsal visual processing streams (thought to specialize in form and motion processing respectively). For the processing of articulated actions, prior work has shown that even a small population of STS neurons contains sufficient information for the decoding of actor invariant to action, action invariant to actor, as well as the specific conjunction of actor and action. This paper addresses two questions. First, what are the invariance properties of individual neural representations (rather than the population representation) in STS? Second, what are the neural encoding mechanisms that can produce such individual neural representations from streams of pixel images? We find that a baseline model, one that simply computes a linear weighted sum of ventral and dorsal responses to short action “snippets”, produces surprisingly good fits to the neural data. Interestingly, even using inputs from a single stream, both actor-invariance and action-invariance can be produced simply by having different linear weights

Preparation of fiber reinforced titanium diboride and boron carbide composite bodies

A process is described for uniformly infiltrating woven carbon cloth with either titanium diboride or boron carbide at reduced pressure (15 to 25 torr). The effects of deposition temperature on the uniformity of penetration and on coating rate are described for temperatures from 750 to 1000/sup 0/C and deposit loadings from 20 to 43 vol. %. For the boron carbides, boron composition is discussed and evidence is presented suggesting that propene is the dominant rate controlling reactant

Processing yttrium-barium-copper oxide superconductor zero gravity using a double float zone surface

The effects of processing YBa{sub 2}Cu{sub 3}O{sub x} (Y123) superconductor in the near-zero gravity (0g) environment provided by the NASA KC-135 airplane flying on parabolic trajectories were studied. A new sheet float zone furnace, designed for this study, enabled fast temperature ramps. Up to an 18-gram sample was processed with each parabola. Samples of Y123 were processed as bulk sheets, composites containing Ag and Pd, and films deposited on single crystal Si and MgO substrates. The 0g-processed samples were multi-phase yet retained a localized Y123 stoichiometry where a single ground-based (1g) oxygen anneal at temperatures of 800 C recovered nearly 100-volume percent superconducting Y123. The 1g processed control samples remained multi-phase after the same ground-based anneal with less than 45 volume percent as superconducting Y123. The superconducting transition temperature was 91 K for both 0g and 1g processed samples. A 29 wt.% Ag/Y123 composite had a transition temperature of 93 K. Melt texturing of bulk Y123 in 0g produced aligned grains about a factor of three larger than in analogous 1g samples. Transport critical current densities were at or below 18 A/cm{sup 2}, due to the formation of cracks caused by the rapid heating rates required by the short time at 0g. Y123 deposited on single crystal Si and MgO in 0g was 30 vol.% y123 without an anneal. A weak superconducting transition at 80 K on MgO showed that substrate interactions occurred

Introspective physicalism as an approach to the science of consciousness

Most ‘theories of consciousness’ are based on vague speculations about the properties of conscious experience. We aim to provide a more solid basis for a science of consciousness. We argue that a theory of consciousness should provide an account of the very processes that allow us to acquire and use information about our own mental states – the processes underlying introspection. This can be achieved through the construction of information processing models that can account for ‘Type-C’ processes. Type-C processes can be specified experimentally by identifying paradigms in which awareness of the stimulus is necessary for an intentional action. The Shallice (1988b) framework is put forward as providing an initial account of Type-C processes, which can relate perceptual consciousness to consciously performed actions. Further, we suggest that this framework may be refined through the investigation of the functions of prefrontal cortex. The formulation of our approach requires us to consider fundamental conceptual and methodological issues associated with consciousness. The most significant of these issues concerns the scientific use of introspective evidence. We outline and justify a conservative methodological approach to the use of introspective evidence, with attention to the difficulties historically associated with its use in psychology

The significance of opthalmologic evaluation in the early diagnosis of inborn errors of metabolism: the Cretan experience

BACKGROUND: The Inborn Errors of Metabolism (IEM) are far from the rare systemic diseases that mainly affect the neural tissue. There are very few written reports on ocular findings in subjects with IEM, thus it was interesting to study the frequency of ocular findings in the studied population and explore their contribution to the early diagnosis of IEM. METHODS: Our study involved the evaluation of IEM suspected cases, which had been identified in a rural population in Crete, Greece. Over a period of 3 years, 125 patients, who fulfilled the inclusion criteria of this study, were examined. Analytical physical examination, detailed laboratory investigation as well as a thorough ocular examination were made. RESULTS: A diagnosis of IEM was established in 23 of the 125 patients (18.4%). Ten (43.5%) of the diagnosed IEM had ocular findings, while 8 of them (34.8%) had findings which were specific for the diagnosed diseases. One patient diagnosed with glycogenosis type 1b presented a rare finding. Of the 102 non-diagnosed patients, 53 (51.96 %) presented various ophthalmic findings, some of which could be related to a metabolic disease and therefore may be very helpful in the future. CONCLUSIONS: The ocular investigation can be extremely useful for raising the suspicion and the establishment of an early diagnosis of IEM. It could also add new findings related to these diseases. The early management of the ocular symptoms can improve the quality of life to these patients

Relational Lockdown and Relational Trauma in the Time of Coronavirus: A Reflection from a UK Family Therapist

This is the final version. Available on open access from Wiley via the DOI in this recordLike a meteor hitting the earth’s surface, 41,698* unexpected deaths have shaken, disturbed, and saddened the core of our nation. This reflection considers the consequences of the coronavirus crisis in the UK with particular reference to the impact on families and on the practice of family therapists. The perspective presented can only be partial because of the fast‐changing situation and the limited access to alternative perspectives that are available during this period of relational lockdown. The author provides a systemic understanding of what has happened and what is happening

Bistable Percepts in the Brain: fMRI Contrasts Monocular Pattern Rivalry and Binocular Rivalry

The neural correlates of binocular rivalry have been actively debated in recent years, and are of considerable interest as they may shed light on mechanisms of conscious awareness. In a related phenomenon, monocular rivalry, a composite image is shown to both eyes. The subject experiences perceptual alternations in which the two stimulus components alternate in clarity or salience. The experience is similar to perceptual alternations in binocular rivalry, although the reduction in visibility of the suppressed component is greater for binocular rivalry, especially at higher stimulus contrasts. We used fMRI at 3T to image activity in visual cortex while subjects perceived either monocular or binocular rivalry, or a matched non-rivalrous control condition. The stimulus patterns were left/right oblique gratings with the luminance contrast set at 9%, 18% or 36%. Compared to a blank screen, both binocular and monocular rivalry showed a U-shaped function of activation as a function of stimulus contrast, i.e. higher activity for most areas at 9% and 36%. The sites of cortical activation for monocular rivalry included occipital pole (V1, V2, V3), ventral temporal, and superior parietal cortex. The additional areas for binocular rivalry included lateral occipital regions, as well as inferior parietal cortex close to the temporoparietal junction (TPJ). In particular, higher-tier areas MT+ and V3A were more active for binocular than monocular rivalry for all contrasts. In comparison, activation in V2 and V3 was reduced for binocular compared to monocular rivalry at the higher contrasts that evoked stronger binocular perceptual suppression, indicating that the effects of suppression are not limited to interocular suppression in V1

Perceptual Rivalry: Reflexes Reveal the Gradual Nature of Visual Awareness

Rivalry is a common tool to probe visual awareness: a constant physical stimulus evokes multiple, distinct perceptual interpretations (“percepts”) that alternate over time. Percepts are typically described as mutually exclusive, suggesting that a discrete (all-or-none) process underlies changes in visual awareness. Here we follow two strategies to address whether rivalry is an all-or-none process: first, we introduce two reflexes as objective measures of rivalry, pupil dilation and optokinetic nystagmus (OKN); second, we use a continuous input device (analog joystick) to allow observers a gradual subjective report. We find that the “reflexes” reflect the percept rather than the physical stimulus. Both reflexes show a gradual dependence on the time relative to perceptual transitions. Similarly, observers' joystick deflections, which are highly correlated with the reflex measures, indicate gradual transitions. Physically simulating wave-like transitions between percepts suggest piece-meal rivalry (i.e., different regions of space belonging to distinct percepts) as one possible explanation for the gradual transitions. Furthermore, the reflexes show that dominance durations depend on whether or not the percept is actively reported. In addition, reflexes respond to transitions with shorter latencies than the subjective report and show an abundance of short dominance durations. This failure to report fast changes in dominance may result from limited access of introspection to rivalry dynamics. In sum, reflexes reveal that rivalry is a gradual process, rivalry's dynamics is modulated by the required action (response mode), and that rapid transitions in perceptual dominance can slip away from awareness