26,638 research outputs found

    Attentive monitoring of multiple video streams driven by a Bayesian foraging strategy

    Full text link
    In this paper we shall consider the problem of deploying attention to subsets of the video streams for collating the most relevant data and information of interest related to a given task. We formalize this monitoring problem as a foraging problem. We propose a probabilistic framework to model observer's attentive behavior as the behavior of a forager. The forager, moment to moment, focuses its attention on the most informative stream/camera, detects interesting objects or activities, or switches to a more profitable stream. The approach proposed here is suitable to be exploited for multi-stream video summarization. Meanwhile, it can serve as a preliminary step for more sophisticated video surveillance, e.g. activity and behavior analysis. Experimental results achieved on the UCR Videoweb Activities Dataset, a publicly available dataset, are presented to illustrate the utility of the proposed technique.Comment: Accepted to IEEE Transactions on Image Processin

    Combining computer game-based behavioural experiments with high-density EEG and infrared gaze tracking

    Get PDF
    Rigorous, quantitative examination of therapeutic techniques anecdotally reported to have been successful in people with autism who lack communicative speech will help guide basic science toward a more complete characterisation of the cognitive profile in this underserved subpopulation, and show the extent to which theories and results developed with the high-functioning subpopulation may apply. This study examines a novel therapy, the "Rapid Prompting Method" (RPM). RPM is a parent-developed communicative and educational therapy for persons with autism who do not speak or who have difficulty using speech communicatively.The technique aims to develop a means of interactive learning by pointing amongst multiple-choice options presented at different locations in space, with the aid of sensory "prompts" which evoke a response without cueing any specific response option. The prompts are meant to draw and to maintain attention to the communicative task–making the communicative and educational content coincident with the most physically salient, attention-capturing stimulus – and to extinguish the sensory–motor preoccupations with which the prompts compete.ideo-recorded RPM sessions with nine autistic children ages 8–14years who lacked functional communicative speech were coded for behaviours of interest

    The N170 event-related potential differentiates congruent and incongruent gaze responses in gaze leading

    Get PDF
    To facilitate social interactions, humans need to process the responses that other people make to their actions, including eye movements that could establish joint attention. Here, we investigated the neurophysiological correlates of the processing of observed gaze responses following the participants’ own eye movement. These observed gaze responses could either establish, or fail to establish, joint attention. We implemented a gaze leading paradigm in which participants made a saccade from an on-screen face to an object, followed by the on-screen face either making a congruent or incongruent gaze shift. An N170 event-related potential was elicited by the peripherally located gaze shift stimulus. Critically, the N170 was greater for joint attention than non-joint gaze both when task-irrelevant (Experiment 1) and task-relevant (Experiment 2). These data suggest for the first time that the neurocognitive system responsible for structural encoding of face stimuli is affected by the establishment of participant-initiated joint attention

    An fMRI study of parietal cortex involvement in the visual guidance of locomotion

    Get PDF
    Locomoting through the environment typically involves anticipating impending changes in heading trajectory in addition to maintaining the current direction of travel. We explored the neural systems involved in the “far road” and “near road” mechanisms proposed by Land and Horwood (1995) using simulated forward or backward travel where participants were required to gauge their current direction of travel (rather than directly control it). During forward egomotion, the distant road edges provided future path information, which participants used to improve their heading judgments. During backward egomotion, the road edges did not enhance performance because they no longer provided prospective information. This behavioral dissociation was reflected at the neural level, where only simulated forward travel increased activation in a region of the superior parietal lobe and the medial intraparietal sulcus. Providing only near road information during a forward heading judgment task resulted in activation in the motion complex. We propose a complementary role for the posterior parietal cortex and motion complex in detecting future path information and maintaining current lane positioning, respectively. (PsycINFO Database Record (c) 2010 APA, all rights reserved

    The development and neural basis of referential gaze perception

    Get PDF
    Infants are sensitive to the referential information conveyed by others’ eye gaze, which could be one of the developmental foundations of theory of mind. To investigate the neural correlates of gaze–object relations, we recorded ERPs from adults and 9-month-old infants while they watched scenes containing gaze shifts either towards or away from the location of a preceding object. In adults, object-incongruent gaze shifts elicited enhanced ERP amplitudes over the occipito-temporal area (N330). In infants, a similar posterior ERP component (N290) was greater for object-incongruent gaze shifts, which suggests that by the age of 9 months infants encode referential information of gaze in a similar way to adults. In addition, in infants we observed an early frontal ERP component (anterior N200), which showed higher amplitude in response to the perception of object-congruent gaze shifts. This component may reflect fast-track processing of socially relevant information, such as the detection of communicative or informative situations, and could form a developmental foundation for attention sharing, social learning and theory of mind

    Social interactions through the eyes of macaques and humans

    Get PDF
    Group-living primates frequently interact with each other to maintain social bonds as well as to compete for valuable resources. Observing such social interactions between group members provides individuals with essential information (e.g. on the fighting ability or altruistic attitude of group companions) to guide their social tactics and choice of social partners. This process requires individuals to selectively attend to the most informative content within a social scene. It is unclear how non-human primates allocate attention to social interactions in different contexts, and whether they share similar patterns of social attention to humans. Here we compared the gaze behaviour of rhesus macaques and humans when free-viewing the same set of naturalistic images. The images contained positive or negative social interactions between two conspecifics of different phylogenetic distance from the observer; i.e. affiliation or aggression exchanged by two humans, rhesus macaques, Barbary macaques, baboons or lions. Monkeys directed a variable amount of gaze at the two conspecific individuals in the images according to their roles in the interaction (i.e. giver or receiver of affiliation/aggression). Their gaze distribution to non-conspecific individuals was systematically varied according to the viewed species and the nature of interactions, suggesting a contribution of both prior experience and innate bias in guiding social attention. Furthermore, the monkeys’ gaze behavior was qualitatively similar to that of humans, especially when viewing negative interactions. Detailed analysis revealed that both species directed more gaze at the face than the body region when inspecting individuals, and attended more to the body region in negative than in positive social interactions. Our study suggests that monkeys and humans share a similar pattern of role-sensitive, species- and context-dependent social attention, implying a homologous cognitive mechanism of social attention between rhesus macaques and humans

    Anticipatory adjustments to being picked up in infancy

    Get PDF
    Anticipation of the actions of others is often used as a measure of action understanding in infancy. In contrast to studies of action understanding which set infants up as observers of actions directed elsewhere, in the present study we explored anticipatory postural adjustments made by infants to one of the most common adult actions directed to them - picking them up. We observed infant behavioural changes and recorded their postural shifts on a pressure mat in three phases: (i) a prior Chat phase, (ii) from the onset of Approach of the mother's arms, and (iii) from the onset of Contact. In Study 1, eighteen 3-month-old infants showed systematic global postural changes during Approach and Contact, but not during Chat. There was an increase in specific adjustments of the arms (widening or raising) and legs (stiffening and extending or tucking up) during Approach and a decrease in thrashing/general movements during Contact. Shifts in postural stability were evident immediately after onset of Approach and more slowly after Contact, with no regular shifts during Chat. In Study 2 we followed ten infants at 2, 3 and 4 months of age. Anticipatory behavioural adjustments during Approach were present at all ages, but with greater differentiation from a prior Chat phase only at 3 and 4 months. Global postural shifts were also more phase differentiated in older infants. Moreover, there was significantly greater gaze to the mother's hands during Approach at 4 months. Early anticipatory adjustments to being picked up suggest that infants' awareness of actions directed to the self may occur earlier than of those directed elsewhere, and thus enable infants' active participation in joint actions from early in life
    corecore