Seeing the invisible: The scope and limits of unconscious processing in binocular rivalry

When an image is presented to one eye and a very different image is presented to the corresponding location of the other eye, they compete for conscious representation, such that only one image is visible at a time while the other is suppressed. Called binocular rivalry, this phenomenon and its deviants have been extensively exploited to study the mechanism and neural correlates of consciousness. In this paper, we propose a framework, the unconscious binding hypothesis, to distinguish unconscious processing from conscious processing. According to this framework, the unconscious mind not only encodes individual features but also temporally binds distributed features to give rise to cortical representation, but unlike conscious binding, such unconscious binding is fragile. Under this framework, we review evidence from psychophysical and neuroimaging studies, which suggests that: (1) for invisible low level features, prolonged exposure to visual pattern and simple translational motion can alter the appearance of subsequent visible features (i.e. adaptation); for invisible high level features, although complex spiral motion cannot produce adaptation, nor can objects/words enhance subsequent processing of related stimuli (i.e. priming), images of tools can nevertheless activate the dorsal pathway; and (2) although invisible central cues cannot orient attention, invisible erotic pictures in the periphery can nevertheless guide attention, likely through emotional arousal; reciprocally, the processing of invisible information can be modulated by attention at perceptual and neural levels

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Dorsal stream : from algorithm to neuroscience

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011.Cataloged from PDF version of thesis.Includes bibliographical references (p. 173-195).The dorsal stream in the primate visual cortex is involved in the perception of motion and the recognition of actions. The two topics, motion processing in the brain, and action recognition in videos, have been developed independently in the field of neuroscience and computer vision. We present a dorsal stream model that can be used for the recognition of actions as well as explaining neurophysiology in the dorsal stream. The model consists of a spatio-temporal feature detectors of increasing complexity: an input image sequence is first analyzed by an array of motion sensitive units which, through a hierarchy of processing stages, lead to position and scale invariant representation of motion in a video sequence. The model outperforms or on par with the state-of-the-art computer vision algorithms on a range of human action datasets. We then describe the extension of the model into a high-throughput system for the recognition of mouse behaviors in their homecage. We provide software and a very large manually annotated video database used for training and testing the system. Our system outperforms a commercial software and performs on par with human scoring, as measured from the ground-truth manual annotations of more than 10 hours of videos of freely behaving mice. We complete the neurobiological side of the model by showing it could explain the motion processing as well as action selectivity in the dorsal stream, based on comparisons between model outputs and the neuronal responses in the dorsal stream. Specifically, the model could explain pattern and component sensitivity and distribution [161], local motion integration [97], and speed-tuning [144] of MT cells. The model, when combining with the ventral stream model [173], could also explain the action and actor selectivity in the STP area. There exists only a few models for the motion processing in the dorsal stream, and these models were not be applied to the real-world computer vision tasks. Our model is one that agrees with (or processes) data at different levels: from computer vision algorithm, practical software, to neuroscience.by Hueihan Jhuang.Ph.D

Stimulus and task-dependent gamma activity in monkey V1

The single unit doctrine proposes that each one of our percepts and sensations is represented by the activity of specialized high-level cells in the brain. A common criticism applied to this proposal is the one referred to as the "combinatorial problem". We are constantly confronted with unlimited combinations of elements and features, and yet we face no problem in recognizing patterns and objects present in visual scenes. Are there enough neurons in the brain to singly code for each one of our percepts? Or is it the case that perceptions are represented by the distributed activity of different neuronal ensembles? We lack a general theory capable of explaining how distributed information can be efficiently integrated into single percepts. The working hypothesis here is that distributed neuronal ensembles signal relations present in the stimulus by selectively synchronizing their spiking responses. Synchronization is generally associated with oscillatory activity in the brain. Gamma oscillations in particular have been linked to various integrative processes in the visual system. Studies in anesthetized animals have shown a conspicuous increase in power for the gamma frequency band (30 to 60 Hz) in response to visual stimuli. Recently, these observations have been extended to behavioral studies which addressed the role of gamma activity in cognitive processes demanding selective attention. The initial motivation for carrying out this work was to test if the binding-by-synchronization (BBS) hypothesis serves as a neuronal mechanism for perceptual grouping in the visual system. To this aim we used single and superimposed grating stimuli. Superimposed gratings (plaids) are bi-stable stimuli capable of eliciting different percepts depending on their physical characteristics. In this way, plaids can be perceived either as a single moving surface (pattern plaids), or as two segregated surfaces drifting in different directions (component plaids). While testing the BBS hypothesis, we performed various experiments which addressed the role of both stimulus and cortical architecture on the properties of gamma oscillations in the primary visual cortex (V1) of monkeys. Additionally, we investigated whether gamma activity could also be modulated by allocating attention in time. Finally, we report on gamma-phase shifts in area V1, and how they depend on the level of neuronal activation. ...Einleitung: Die visuelle Hirnforschung hat eine große Informationsmenge über die analytischen Fähigkeiten des Nervensystems zusammengetragen. Die Einführung von Einzelzellableitungen ermöglichte eine detaillierte Beschreibung der Eigenschaften rezeptiver Felder im Sehsystem. Konzentrische rezeptive Felder in der Netzhaut antworten optimal auf einen Luminanzkontrast in ihren On- und Off-Regionen. Antworteigenschaften entwickeln sich schrittweise entlang der Sehbahn, indem zunehmend komplexere Eigenschaften des visuellen Reizes extrahiert werden. Die Pionierarbeiten von David Hubel und Torsten Wiesel beschrieben zunächst Orientierung- und Richtungsselektivität von Neuronen in frühen visuellen Kortexarealen. Später fand man Einzelzellen im medialen Temporallappen, die auf komplexe Objekte wie Hände und Gesichter antworten. Die Hirnforschung ist daher lange davon ausgegangen, dass die Repräsentation komplexer Objekte eine natürliche Entfaltung von Konvergenz entlang der Sehbahn darstellt. Zellen, welche auf elementare Merkmale des Stimulus antworteten, bildeten so durch ihr Muster anatomischer Verbindungen schrittweise die spezialisierten Neurone in höheren visuellen Arealen. Diese Sichtweise zeigt allerdings Limitationen auf. Eine beständige Kritik, die an der "Einzelzelldoktrin" geübt wird, ist das sogenannte kombinatorische Problem. Obwohl wir ständig mit einer unbegrenzten Fülle an Kombinationen verschiedener Elemente und Merkmale konfrontiert sind, laufen wir selten Gefahr, Muster und Objekte in einer visuellen Szene nicht zu erkennen. Ist es überhaupt möglich, dass jedes unserer möglichen Perzepte durch die Antwort eines einzelnen hoch spezialisierten Neurons im Hirn kodiert wird? Falls nicht, welcher Mechanismus könnte einen relationalen Code darstellen, der es ermöglicht, die Aktivität verschiedener neuronaler Ensembles zu integrieren? Die Anforderungen an einen solchen Mechanismus treten besonders hervor, wenn man sich die verteilte Struktur der visuellen Verarbeitung verdeutlicht. Die Merkmalsextraktion entlang der Sehbahn führt unvermeidbar zu einer räumlich verstreuten Repräsentation eines visuellen Reizes. Zusätzlich kommen parallele Bahnen neuronaler Verarbeitung im Hirn häufig vor. Es fehlt eine universale Theorie darüber, wie die verteilte Information effizient in eine einzige Wahrnehmung integriert wird. Die Arbeitshypothese hier lautet, dass das Hirn die Zeitdomäne benutzt, um visuelle Informationen zu integrieren und zu verarbeiten. Konkret würden neuronale Ensemble die aus dem Stimulus hervorgehenden Beziehungen durch eine selektive Synchronisation ihrer Aktionspotenziale signalisieren. Synchronisation ist normalerweise mit oszillatorischer Hirnaktivität assoziiert. Besonders die Oszillationen im Gamma Frequenzband sind mit verschiedensten integrativen Prozessen im Sehsystem in Verbindung gebracht worden. Arbeiten an anästhesierten Tieren haben einen auffälligen Anstieg von Energie im Gamma Frequenzband (30-60 Hz) unter visueller Stimulation gezeigt. Kürzlich sind diese Beobachtungen auf Verhaltensstudien ausgeweitet worden, welche die Rolle von Gamma Aktivität bei der für kognitive Prozesse erforderlichen gerichteten Aufmerksamkeit untersuchen. Die ursprüngliche Motivation dieser Arbeit war es, die von Wolf Singer und Mitarbeitern formulierte "binding-bysynchronization (BBS)" Hypothese zu testen. Dies wurde durch die Ableitung neuronaler Antworten in V1 bei Darbietung eines Paars übereinander gelegter Balkengitter ("Plaid" Stimulus) angegangen. Physikalische Manipulationen der Luminanz in Unterregionen des Plaid-Stimulus können die Wahrnehmung zugunsten der Bewegung der Einzelkomponenten (zwei Objekte, die sich übereinander schieben) oder der Bewegung des Gesamtmusters (ein einziges sich in eine gemeinsame Richtung bewegendes Objekt) beeinflussen. Die gleichzeitige Ableitung von zwei Neuronen, die jeweils nur selektiv auf eines der beiden Balkengitter antworteten, ermöglichte es uns, zwei Vorhersagen der BBS Hypothese zu testen. Falls beide V1 Neurone auf dasselbe Balkengitter antworteten, sollten sie ihre Aktivität unabhängig davon, ob das Plaid in Einzelkomponenten oder als Gesamtmuster wahrgenommen würde, synchronisieren. Der Grund dafür wäre, dass beide Neurone auf dasselbe Objekt reagierten. Im zweiten Fall antworten beide Ableitstellen auf jeweils eine der beiden Balkengitterkomponenten. Hier sagt die BBS Hypothese voraus, dass beide ihre Aktivität nur bei Gesamtmusterbewegung synchronisieren würden, da sie nur in dieser Bedingung auf dasselbe Objekt antworten würden. ..

Visual Cortex

The neurosciences have experienced tremendous and wonderful progress in many areas, and the spectrum encompassing the neurosciences is expansive. Suffice it to mention a few classical fields: electrophysiology, genetics, physics, computer sciences, and more recently, social and marketing neurosciences. Of course, this large growth resulted in the production of many books. Perhaps the visual system and the visual cortex were in the vanguard because most animals do not produce their own light and offer thus the invaluable advantage of allowing investigators to conduct experiments in full control of the stimulus. In addition, the fascinating evolution of scientific techniques, the immense productivity of recent research, and the ensuing literature make it virtually impossible to publish in a single volume all worthwhile work accomplished throughout the scientific world. The days when a single individual, as Diderot, could undertake the production of an encyclopedia are gone forever. Indeed most approaches to studying the nervous system are valid and neuroscientists produce an almost astronomical number of interesting data accompanied by extremely worthy hypotheses which in turn generate new ventures in search of brain functions. Yet, it is fully justified to make an encore and to publish a book dedicated to visual cortex and beyond. Many reasons validate a book assembling chapters written by active researchers. Each has the opportunity to bind together data and explore original ideas whose fate will not fall into the hands of uncompromising reviewers of traditional journals. This book focuses on the cerebral cortex with a large emphasis on vision. Yet it offers the reader diverse approaches employed to investigate the brain, for instance, computer simulation, cellular responses, or rivalry between various targets and goal directed actions. This volume thus covers a large spectrum of research even though it is impossible to include all topics in the extremely diverse field of neurosciences

Recognition by Flickering Components: The Effect of Temporal Modulation on Image Recognition

A primary goal of vision is to identify objects rapidly and efficiently. Successful object and scene recognition results from the integration of both feed-forward and feedback processes that correspond a two-dimensional retinal image to a representation of its content stored in memory (Bar, 2003). One general organizing principle may be that the visual system analyzes images and scenes according to their spatial components in a coarse- (low spatial frequency) to-fine (high spatial frequency) sequence (Bullier, 2001; Hegde, 2008). An individual’s sensitivity to these spatial components is described by contrast sensitivity function (CSF), which indicates the minimum contrast required for the detection of patterns of various sizes. A consistent finding is that, when temporally modulated at a moderate rate, sensitivity to lower spatial frequency gratings is heightened relative to its static counterpart (Robson, 1966; Abramov et al., 2012). This suggests that temporal modulation may enhance image detectability, especially so for those coarsest spatial components—the lower spatial frequencies—that seem to be most important for detection and categorization of objects and scenes. We presented participants with an array of grayscale images depicting objects and scenes under 3 spatial (3cpd-filtered, 4cpd-filtered, and unfiltered full-spectrum) and 3 temporal (static, 6Hz counterphase flicker, and 250ms presentation) conditions, at 4 levels of near-threshold contrast. Responses were open-ended identifications. Temporal modulation was hypothesized to improve recognition in all spatial conditions, while short-duration presentation was predicted to result in performance comparable to the full-duration static condition. Males were hypothesized to perform better than females based on previously reported (Abramov, et al., 2012) sensitivity differences. Results partially supported our hypotheses: temporal modulation at 6Hz had recognition enhancement effects only for the lowest spatial frequency-cutoff—3 cpd. We describe a distinction among the neurological underpinnings of the CSF into two separate mechanisms responsible for the lower and upper halves of the CSF