Desire Lines: Open Educational Collections, Memory and the Social Machine

This paper delineates the initial ideas around the development of the Co-Curate North East project. The idea of computerised machines which have a social use and impact was central to the development of the project. The project was designed with and for schools and communities as a digital platform which would collect and aggregate ‘memory’ resources and collections around local area studies and social identity. It was a co-curation process supported by museums and curators which was about the ‘meshwork’ between ‘official’ and ‘unofficial’ archives and collections and the ways in which materials generated from within the schools and community groups could themselves be re-narrated and exhibited online as part of self-organised learning experiences. This paper looks at initial ideas of social machines and the ways in machines can be used in identity and memory studies. It examines ideas of navigation and visualisation of data and concludes with some initial findings from the early stages of the project about the potential for machines and educational work

A survey of visual preprocessing and shape representation techniques

Many recent theories and methods proposed for visual preprocessing and shape representation are summarized. The survey brings together research from the fields of biology, psychology, computer science, electrical engineering, and most recently, neural networks. It was motivated by the need to preprocess images for a sparse distributed memory (SDM), but the techniques presented may also prove useful for applying other associative memories to visual pattern recognition. The material of this survey is divided into three sections: an overview of biological visual processing; methods of preprocessing (extracting parts of shape, texture, motion, and depth); and shape representation and recognition (form invariance, primitives and structural descriptions, and theories of attention)

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Vocal Performance Through Electrical Flows: Making Current Kin

What do we hear in a human voice that vibrates through electrical flows? In this paper I argue for listening (and vocalizing) beyond the human in performances with audio media. I propose understanding such performance practice as engaging with what I call plasmatic voice, a phenomenon distinct from the merely additive, prosthetic conception of voice + electricity. Instead, plasmatic voice functions as instances of queer assemblage stretching to reach the radically Other that constitutes ourselves—facilitating the sense of what Alaimo (2010) terms transcorporeality, an understanding of human embodiment as “intermeshed with the more-than-human world” (2). The vibrations of plasmatic voice—as an example of Eidsheim’s (2015) intermaterial vibrational practice—loosen (post)human social constructs of race and gender and reverberate with nonhuman ecosystems, as I illustrate through analysis of musical examples

Perceptually optimized real-time computer graphics

Perceptual optimization, the application of human visual perception models to remove imperceptible components in a graphics system, has been proven effective in achieving significant computational speedup. Previous implementations of this technique have focused on spatial level of detail reduction, which typically results in noticeable degradation of image quality. This thesis introduces refresh rate modulation (RRM), a novel perceptual optimization technique that produces better performance enhancement while more effectively preserving image quality and resolving static scene elements in full detail. In order to demonstrate the effectiveness of this technique, a graphics framework has been developed that interfaces with eye tracking hardware to take advantage of user fixation data in real-time. Central to the framework is a high-performance GPGPU ray-tracing engine written in OpenCL. RRM reduces the frequency with which pixels outside of the foveal region are updated by the ray-tracer. A persistent pixel buffer is maintained such that peripheral data from previous frames provides context for the foveal image in the current frame. Traditional optimization techniques have also been incorporated into the ray-tracer for improved performance. Applying the RRM technique to the ray-tracing engine results in a speedup of 2.27 (252 fps vs. 111 fps at 1080p) for the classic Whitted scene with reflection and transmission enabled. A speedup of 3.41 (140 fps vs. 41 fps at 1080p) is observed for a high-polygon scene that depicts the Stanford Bunny. A small pilot study indicates that RRM achieves these results with minimal impact to perceived image quality. A secondary investigation is conducted regarding the performance benefits of increasing physics engine error tolerance for bounding volume hierarchy based collision detection when the scene elements involved are in the user\u27s periphery. The open-source Bullet Physics Library was used to add accurate collision detection to the full resolution ray-tracing engine. For a scene with a static high-polygon model and 50 moving spheres, a speedup of 1.8 was observed for physics calculations. The development and integration of this subsystem demonstrates the extensibility of the graphics framework

Logic and phenomenology of incompleteness in illusory figures: new cases and hypotheses

Why is it relevant to analyze the role of incompleteness in illusory figure formation? Incompleteness probes the general problems of organization of the visual world and object segregation. The organization problem is one of the most important problems in visual neuroscience; namely: How and why are a very large numebr of unorganized elements of the retinal image combined, reduced, grouped and segregated to create visual objects? Within the problem of organizaiton, illusory figures are often considered to be one of the best examples to understand how and why the visual system segregates objects with a particular shape, color, and depth stratification. Understanding the role played by incompleteness in inducing illusory figures can thus be useful for understanding the principles of organization (the How) of perceptual forms and the more general logic of perception (the Why). To this purpose, incompletenss is here studied by analyzing its underlying organization principles and its inner logic

Hierarchical Bayesian Inference in the Visual Cortex

Traditional views of visual processing suggest that early visual neurons in areas V1 and V2 are static spatiotemporal filters that extract local features from a visual scene. The extracted information is then channeled through a feedforward chain of modules in successively higher visual areas for further analysis. Recent electrophysiological recordings from early visual neurons in awake behaving monkeys reveal that there are many levels of complexity in the information processing of the early visual cortex, as seen in the long-latency responses of its neurons. These new findings suggest that activity in the early visual cortex is tightly coupled and highly interactive with the rest of the visual system. They lead us to propose a new theoretical setting based on the mathematical framework of hierarchical Bayesian inference for reasoning about the visual system. In this framework, the recurrent feedforward/feedback loops in the cortex serve to integrate top-down contextual priors and bottom-up observations so as to implement concurrent probabilistic inference along the visual hierarchy. We suggest that the algorithms of particle filtering and Bayesian-belief propagation might model these interactive cortical computations. We review some recent neurophysiological evidences that support the plausibility of these ideas.Mathematic

Neural Representations of Visual Motion Processing in the Human Brain Using Laminar Imaging at 9.4 Tesla

During natural behavior, much of the motion signal falling into our eyes is due to our own movements. Therefore, in order to correctly perceive motion in our environment, it is important to parse visual motion signals into those caused by self-motion such as eye- or head-movements and those caused by external motion. Neural mechanisms underlying this task, which are also required to allow for a stable perception of the world during pursuit eye movements, are not fully understood. Both, perceptual stability as well as perception of real-world (i.e. objective) motion are the product of integration between motion signals on the retina and efference copies of eye movements. The central aim of this thesis is to examine whether different levels of cortical depth or distinct columnar structures of visual motion regions are differentially involved in disentangling signals related to self-motion, objective, or object motion. Based on previous studies reporting segregated populations of voxels in high level visual areas such as V3A, V6, and MST responding predominantly to either retinal or extra- retinal (‘real’) motion, we speculated such voxels to reside within laminar or columnar functional units. We used ultra-high field (9.4T) fMRI along with an experimental paradigm that independently manipulated retinal and extra-retinal motion signals (smooth pursuit) while controlling for effects of eye-movements, to investigate whether processing of real world motion in human V5/MT, putative MST (pMST), and V1 is associated to differential laminar signal intensities. We also examined motion integration across cortical depths in human motion areas V3A and V6 that have strong objective motion responses. We found a unique, condition specific laminar profile in human area V6, showing reduced mid-layer responses for retinal motion only, suggestive of an inhibitory retinal contribution to motion integration in mid layers or alternatively an excitatory contribution in deep and superficial layers. We also found evidence indicating that in V5/MT and pMST, processing related to retinal, objective, and pursuit motion are either integrated or colocalized at the scale of our resolution. In contrast, in V1, independent functional processes seem to be driving the response to retinal and objective motion on the one hand, and to pursuit signals on the other. The lack of differential signals across depth in these regions suggests either that a columnar rather than laminar segregation governs these functions in these areas, or that the methods used were unable to detect differential neural laminar processing. Furthermore, the thesis provides a thorough analysis of the relevant technical modalities used for data acquisition and data analysis at ultra-high field in the context of laminar fMRI. Relying on our technical implementations we were able to conduct two high-resolution fMRI experiments that helped us to further investigate the laminar organization of self-induced and externally induced motion cues in human high-level visual areas and to form speculations about the site and the mechanisms of their integration