Rethinking affordance

n/a – Critical survey essay retheorising the concept of 'affordance' in digital media context. Lead article in a special issue on the topic, co-edited by the authors for the journal Media Theory

Empiricism without Magic: Transformational Abstraction in Deep Convolutional Neural Networks

In artificial intelligence, recent research has demonstrated the remarkable potential of Deep Convolutional Neural Networks (DCNNs), which seem to exceed state-of-the-art performance in new domains weekly, especially on the sorts of very difficult perceptual discrimination tasks that skeptics thought would remain beyond the reach of artificial intelligence. However, it has proven difficult to explain why DCNNs perform so well. In philosophy of mind, empiricists have long suggested that complex cognition is based on information derived from sensory experience, often appealing to a faculty of abstraction. Rationalists have frequently complained, however, that empiricists never adequately explained how this faculty of abstraction actually works. In this paper, I tie these two questions together, to the mutual benefit of both disciplines. I argue that the architectural features that distinguish DCNNs from earlier neural networks allow them to implement a form of hierarchical processing that I call “transformational abstraction”. Transformational abstraction iteratively converts sensory-based representations of category exemplars into new formats that are increasingly tolerant to “nuisance variation” in input. Reflecting upon the way that DCNNs leverage a combination of linear and non-linear processing to efficiently accomplish this feat allows us to understand how the brain is capable of bi-directional travel between exemplars and abstractions, addressing longstanding problems in empiricist philosophy of mind. I end by considering the prospects for future research on DCNNs, arguing that rather than simply implementing 80s connectionism with more brute-force computation, transformational abstraction counts as a qualitatively distinct form of processing ripe with philosophical and psychological significance, because it is significantly better suited to depict the generic mechanism responsible for this important kind of psychological processing in the brain

Synthetic worlds, synthetic strategies: attaining creativity in the metaverse

This text will attempt to delineate the underlying theoretical premises and the definition of the output of an immersive learning approach pertaining to the visual arts to be implemented in online, three dimensional synthetic worlds. Deviating from the prevalent practice of the replication of physical art studio teaching strategies within a virtual environment, the author proposes instead to apply the fundamental tenets of Roy Ascott’s “Groundcourse”, in combination with recent educational approaches such as “Transformative Learning” and “Constructionism”. In an amalgamation of these educational approaches with findings drawn from the fields of Metanomics, Ludology, Cyberpsychology and Presence Studies, as well as an examination of creative practices manifest in the metaverse today, the formulation of a learning strategy for creative enablement unique to online, three dimensional synthetic worlds; one which will focus upon “Play” as well as Role Play, virtual Assemblage and the visual identity of the avatar within the pursuits, is being proposed in this chapter