Coloresia : An Interactive Colour Perception Device for the Visually Impaired

A significative percentage of the human population suffer from impairments in their capacity to distinguish or even see colours. For them, everyday tasks like navigating through a train or metro network map becomes demanding. We present a novel technique for extracting colour information from everyday natural stimuli and presenting it to visually impaired users as pleasant, non-invasive sound. This technique was implemented inside a Personal Digital Assistant (PDA) portable device. In this implementation, colour information is extracted from the input image and categorised according to how human observers segment the colour space. This information is subsequently converted into sound and sent to the user via speakers or headphones. In the original implementation, it is possible for the user to send its feedback to reconfigure the system, however several features such as these were not implemented because the current technology is limited.We are confident that the full implementation will be possible in the near future as PDA technology improves

NICE : A Computational solution to close the gap from colour perception to colour categorization

The segmentation of visible electromagnetic radiation into chromatic categories by the human visual system has been extensively studied from a perceptual point of view, resulting in several colour appearance models. However, there is currently a void when it comes to relate these results to the physiological mechanisms that are known to shape the pre-cortical and cortical visual pathway. This work intends to begin to fill this void by proposing a new physiologically plausible model of colour categorization based on Neural Isoresponsive Colour Ellipsoids (NICE) in the cone-contrast space defined by the main directions of the visual signals entering the visual cortex. The model was adjusted to fit psychophysical measures that concentrate on the categorical boundaries and are consistent with the ellipsoidal isoresponse surfaces of visual cortical neurons. By revealing the shape of such categorical colour regions, our measures allow for a more precise and parsimonious description, connecting well-known early visual processing mechanisms to the less understood phenomenon of colour categorization. To test the feasibility of our method we applied it to exemplary images and a popular ground-truth chart obtaining labelling results that are better than those of current state-of-the-art algorithms

Autonomous Exploration of Large-Scale Natural Environments

This thesis addresses issues which arise when using robotic platforms to explore large-scale, natural environments. Two main problems are identified: the volume of data collected by autonomous platforms and the complexity of planning surveys in large environments. Autonomous platforms are able to rapidly accumulate large data sets. The volume of data that must be processed is often too large for human experts to analyse exhaustively in a practical amount of time or in a cost-effective manner. This burden can create a bottleneck in the process of converting observations into scientifically relevant data. Although autonomous platforms can collect precisely navigated, high-resolution data, they are typically limited by finite battery capacities, data storage and computational resources. Deployments are also limited by project budgets and time frames. These constraints make it impractical to sample large environments exhaustively. To use the limited resources effectively, trajectories which maximise the amount of information gathered from the environment must be designed. This thesis addresses these problems. Three primary contributions are presented: a new classifier designed to accept probabilistic training targets rather than discrete training targets; a semi-autonomous pipeline for creating models of the environment; and an offline method for autonomously planning surveys. These contributions allow large data sets to be processed with minimal human intervention and promote efficient allocation of resources. In this thesis environmental models are established by learning the correlation between data extracted from a digital elevation model (DEM) of the seafloor and habitat categories derived from in-situ images. The DEM of the seafloor is collected using ship-borne multibeam sonar and the in-situ images are collected using an autonomous underwater vehicle (AUV). While the thesis specifically focuses on mapping and exploring marine habitats with an AUV, the research applies equally to other applications such as aerial and terrestrial environmental monitoring and planetary exploration

Coordinating perceptually grounded categories through language: A case study for colour

This article proposes a number of models to examine through which mechanisms a population of autonomous agents could arrive at a repertoire of perceptually grounded categories that is sufficiently shared to allow successful communication. the models are inspired by the main approaches to human categorisation being discussed in the literature: nativism, empiricism, and culturalism. colour is taken as a case study. although we take no stance on which position is to be accepted as final truth with respect to human categorisation and naming, we do point to theoretical constraints that make each position more or less likely and we make clear suggestions on what the best engineering solution would be. specifically, we argue that the collective choice of a shared repertoire must integrate multiple constraints, including constraints coming from communication.This research was sponsored by the Sony Computer Science Laboratory in Paris, the Flemish Fund for Scientific Research (FWO Vlaanderen), the OMLL initiative of the European Science Foundation, and the EU-FET ECAgents and Cogniron project.Peer reviewe

Language impairment and colour categories

Goldstein (1948) reported multiple cases of failure to categorise colours in patients that he termed amnesic or anomic aphasics. these patients have a particular difficulty in producing perceptual categories in the absence of other aphasic impairments. we hold that neuropsychological evidence supports the view that the task of colour categorisation is logically impossible without labels

How culture might constrain color categories

If language is crucial to the development of shared colour categories, how might cultural constraints influence the development of divergent category sets? We propose that communities arrive at different sets of categories because the tendency to group by perceptual similarity interacts with environmental factors (differential access to dying and printing technologies), to make different systems optimal for communication in different situations.</p

A Computational Model of Creative Design as a Sociocultural Process Involving the Evolution of Language

The aim of this research is to investigate the mechanisms of creative design within the context of an evolving language through computational modelling. Computational Creativity is a subfield of Artificial Intelligence that focuses on modelling creative behaviours. Typically, research in Computational Creativity has treated language as a medium, e.g., poetry, rather than an active component of the creative process. Previous research studying the role of language in creative design has relied on interviewing human participants, limiting opportunities for computational modelling. This thesis explores the potential for language to play an active role in computational creativity by connecting computational models of the evolution of artificial languages and creative design processes. Multi-agent simulations based on the Domain-Individual-Field-Interaction framework are employed to evolve artificial languages with features that may support creative designing including ambiguity, incongruity, exaggeration and elaboration. The simulation process consists of three steps: (1) constructing representations associating topics, meanings and utterances; (2) structured communication of utterances and meanings through the playing of “language games”; and (3) evaluation of design briefs and works. The use of individual agents with different evaluation criteria, preferences and roles enriches the scope and diversity of the simulations. The results of the experiments conducted with artificial creative language systems demonstrate the expansion of design spaces by generating compositional utterances representing novel concepts among design agents using language features and weighted context free grammars. They can be used to computationally explore the roles of language in creative design, and possibly point to computational applications. Understanding the evolution of artificial languages may provide insights into human languages, especially those features that support creativity

Synchronising the Senses: The Impact of Embodied Cognition on Communication, Explored in the Domain of Colour

Colour terms divide the visual spectrum into categorical concepts. Since Berlin & Kay’s (1969) cross-cultural study of colour terms, there has been debate about the extent to which these concepts are constrained by innate biases from perceptual hardware and the environment. This study shows that concepts can affect perception in the domain of colour (e.g., reading the word ‘yellow’ causes us to see yellow). An experiment was run in which participants were asked to adjust the font colour of colour terms to appear grey. In fact, participants adjusted the font colour to perceptually oppose the colour the word described (e.g., the word ‘yellow’ was adjusted to be blue). This is interpreted as over-compensating for a perceptual activation caused by the comprehension of the word. These results are used to argue that cross-cultural patterns in colour term systems do not necessarily imply strong innate biases. It is argued that the most efficient way of converging on, maintaining and transferring a conceptual system is for shared categories to re-organise perception. This re-organisation will converge to optimally fit the perceptual and environmental biases. Therefore, an Embodied, Relativist explanation of cross-cultural patterns is supported. Furthermore, if the comprehension of language involves the activation of perceptual representations, then there will be a communicative pressure to reduce perceptual differences between speakers

Revisualising Intersectionality

Revisualising Intersectionality offers transdisciplinary interrogations of the supposed visual evidentiality of categories of human similarity and difference. This open-access book incorporates insights from social and cognitive science as well as psychology and philosophy to explain how we visually perceive physical differences and how cognition is fallible, processual, and dependent on who is looking in a specific context. Revisualising Intersectionality also puts into conversation visual culture studies and artistic research with approaches such as gender, queer, and trans studies as well as postcolonial and decolonial theory to complicate simplified notions of identity politics and cultural representation. The book proposes a revision of intersectionality research to challenge the predominance of categories of visible difference such as race and gender as analytical lenses