The perception of materials through oral sensation

This paper presents the results of a multimodal study of oral perception conducted with a set of material samples made from metals, polymers and woods, in which both the somatosensory and taste factors were examined. A multidimensional scaling analysis coupled with subjective attribute ratings was performed to assess these factors both qualitatively and quantitatively. The perceptual somatosensory factors of warmth, hardness and roughness dominated over the basic taste factors, and roughness was observed to be a less significant sensation compared to touch-only experiments. The perceptual somatosensory ratings were compared directly with physical property data in order to assess the correlation between the perceived properties and measured physical properties. In each case, a strong correlation was observed, suggesting that physical properties may be useful in industrial design for predicting oral perception

Rendering techniques for multimodal data

Many different direct volume rendering methods have been developed to visualize 3D scalar fields on uniform rectilinear grids. However, little work has been done on rendering simultaneously various properties of the same 3D region measured with different registration devices or at different instants of time. The demand for this type of visualization is rapidly increasing in scientific applications such as medicine in which the visual integration of multiple modalities allows a better comprehension of the anatomy and a perception of its relationships with activity. This paper presents different strategies of Direct Multimodal Volume Rendering (DMVR). It is restricted to voxel models with a known 3D rigid alignment transformation. The paper evaluates at which steps of the render-ing pipeline must the data fusion be realized in order to accomplish the desired visual integration and to provide fast re-renders when some fusion parameters are modified. In addition, it analyzes how existing monomodal visualization al-gorithms can be extended to multiple datasets and it compares their efficiency and their computational cost.Postprint (published version

A psychology literature study on modality related issues for multimodal presentation in crisis management

The motivation of this psychology literature study is to obtain modality related guidelines for real-time information presentation in crisis management environment. The crisis management task is usually companied by time urgency, risk, uncertainty, and high information density. Decision makers (crisis managers) might undergo cognitive overload and tend to show biases in their performances. Therefore, the on-going crisis event needs to be presented in a manner that enhances perception, assists diagnosis, and prevents cognitive overload. To this end, this study looked into the modality effects on perception, cognitive load, working memory, learning, and attention. Selected topics include working memory, dual-coding theory, cognitive load theory, multimedia learning, and attention. The findings are several modality usage guidelines which may lead to more efficient use of the user’s cognitive capacity and enhance the information perception

Perceptual Consciousness as a Mental Activity

I argue that perceptual consciousness is constituted by a mental activity. The mental activity in question is the activity of employing perceptual capacities, such as discriminatory, selective capacities. This is a radical view, but I hope to make it plausible. In arguing for this mental activist view, I reject orthodox views on which perceptual consciousness is analyzed in terms of peculiar entities, such as, phenomenal properties, external mind-independent properties, propositions, sense-data, qualia, or intentional objects