Semiotic Analysis of Computer Visualization

The purpose of this chapter is to discuss the semiotic approach to form theory of computer visualization. Such theory should be the foundation of design, development, and evaluations of visualization systems. The “direct” semiotic analysis of visualization is defined and the scheme of the analysis is considered. This analysis reveals “who is who” in the process of the visualization semiosis and helps in design and development of the real visualization systems. The analysis allows to describe the problems arising at developments of specialized systems in terms of the semiotics and showing how this analysis can serve as a tool for the visualization systems design. It is important to analyze the sign nature of the human‐computer interface and the visualization. Such conceptions as computer metaphor, metaphor action, and metaphor formula are defined. The properties of metaphors are analyzed with a view to possible usage of metaphors for specific applications. The properties are considered by the example of the hierarchical sequence of the natural Room‐Building‐City (Landscape) metaphors. Also the properties of the molecule metaphor are considered in the context of software visualization systems. In conclusion, some approaches to the theory of computer visualization are outlined

Directional adposition use in English, Swedish and Finnish

Directional adpositions such as to the left of describe where a Figure is in relation to a Ground. English and Swedish directional adpositions refer to the location of a Figure in relation to a Ground, whether both are static or in motion. In contrast, the Finnish directional adpositions edellä (in front of) and jäljessä (behind) solely describe the location of a moving Figure in relation to a moving Ground (Nikanne, 2003). When using directional adpositions, a frame of reference must be assumed for interpreting the meaning of directional adpositions. For example, the meaning of to the left of in English can be based on a relative (speaker or listener based) reference frame or an intrinsic (object based) reference frame (Levinson, 1996). When a Figure and a Ground are both in motion, it is possible for a Figure to be described as being behind or in front of the Ground, even if neither have intrinsic features. As shown by Walker (in preparation), there are good reasons to assume that in the latter case a motion based reference frame is involved. This means that if Finnish speakers would use edellä (in front of) and jäljessä (behind) more frequently in situations where both the Figure and Ground are in motion, a difference in reference frame use between Finnish on one hand and English and Swedish on the other could be expected. We asked native English, Swedish and Finnish speakers’ to select adpositions from a language specific list to describe the location of a Figure relative to a Ground when both were shown to be moving on a computer screen. We were interested in any differences between Finnish, English and Swedish speakers. All languages showed a predominant use of directional spatial adpositions referring to the lexical concepts TO THE LEFT OF, TO THE RIGHT OF, ABOVE and BELOW. There were no differences between the languages in directional adpositions use or reference frame use, including reference frame use based on motion. We conclude that despite differences in the grammars of the languages involved, and potential differences in reference frame system use, the three languages investigated encode Figure location in relation to Ground location in a similar way when both are in motion. Levinson, S. C. (1996). Frames of reference and Molyneux’s question: Crosslingiuistic evidence. In P. Bloom, M.A. Peterson, L. Nadel & M.F. Garrett (Eds.) Language and Space (pp.109-170). Massachusetts: MIT Press. Nikanne, U. (2003). How Finnish postpositions see the axis system. In E. van der Zee & J. Slack (Eds.), Representing direction in language and space. Oxford, UK: Oxford University Press. Walker, C. (in preparation). Motion encoding in language, the use of spatial locatives in a motion context. Unpublished doctoral dissertation, University of Lincoln, Lincoln. United Kingdo

A semantics-based approach to sensor data segmentation in real-time Activity Recognition

Department of Information Engineering, Dalian University, China The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.Activity Recognition (AR) is key in context-aware assistive living systems. One challenge in AR is the segmentation of observed sensor events when interleaved or concurrent activities of daily living (ADLs) are performed. Several studies have proposed methods of separating and organising sensor observations and recognise generic ADLs performed in a simple or composite manner. However, little has been explored in semantically distinguishing individual sensor events directly and passing it to the relevant ongoing/new atomic activities. This paper proposes Semiotic theory inspired ontological model, capturing generic knowledge and inhabitant-specific preferences for conducting ADLs to support the segmentation process. A multithreaded decision algorithm and system prototype were developed and evaluated against 30 use case scenarios where each event was simulated at 10sec interval on a machine with i7 2.60GHz CPU, 2 cores and 8GB RAM. The result suggests that all sensor events were adequately segmented with 100% accuracy for single ADL scenarios and minor improvement of 97.8% accuracy for composite ADL scenario. However, the performance has suffered to segment each event with the average classification time of 3971ms and 62183ms for single and composite ADL scenarios, respectively

Mind and Matter

Do brains create material reality in thinking processes or is it the other way around, with things shaping the mind? Where is the location of meaning-making? How do neural networks become established by means of multimodal pattern replications, and how are they involved in conceptualization? How are resonance textures within cellular entities extended in the body and the mind by means of mirroring processes? In which ways do they correlate to consciousness and self-consciousness? Is it possible to explain out-of-awareness unconscious processes? What holds together the relationship between experiential reality, bodily processes like memory, reason, or imagination, and sign-systems and simulation structures like metaphor and metonymy visible in human language? This volume attempts to answer some of these questions

What is the contribution of personal information management systems (PIMS) to the Working Model and personal work system of knowledge workers?

The thesis reports research into a phenomenon which it calls the personal working model of an individual knowledge worker. The principal conjecture addressed in this thesis is that each of us has a personal working model which is supported by a personal work system enabled by a personal information management system. For some people, these are well defined; for most they are not even explicit. By means of structured self-reflection aided by conceptual knowledge modelling within the context of a process of action learning they can be improved. That personal working model is predicted by Ashby's law of requisite variety and by the good regulator theorem of Conant and Ashby. The latter theorem states that the only good regulator of a system is a model of that system. The thesis and the work it reports result from a systemic approach to identifying the personal information management system and personal work system which together contribute to the personal working model. Starting with abductive conjecture, the author has sought to understand what models are and to explore ways in which those models can themselves be expressed. The thesis shows how a new approach to the conceptual modelling of aspects of the personal knowledge of knowledge worker was designed, built and then used. Similarly, the actual data used by a knowledge worker had to be stored, and for this purpose a personal information management system was also designed. Both these artefacts are evaluated in accordance with principles drawn from the literature of design science research. The research methodology adopted in the first phase of the research now ending also included a relatively novel approach in which the PhD student attempted to observe himself over the last five years of his PhD research – this approach is sometimes called autoethnography. This autoethnographic element is one of a number of methods used within an overall framework grounded by the philosophical approach called critical realism. The work reported in the thesis is initial exploratory research which, it is planned, will continue in empirical action research involving mentored action learning undertaken by professional knowledge workers