A Formal Approach to Computer Aided 2D Graphical Design for Blind People

The growth of computer aided drawing systems for blind people (CADB) has long been recognised and has increased in interest within the assistive technology research area. The representation of pictorial data by blind and visually impaired (BVI) people has recently gathered momentum with research and development; however, a survey of published literature on CADB reveals that only marginal research has been focused on the use of a formal approach for on screen spatial orientation, creation and reuse of graphics artefacts. To realise the full potential of CADB, such systems should possess attributes of usability, spatial navigation and shape creation features without which blind users drawing activities are less likely to be achieved. As a result of this, usable, effective and self-reliant CADB have arisen from new assistive Technology (AT) research. This thesis contributes a novel, abstract, formal approach that facilitates BVI users to navigate on the screen, create computer graphics/diagrams using 2D shapes and user-defined images. Moreover, the research addresses the specific issues involved with user language by formulating specific rules that make BVI user interaction with the drawing effective and easier. The formal approach proposed here is descriptive and it is specified at a level of abstraction above the concrete level of system technologies. The proposed approach is unique in problem modelling and syntheses of an abstract computer-based graphics/drawings using a formal set of user interaction commands. This technology has been applied to enable blind users to independently construct drawings to satisfy their specific needs without recourse to a specific technology and without the intervention of support workers. The specification aims to be the foundation for a system scope, investigation guidelines and user-initiated command-driven interaction. Such an approach will allow system designers and developers to proceed with greater conceptual clarity than it is possible with current technologies that is built on concrete system-driven prototypes. In addition to the scope of the research the proposed model has been verified by various types of blind users who have independently constructed drawings to satisfy their specific needs without the intervention of support workers. The effectiveness and usability of the proposed approach has been compared against conventional non-command driven drawing systems by different types of blind users. The results confirm that the abstract formal approach proposed here using command-driven means in the context of CADB enables greater comprehension by BVI users. The innovation can be used for both educational and training purposes. The research, thereby sustaining the claim that the abstract formal approach taken allows for the greater comprehension of the command-driven means in the context of CADB, and how the specification aid the design of such a system

Human Factors in Automated and Robotic Space Systems: Proceedings of a symposium. Part 1

Human factors research likely to produce results applicable to the development of a NASA space station is discussed. The particular sessions covered in Part 1 include: (1) system productivity -- people and machines; (2) expert systems and their use; (3) language and displays for human-computer communication; and (4) computer aided monitoring and decision making. Papers from each subject area are reproduced and the discussions from each area are summarized

Empirical modelling as a new paradigm for educational technology

Educational technology has yet to deliver the benefits or successes that were expected in educational practice, especially in relation to issues other than the communication and delivery of teaching materials. Evidence suggests that these difficulties stem from the mismatch between formalised virtual learning environments and everyday sensemaking and between the rich potential for enhanced learning afforded by new technology and the constraints of old-style educational practice. In addressing this mismatch, some commentators suggest that the primary need is for a new culture of educational practice-and even that such a culture is already emerging, and others identify the need for a new paradigm for educational technology. The aim of this thesis is to explore the potential for a new paradigm for educational technology based on the principles and tools of Empirical Modelling (see http://dcs.warwick.ac.uk/modelling). The thesis builds upon previous research on Empirical Modelling as a constructionist approach to learning, and in particular Roe's doctoral thesis 'Computers for learning: an Empirical Modelling perspective'. Roe's treatment of Empirical Modelling can be viewed as generalising the use of spreadsheets for learning through applying 'programming by dependency' within the framework of existing educational practice. In contrast, this thesis is concerned at a more fundamental level with the contribution that Empirical Modelling can make to technology enhanced learning that may lead to new educational practices. In particular, it identifies eight significant characteristics of learning that are well-matched to Empirical Modelling activity, and associates these with experimental, flexible and meaningful strands in learning. The credentials of Empirical Modelling as a potential new foundation for educational technology are enhanced by demonstrating that Empirical Modelling is radically different from traditional software development and use. It provides a methodology for modelling with dependency that is more closely related to the use of spreadsheets for learning. The thesis elaborates on the relationship between Empirical Modelling and learning in a variety of different contexts, ways and applications. Three examples drawn from computer science higher education are explored to emphasise the experimental, flexible and meaningful characteristics of Empirical Modelling. This discussion of Empirical Modelling in a specific educational context is complemented by an investigation of its relevance to learning in a wider context, with reference to a broad range of subjects, to specific issues in language learning, and to the topics of lifelong learning and collaborative learning. Although the application of Empirical Modelling for learning is as yet too immature for large scale empirical studies, its potential is evaluated using informal empirical evidence arising from Empirical Modelling practice at Warwick. The sources for this evaluation are well-established teaching activities relating to Empirical Modelling in Computer Science at the University of 'Warwick, comprising an introductory module and a number of final year undergraduate projects. The thesis concludes by considering the extent to which Empirical Modelling can go beyond the support for constructionism envisaged by Roe, to address the broader agenda of supporting constructivist learning using computers. To this end, a close relationship between Empirical Modelling and a vision of constructivism recently set out by Bruno Latour in his paper 'The Promises of Constructivism' is demonstrated

Applying blended conceptual spaces to variable choice and aesthetics in data visualisation

Computational creativity is an active area of research within the artificial intelligence domain that investigates what aspects of computing can be considered as an analogue to the human creative process. Computers can be programmed to emulate the type of things that the human mind can. Artificial creativity is worthy of study for two reasons. Firstly, it can help in understanding human creativity and secondly it can help with the design of computer programs that appear to be creative. Although the implementation of creativity in computer algorithms is an active field, much of the research fails to specify which of the known theories of creativity it is aligning with. The combination of computational creativity with computer generated visualisations has the potential to produce visualisations that are context sensitive with respect to the data and could solve some of the current automation problems that computers experience. In addition theories of creativity could theoretically compute unusual data combinations, or introducing graphical elements that draw attention to the patterns in the data. More could be learned about the creativity involved as humans go about the task of generating a visualisation. The purpose of this dissertation was to develop a computer program that can automate the generation of a visualisation, for a suitably chosen visualisation type over a small domain of knowledge, using a subset of the computational creativity criteria, in order to try and explore the effects of the introduction of conceptual blending techniques. The problem is that existing computer programs that generate visualisations are lacking the creativity, intuition, background information, and visual perception that enable a human to decide what aspects of the visualisation will expose patterns that are useful to the consumer of the visualisation. The main research question that guided this dissertation was, “How can criteria derived from theories of creativity be used in the generation of visualisations?”. In order to answer this question an analysis was done to determine which creativity theories and artificial intelligence techniques could potentially be used to implement the theories in the context of those relevant to computer generated visualisations. Measurable attributes and criteria that were sufficient for an algorithm that claims to model creativity were explored. The parts of the visualisation pipeline were identified and the aspects of visualisation generation that humans are better at than computers was explored. Themes that emerged in both the computational creativity and the visualisation literature were highlighted. Finally a prototype was built that started to investigate the use of computational creativity methods in the ‘variable choice’, and ‘aesthetics’ stages of the data visualisation pipeline.School of ComputingM. Sc. (Computing

Human-Computer Interaction

In this book the reader will find a collection of 31 papers presenting different facets of Human Computer Interaction, the result of research projects and experiments as well as new approaches to design user interfaces. The book is organized according to the following main topics in a sequential order: new interaction paradigms, multimodality, usability studies on several interaction mechanisms, human factors, universal design and development methodologies and tools

User Interface Abstraction for enabling TV set based Inclusive Access to the Information Society

199 p.The television (TV) set is present in most homes worldwide, and is the most used Information and Communication Technology (ICT). Despite its large implantation in the market, the interactive services consumption on TV set is limited. This thesis focuses on overcoming the following limiting factors: (i) limited Human Computer Interaction and (ii) lack of considering user’s real life context in the digital television (dTV) service integration strategy. Making interactive services accessible to TV set’s large user base, and especially to the most vulnerable ones, is understood as the path to integrate the mankind with the information society. This thesis explores the use of user interface abstraction technologies to reach the introduced goals. The main contributions of this thesis are: (i) an approach to enable the universally accessible remote control of the TV set, (ii) an approach for the provision of universally accessible interactive services through TV sets, and (iii) an approach for the provision of universally accessible services in the TV user’s real life context. We have implemented the contributing approaches for different use cases, and we have evaluated them with real users, achieving good results

Cognitive work analysis: Extensions and applications in command and control

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.'Complex sociotechnical systems' are systems made up of numerous interacting parts, both human and non-human, operating in dynamic, ambiguous and safety critical domains. The system design, and representation, has significant implications for the usability of the system, its performance, errors and reliability. Due to its formative constraint-based approach, Cognitive Work Analysis (CWA) has been frequently proposed as a framework for modelling these complex systems, further it is contended that the approach can be extended to design for interaction without significant deviation from the accepted framework. This thesis presents a number of applications in complex military domains to explore and develop the benefits of CWA. Unlike much of the previous literature, particular attention is placed on exploring the CWA framework in its entirety. This holistic approach focuses on the system environment, the activity that takes place within it, the strategies used to conduct this activity, the way in which the constituent parts of the system (both human and non-human) interact and the behaviour required. Each stage of this analysis identifies the constraints governing the system; it is contended that through this holistic understanding of constraints, recommendations can be made for the design of system interaction; increasing the ability of users to cope with unanticipated, unexpected situations. This thesis discusses the applicability of the approach in system analysis, development and evaluation. It provides process to what was previously a loosely defined framework.This work is part-funded by the Human Sciences Domain of the UK Ministry of Defence Scientific Research Programme

트리 구조를 이용한 3차원 공간 내 데이터 시각화 연구

학위논문 (박사)-- 서울대학교 대학원 : 미술대학 디자인학부 디자인전공, 2019. 2. 김수정.Speculative visualization combines both data visualization methods and aesthetics to draw attention to specific social, political and environmental issues. The speculative data visualization project proposed in this work explores electronic waste trade and the environmental performance of various nations. Illegal trading of electronic waste without proper disposal and recycling measures has a severe impact on both human health and the environment. This trade can be represented as a network data structure. The overall environmental health and ecosystem vitality of those trading countries, represented by their Environmental Performance Index (EPI), can also give greater insight into this issue. This EPI data has a hierarchical structure. This work explores methods to visualize these two data sets simultaneously in a manner that allows for analytical exploration of the data while communicating its underlying meaning. This project-based design research specifically focuses on visualizing hierarchical datasets with a node-link type tree structure and suggests a novel data visualization method, called the data garden, to visualize these hierarchical datasets within a spatial network. This draws inspiration from networks found between trees in nature. This is applied to the illegal e-waste trade and environmental datasets to provoke discussion, provide a holistic understanding and improve the peoples awareness on these issues. This uses both analytical data visualization techniques, along with a more aesthetic approach. The data garden approach is used to create a 3D interactive data visualization that users can use to navigate and explore the data in a meaningful way while also providing an emotional connection to the subject. This is due to the ability of the data garden approach to accurately show the underlying data while also closely mimicking natural structures. The visualization project intends to encourage creative professionals to create both visually appealing and thought-provoking data visualizations on significant issues that can reach a mass audience and improve awareness of citizens. Additionally, this design research intends to cause further discussion on the role of aesthetics and creative practices in data visualizations.사변적 시각화(speculative visualization)는 데이터 시각화 방법과 미학을 결합하여 특정한 사회, 정치 및 환경 문제에 관심을 유도하는 것입니다. 제안한 사변적 데이터 시각화 프로젝트를 통해 다양한 국가의 전자 폐기물 거래와 환경 성과를 살펴봅니다. 적절한 처리와 재활용 조치가 이뤄지지 않은 전자폐기물의 불법 거래는 환경과 인간에 심각한 영향을 미칩니다. 이 거래는 네트워크 데이터 구조로 표현할 수 있습니다. 환경성과지수(EPI)를 통해 이 거래에 참여하는 국가들의 전반적인 환경 보건과 생태계 활력을 살펴보는 것은 이 문제에 더 깊은 통찰력을 제공할 수 있습니다. 이 환경성과지수는 계층 구조로 되어 있습니다. 이 연구는 데이터를 분석적으로 탐구할 수 있도록 하는 방법을 통해 두 가지 데이터를 동시에 시각화하고, 이를 통해 표면에 드러나지 않는 데이터의 의미를 전달하는 방법을 탐구합니다. 본 연구는 프로젝트를 기반으로 하는 디자인 연구로, 노드 링크 유형 트리 구조를 통해 계층적 데이터를 시각화하는 것에 중점을 두고 있습니다. 자연에서 발견할 수 있는 나무 간 네트워크에서 영감을 얻어 공간 네트워크에서 계층적 데이터 세트를 시각화합니다. 데이터 정원이라고 하는 이 새로운 데이터 시각화 방법을 불법 전자 폐기물 거래와 환경 데이터에 적용하여 토론을 유발하고 전체적인 이해를 제공하며 이러한 문제에 대한 사람들의 인식을 개선하고자 합니다. 이는 보다 미적인 접근과 분석적 데이터 시각화 기술을 모두 사용합니다. 데이터 정원을 통한 접근으로 삼차원 대화형 데이터 시각화를 만들 수 있습니다. 이 시각화를 통해 사용자는 데이터를 의미 있는 방식으로 살펴보는 동시에 주제와 감성적인 연결을 받을 수 있습니다. 이는 데이터 정원 방법이 데이터를 정확하게 보여주는 동시에 자연 구조를 면밀하게 모방하기 때문입니다. 본 시각화 프로젝트는 창의적인 전문가들이 중요한 문제에 대해 시각적으로 매력적이고 생각을 자극하는 데이터 시각화를 만들어 대중에게 도달하고 시민들의 인식을 향상할 수 있도록 권장합니다. 또한, 본 디자인 연구는 데이터 시각화에서 미학과 창조적인 실천의 역할에 대한 더 많은 논의를 유도하고자 합니다.Abstract I Table of Contents III List of Figures VI 1. Introduction 1 1.1 Research Background 2 1.2 Research Goal and Method 6 1.3 Terminology 9 2. Hierarchical Relationships: Trees 14 2.1 The History of Tree Diagrams 16 2.1.1 Significance of Trees 16 2.1.2 Aristotles Hierarchical Order of Life 19 2.1.3 Early Religious Depictions of Hierarchical Structures 22 2.1.4 Depicting Evolution 26 2.2 Tree Structures 29 2.3 Tree Layouts 31 3. Complex Relationships: Networks 34 3.1 Attributes of Networks 36 3.1.1 Interdependence and Interconnectedness 38 3.1.2 Decentralization 42 3.1.3 Nonlinearity 45 3.1.4 Multiplicity 46 3.2 Spatial Networks 46 3.3 Combining Tree Structures and Networks 48 4. Design Study Goals and Criteria 51 4.1 Objectives of the Design Study 71 4.2 Data Visualization Approaches 54 4.3 Criteria of Data Visualization 57 4.3.1 Aesthetics 58 4.3.2 Information Visualization Principles 62 4.3.2.1 Visual Cues in Data Visualization 62 4.3.2.2 Gestalt Principles 65 4.3.2.3 Increasing Efficiency of Network Visualizations 67 4.4 Case Study 70 5. Design Study: Data Garden Method 78 5.1 Concept of the Data Garden Structure 79 5.2 Data Garden Tree Structure 84 5.2.1 360°Vertical Branches 85 5.2.2 Break Point of the Branches 87 5.2.3 Aligning Hierarchy Levels 89 5.2.3.1 Design 01 – Extend Method 90 5.2.3.2 Design 02 – Collapse Method 91 5.2.4 Node Placement Technique 92 5.3 Conveying 3D Information 95 6. Design Study: Visualization Project 98 6.1 Theme 99 6.1.1 E-waste Trade 100 6.1.2 Environmental Performance Index 102 6.2 Visual Design Concept 104 6.3 Assigning Attributes 105 6.4 Visual Design Process 107 6.4.1 Leaf (Node) Design Process 107 6.4.1.1 Leaf Inspiration 107 6.4.1.2 Leaf Design 108 6.4.1.3 Leaf Area Calculation and Alignment 113 6.4.2 Stem (Branch) Design Process 116 6.4.3 Root (Link) Design Process 117 6.5 Interaction Design 118 6.5.1 Navigation 118 6.5.2 User Interface 119 6.5.3 Free and Detail Modes 120 6.5.4 Data Details 121 6.6 Visualization Renders 122 6.7 Exhibition 129 7. Conclusion 131 7.1 Conclusion 132 7.2 Limitations and Further Research 133 Bibliography 135 국문초록 (Abstract in Korean) 144Docto

Mobile Learning using Mixed Reality Games and a Conversational, Instructional and Motivational Paradigm. Design and implementation of technical language learning mobile games for the developing world with special attention to mixed reality games for the realization of a conversational, instructional and motivational paradigm.

Mobile learning has significant potential to be very influential in further and higher education. In this research a new definition for Mobile Educational Mixed Reality Games (MEMRG) is proposed based on a mobile learning environment. A questionnaire and a quantifying scale are utilised to assist the game developers in designing a MEMRG. A ¿Conversational Framework¿ is proposed as an appropriate psycho-pedagogical approach to teaching and learning for MEMRG. This methodology is based on the theme of a ¿conversation¿ between different actors of the learning community with the objective of building the architectural framework for MEMRG. Various elements responsible for instructing and motivating learners in educational games are utilised in an instructional-motivational model. User interface design for the games incorporates an efficient navigation system that uses contextual information, and allows the players to move seamlessly between real and virtual worlds. The implementation of MEMRG using the Java 2 Micro Edition (J2ME) platform iii is presented. The hardware and software specification for the MEMRG implementation and deployment are also discussed. MEMRG has produced improvements in the different cognitive processes of the learner, and also produced a deeper level of learning through enculturation, externalising ideas, and socialising. Learners¿ enjoyment, involvement, motivation, autonomy and metacognition skills have improved. This research will assist developers and teachers to gain an insight into learning paradigms which utilise mobile game environments that are formed by mixing real and virtual spaces, and provide them with a vision for effectively incorporating these games into formal and informal classroom sessions