A cognitive model of user interaction as a guideline for designing novel interfaces

Adaptive systems behavior based on user models appear promising, mostly for complex environments such as mixed reality environments (MRE). An MRE comprises a virtual representation of the reality as well as physical objects augmented with virtual features. These objects are coupled with the virtual representation so that they can reflect its changes in real time. The proper design of an MRE and the user models that it implies are crucial for its success, but unfortunately, there are no guidelines for the design of these environments. In this paper we present a methodology for designing user models for MRE as well as for the augmentation of physical everyday objects. The user model describes users’ knowledge in two levels of abstraction: objects manipulation (syntax) and its meaning assigned by a community of practice (semantics).1st International Workshop on Advanced Software Engineering: Expanding the Frontiers of Software Technology - Session 2: Software ModelingRed de Universidades con Carreras en Informática (RedUNCI

Towards an engineering approach for advanced interaction techniques in 3D environments

National audienceIn recent years, Virtual Environments have appeared in new areas such as mass-market, web or mobile situations. In parallel, advanced forms ofinteractions are emerging such as tactile, mixed, tangible or spatial user interfaces, promoting ease of learning and use. To contribute to the democratization of 3D Virtual Environments(3DVE) and their use by persons who are not experts in 3D and occasional users, simultaneously considering Computer Graphics and Human Computer Interaction design considerations is required. In this position paper, we first provide an overview of a new analytical framework for the design of advanced interaction techniques for 3D Virtual Environment. It consists in identifying links that support the interaction and connect user’s tasks to be performed in a 3DVE with the targeted scene graph. We relate our work to existing modeling approaches and discuss about our expectations with regards to the engineering of advanced interaction techniqu

A novel design education approach for professional global product realization

Emerging trends in design practice, such as collaborative design and multi-national, multi-cultural and multi-disciplinary (multi-x) teamwork, call for ongoing changes in design education. Educational institutions need to be proactive in adapting to such trends, in order to ensure an adequate development of the design competences of their students. The graduated design students must be able to effectively solve real-life new product development (NPD) problems in multi-x environments. In this paper we present a novel approach towards design education, where special focus is put on multi-x collaboration of design students in solving NPD tasks. We present the idea of an Academic Virtual Enterprise (AVE), a project oriented educational agreement, which is based on volatile alliance of industrial and academic partners for mutual advantages. A course, called Global Product Realization (GPR) is presented as an example of how to implement AVE into design education and provide a stimulating learning environment for students in several disciplines (i.e. mechanical engineering, programming, electronics, design, etc.), where they can get experience in multi-x collaboration in NPD and develop several aspects of design competences needed for their future professional practice

Design Creativity: Future Directions for Integrated Visualisation

The Architecture, Engineering and Construction (AEC) sectors are facing unprecedented challenges, not just with increased complexity of projects per se, but design-related integration. This requires stakeholders to radically re-think their existing business models (and thinking that underpins them), but also the technological challenges and skills required to deliver these projects. Whilst opponents will no doubt cite that this is nothing new as the sector as a whole has always had to respond to change; the counter to this is that design ‘creativity’ is now much more dependent on integration from day one. Given this, collaborative processes embedded in Building Information Modelling (BIM) models have been proffered as a panacea solution to embrace this change and deliver streamlined integration. The veracity of design teams’ “project data” is increasingly becoming paramount - not only for the coordination of design, processes, engineering services, fabrication, construction, and maintenance; but more importantly, facilitate ‘true’ project integration and interchange – the actualisation of which will require firm consensus and commitment. This Special Issue envisions some of these issues, challenges and opportunities (from a future landscape perspective), by highlighting a raft of concomitant factors, which include: technological challenges, design visualisation and integration, future digital tools, new and anticipated operating environments, and training requirements needed to deliver these aspirations. A fundamental part of this Special Issue’s ‘call’ was to capture best practice in order to demonstrate how design, visualisation and delivery processes (and technologies) affect the finished product viz: design outcome, design procedures, production methodologies and construction implementation. In this respect, the use of virtual environments are now particularly effective at supporting the design and delivery processes. In summary therefore, this Special Issue presents nine papers from leading scholars, industry and contemporaries. These papers provide an eclectic (but cognate) representation of AEC design visualisation and integration; which not only uncovers new insight and understanding of these challenges and solutions, but also provides new theoretical and practice signposts for future research

Agent Assistance: From Problem Solving to Music Teaching

We report on our research on agents that act and behave in a web learning environment. This research is part of a general approach to agents acting and behaving in virtual environments where they are involved in providing information, performing transactions, demonstrating products and, more generally, assisting users or visitors of the web environment in doing what they want or have been asked to do. While initially we hardly provided our agents with 'teaching knowledge', we now are in the process of making such knowledge explicit, especially in models that take into account that assisting and teaching takes place in a visualized and information-rich environment. Our main (embodied) tutor-agent is called Jacob; it knows about the Towers of Hanoi, a well-known problem that is offered to CS students to learn about recursion. Other agents we are working on assist a visitor in navigating in a virtual world or help the visitor in getting information. We are now designing a music teacher - using knowledge of software engineering and how to design multi-modal interactions, from previous projects