USER INTERFACE AND USER EXPERIENCE DESIGNING IN THE KAPUSTAKAN SYSTEM USING USER CENTRED DESIGN APPROACH (CASE STUDY: KERATON NGAYOGYAKARTA HADININGRAT)

The Kapustakan System is a digital collection management system for the Keraton Ngayogyakarta Hadiningrat. The Kapustakan System is being developed to present various museum collections in digital representation, facilitating access to knowledge search, cross-referencing, and encouraging research. This system needs an interface design that takes into account both the User Interface (UI) and the User Experience (UX) to make users feel comfortable when they use it. This paper describes the UI/UX design process for the Kapustakan System using the user-centred Design (UCD) method, which consists of five stages: planning the human-centred design, specifying the context of use, specifying user and organizational requirements, producing design solutions, and evaluating designs against user requirements. The UCD method focuses on the direct involvement of prospective users so that they can influence the design results that meet their needs and desires. The result of this research is a prototype design of the Kapustakan System that has been validated through usability testing of potential users. The parameters tested in usability testing are success rate, efficiency, error rate, and satisfaction. The test's success rate is 93.75%, its efficiency is 90.27%, its error rate is 3.73%, and its satisfaction is 86.25

Emotions, behaviour and belief regulation in an intelligent guide with attitude

Abstract unavailable please refer to PD

Developing knowledge for real world problem scenarios : using 3D gaming technology within a problem-based learning framework

Problem-based learning is an instructional strategy that emphasises active and experiential learning through problem-solving activity. Using gaming technologies to embed this approach in a three-dimensional (3D) simulation environment provides users with a dynamic, responsive, visually engaging, and cost effective learning experience. Representing real world problems in 3D simulation environments develops knowledge and skills that are applicable to their resolution. The Simulation, User, and Problem-based Learning (SUPL) Design Framework was developed to inform the design of learning environments which develop problem-solving knowledge for real world application. This framework identifies design factors relative to the user, the problem-solving task, and the 3D simulation environment which facilitate the transfer, development, and application of problem-solving knowledge. To assess the validity of the SUPL Design Framework, the Fires in Underground Mines Evacuation Simulator (FUMES) was developed to train mining personnel in emergency evacuation procedures at the Challenger gold mine in South Australia. Two groups of participants representing experienced and novice personnel were utilised to ascertain the effectiveness of FUMES as a training platform in this regard. Findings demonstrated that FUMES accurately represented emergency evacuation scenarios in the Challenger mine. Participants were able to utilise existing real world knowledge in FUMES to resolve emergency evacuation problem-solving tasks and develop new knowledge. The effectiveness of the SUPL Design Framework was also demonstrated, as was the need to design learning environments to meet the learning needs of users rather than merely as static simulations of real world problems. A series of generalisable design guidelines were also established from these findings which could be applied to design problem-based learning simulations in other training contexts

Impact of Imaging and Distance Perception in VR Immersive Visual Experience

Virtual reality (VR) headsets have evolved to include unprecedented viewing quality. Meanwhile, they have become lightweight, wireless, and low-cost, which has opened to new applications and a much wider audience. VR headsets can now provide users with greater understanding of events and accuracy of observation, making decision-making faster and more effective. However, the spread of immersive technologies has shown a slow take-up, with the adoption of virtual reality limited to a few applications, typically related to entertainment. This reluctance appears to be due to the often-necessary change of operating paradigm and some scepticism towards the "VR advantage". The need therefore arises to evaluate the contribution that a VR system can make to user performance, for example to monitoring and decision-making. This will help system designers understand when immersive technologies can be proposed to replace or complement standard display systems such as a desktop monitor. In parallel to the VR headsets evolution there has been that of 360 cameras, which are now capable to instantly acquire photographs and videos in stereoscopic 3D (S3D) modality, with very high resolutions. 360° images are innately suited to VR headsets, where the captured view can be observed and explored through the natural rotation of the head. Acquired views can even be experienced and navigated from the inside as they are captured. The combination of omnidirectional images and VR headsets has opened to a new way of creating immersive visual representations. We call it: photo-based VR. This represents a new methodology that combines traditional model-based rendering with high-quality omnidirectional texture-mapping. Photo-based VR is particularly suitable for applications related to remote visits and realistic scene reconstruction, useful for monitoring and surveillance systems, control panels and operator training. The presented PhD study investigates the potential of photo-based VR representations. It starts by evaluating the role of immersion and user’s performance in today's graphical visual experience, to then use it as a reference to develop and evaluate new photo-based VR solutions. With the current literature on photo-based VR experience and associated user performance being very limited, this study builds new knowledge from the proposed assessments. We conduct five user studies on a few representative applications examining how visual representations can be affected by system factors (camera and display related) and how it can influence human factors (such as realism, presence, and emotions). Particular attention is paid to realistic depth perception, to support which we develop target solutions for photo-based VR. They are intended to provide users with a correct perception of space dimension and objects size. We call it: true-dimensional visualization. The presented work contributes to unexplored fields including photo-based VR and true-dimensional visualization, offering immersive system designers a thorough comprehension of the benefits, potential, and type of applications in which these new methods can make the difference. This thesis manuscript and its findings have been partly presented in scientific publications. In particular, five conference papers on Springer and the IEEE symposia, [1], [2], [3], [4], [5], and one journal article in an IEEE periodical [6], have been published

Behavioural morphisms in virtual environments

One of the largest application domains for Virtual Reality lies in simulating the Real World. Contemporary applications of virtual environments include training devices for surgery, component assembly and maintenance, all of which require a high fidelity reproduction of psychomotor skills. One extremely important research question in this field is: "How closely does our facsimile of a real task in a virtual environment reproduce that Task?" At present the field of Virtual Reality is answering this question in subjective terms by the concept of presence and in objective terms by measures of task performance or training effectiveness ratios. [Continues.

Involving users in the design process: the role of product representations in co-designing

Allowing users to be part of shaping change in new product development can contribute to more successful products. Advances in recent years in digital product representations (such as CAD and rapid prototyping) can potentially offer economic and time-saving benefits to this process. The research in this thesis has generated guidelines to support co-designing activity by exploring the issues of user involvement in the design process, paying particular attention to the use of digital (computer-based) and non-digital product representations to facilitate understanding and communication. The guidelines emerged through empirical research. The first stage of the research explored users' perceptions of physical and emotional product properties through digital and rapid prototyped representations: initial guidelines for Including product representations in co-designing were generated. An Interview study was then conducted to examine the wider issues of user involvement in designing and the use of digital and non-digital product representations from the standpoint of ten practicing - designers. Challenges and barriers to user Involvement were perceived but designers were open-minded to the Idea of digital co-designing. In parallel an audit was undertaken to evaluate product representation technologies for their ability to facilitate co-designing: traditional non-digital methods of sketching and hand-made models were used to develop criteria for this benchmarking. Limitations were found with existing technology and it was apparent that traditional methods (e. g. hand-drawn sketches and models) were better able to facilitate co-designing at this time than digital methods. These findings led to recommendations for future co-designing tools. Co-designing processes were then explored through six practical studies conducted with individuals and small groups of users. Users experimented with designing and making improved handles for a small gardening tool through sketching and day modelling. Design concepts were then taken further into digital media, through 3D scanning, digital CAD images and rapid prototyping and presented back to users for evaluation. Co-designing was also explored through a commercial context with an international packaging manufacturer. Ten users communicated design ideas for improved packaging by triangulation of notes, sketches, discussion and modelling activity. This produced user-led design criteria and commercially valuable concept designs. Important insights were gained into how codesigning may be facilitated within a commercial context and the experiences of the stakeholders. Several pertinent ethical issues such as ownership of ideas, incentives and rewards for user involvement were raised. The thesis concludes with guidelines and recommendations for co-designing, particularly regarding the role of product representations

Applying User-Centered Design in the Development of a Software Application For the Treatment of a Mental Health Disorder

The research that follows will provide a process for applying a user-centered design methodology to the development of a virtual environment software application for the treatment of a mental health disorder, specifically post traumatic stress disorder (PTSD). The goal is to create a screen-based virtual environment product that focuses on the end user rather than the technological aspects of the system. Moreover, past and present treatments in the mental health and healthcare fields and their effectiveness will be analyzed through an extensive literature review

Coping with the inheritance of COVID-19: the role of new interactive technologies to enhance user experience in different contexts of use

The COVID-19 pandemic has upset the habits of people and various sectors of society, including training, entertainment, and retail. These sectors have been forced to adapt to abnormal situations such as social distancing, remote work, and online entertainment. The pandemic has significantly transformed the training field, leading to the closure of many in-person instruction centers and a shift toward online education courses, which can be less effective. In addition, the entertainment industry has been heavily transformed by social distancing, resulting in the cancellation of many live events and the closure of several cinemas. This has increased demand for online entertainment options, such as streaming services and virtual events. Finally, the restrictions imposed by the COVID-19 pandemic substantially impacted physical stores and fairs, suspending exhibitions for more than two years. This has further driven consumers to rely on e-commerce to fulfill their purchasing and companies to increasingly take advantage of new technologies such as augmented reality. In this suddenly disrupted scenario, new technologies have the potential to fill the gap generated by the pandemic, functioning as an interactive bridge to connect people. This Ph.D. thesis explored the potential of interactive technologies in mitigating the challenges posed by the COVID-19 pandemic in various contexts of use in the above-mentioned areas. Specifically, three lines of research were investigated by conducting different studies using a mixed approach in the Human-Computer Interaction field. The first research line focused on the study of immersive virtual reality training, with a particular interest in flood emergencies, a growing phenomenon. The goal was to implement engaging and efficient training for citizens that live near rivers through a human-centric design approach. The second line of research explored innovative ways to improve social interaction and collaboration in the entertainment sector, highlighting guidelines for the design of shared streaming experiences. In particular, three different communication modalities were studied during group viewing of an interactive film on a streaming platform. Finally, the third research line focused on the retail sector. On the one hand, the focus consisted of understanding which aspects of the 3D web and AR technology are helpful for supporting small businesses and trade fairs. On the other hand, the focus was to investigate how to support consumers during an AR shopping experience when interacting with 3D virtual products of different sizes. Overall, this project provides suggestions and guidelines for designing systems that can both increasingly connect people at a distance and offer new hybrid worlds. In addition, this project expands state-of-the-art related to interactive technologies and offers generalizable results outside the crisis created by COVID-19. These technologies, now increasingly integrated into everyday life, can be a tool for empowerment and resilience, improving people's lives.The COVID-19 pandemic has upset the habits of people and various sectors of society, including training, entertainment, and retail. These sectors have been forced to adapt to abnormal situations such as social distancing, remote work, and online entertainment. The pandemic has significantly transformed the training field, leading to the closure of many in-person instruction centers and a shift toward online education courses, which can be less effective. In addition, the entertainment industry has been heavily transformed by social distancing, resulting in the cancellation of many live events and the closure of several cinemas. This has increased demand for online entertainment options, such as streaming services and virtual events. Finally, the restrictions imposed by the COVID-19 pandemic substantially impacted physical stores and fairs, suspending exhibitions for more than two years. This has further driven consumers to rely on e-commerce to fulfill their purchasing and companies to increasingly take advantage of new technologies such as augmented reality. In this suddenly disrupted scenario, new technologies have the potential to fill the gap generated by the pandemic, functioning as an interactive bridge to connect people. This Ph.D. thesis explored the potential of interactive technologies in mitigating the challenges posed by the COVID-19 pandemic in various contexts of use in the above-mentioned areas. Specifically, three lines of research were investigated by conducting different studies using a mixed approach in the Human-Computer Interaction field. The first research line focused on the study of immersive virtual reality training, with a particular interest in flood emergencies, a growing phenomenon. The goal was to implement engaging and efficient training for citizens that live near rivers through a human-centric design approach. The second line of research explored innovative ways to improve social interaction and collaboration in the entertainment sector, highlighting guidelines for the design of shared streaming experiences. In particular, three different communication modalities were studied during group viewing of an interactive film on a streaming platform. Finally, the third research line focused on the retail sector. On the one hand, the focus consisted of understanding which aspects of the 3D web and AR technology are helpful for supporting small businesses and trade fairs. On the other hand, the focus was to investigate how to support consumers during an AR shopping experience when interacting with 3D virtual products of different sizes. Overall, this project provides suggestions and guidelines for designing systems that can both increasingly connect people at a distance and offer new hybrid worlds. In addition, this project expands state-of-the-art related to interactive technologies and offers generalizable results outside the crisis created by COVID-19. These technologies, now increasingly integrated into everyday life, can be a tool for empowerment and resilience, improving people's lives