Enhanced device-based 3D object manipulation technique for handheld mobile augmented reality

3D object manipulation is one of the most important tasks for handheld mobile Augmented Reality (AR) towards its practical potential, especially for realworld assembly support. In this context, techniques used to manipulate 3D object is an important research area. Therefore, this study developed an improved device based interaction technique within handheld mobile AR interfaces to solve the large range 3D object rotation problem as well as issues related to 3D object position and orientation deviations in manipulating 3D object. The research firstly enhanced the existing device-based 3D object rotation technique with an innovative control structure that utilizes the handheld mobile device tilting and skewing amplitudes to determine the rotation axes and directions of the 3D object. Whenever the device is tilted or skewed exceeding the threshold values of the amplitudes, the 3D object rotation will start continuously with a pre-defined angular speed per second to prevent over-rotation of the handheld mobile device. This over-rotation is a common occurrence when using the existing technique to perform large-range 3D object rotations. The problem of over-rotation of the handheld mobile device needs to be solved since it causes a 3D object registration error and a 3D object display issue where the 3D object does not appear consistent within the user’s range of view. Secondly, restructuring the existing device-based 3D object manipulation technique was done by separating the degrees of freedom (DOF) of the 3D object translation and rotation to prevent the 3D object position and orientation deviations caused by the DOF integration that utilizes the same control structure for both tasks. Next, an improved device-based interaction technique, with better performance on task completion time for 3D object rotation unilaterally and 3D object manipulation comprehensively within handheld mobile AR interfaces was developed. A pilot test was carried out before other main tests to determine several pre-defined values designed in the control structure of the proposed 3D object rotation technique. A series of 3D object rotation and manipulation tasks was designed and developed as separate experimental tasks to benchmark both the proposed 3D object rotation and manipulation techniques with existing ones on task completion time (s). Two different groups of participants aged 19-24 years old were selected for both experiments, with each group consisting sixteen participants. Each participant had to complete twelve trials, which came to a total 192 trials per experiment for all the participants. Repeated measure analysis was used to analyze the data. The results obtained have statistically proven that the developed 3D object rotation technique markedly outpaced existing technique with significant shorter task completion times of 2.04s shorter on easy tasks and 3.09s shorter on hard tasks after comparing the mean times upon all successful trials. On the other hand, for the failed trials, the 3D object rotation technique was 4.99% more accurate on easy tasks and 1.78% more accurate on hard tasks in comparison to the existing technique. Similar results were also extended to 3D object manipulation tasks with an overall 9.529s significant shorter task completion time of the proposed manipulation technique as compared to the existing technique. Based on the findings, an improved device-based interaction technique has been successfully developed to address the insufficient functionalities of the current technique

Haptic feedback in a virtual crowd scenario improves the emotional response

Research has shown that incorporating haptics into virtual environments can increase sensory fidelity and provide powerful and immersive experiences. However, current studies on haptics in virtual interactions primarily focus on one-on-one scenarios, while kinesthetic haptic interactions in large virtual gatherings are underexplored. This study aims to investigate the impact of kinesthetic haptics on eliciting emotional responses within crowded virtual reality (VR) scenarios. Specifically, we examine the influence of type or quality of the haptic feedback on the perception of positive and negative emotions. We designed and developed different combinations of tactile and torque feedback devices and evaluated their effects on emotional responses. To achieve this, we explored different combinations of haptic feedback devices, including “No Haptic,” “Tactile Stimulus” delivering tactile cues, and “Haptic Stimulus” delivering tactile and torque cues, in combination with two immersive 360-degree video crowd scenarios, namely, “Casual Crowd” and “Aggressive Crowd.” The results suggest that varying the type or quality of haptic feedback can evoke different emotional responses in crowded VR scenarios. Participants reported increased levels of nervousness with Haptic Stimulus in both virtual scenarios, while both Tactile Stimulus and Haptic Stimulus were negatively associated with pleasantness and comfort during the interaction. Additionally, we observed that participants’ sense of touch being real was enhanced in Haptic Stimulus compared to Tactile Stimulus. The “Haptic Stimulus” condition had the most positive influence on participants’ sense of identification with the crowd

Skyler and Bliss

Hong Kong remains the backdrop to the science fiction movies of my youth. The city reminds me of my former training in the financial sector. It is a city in which I could have succeeded in finance, but as far as art goes it is a young city, and I am a young artist. A frustration emerges; much like the mould, the artist also had to develop new skills by killing off his former desires and manipulating technology. My new series entitled HONG KONG surface project shows a new direction in my artistic research in which my technique becomes ever simpler, reducing the traces of pixelation until objects appear almost as they were found and photographed. Skyler and Bliss presents tectonic plates based on satellite images of the Arctic. Working in a hot and humid Hong Kong where mushrooms grow ferociously, a city artificially refrigerated by climate control, this series provides a conceptual image of a imaginary typographic map for survival. (Laurent Segretier

Timbre from Sound Synthesis and High-level Control Perspectives

International audienceExploring the many surprising facets of timbre through sound manipulations has been a common practice among composers and instrument makers of all times. The digital era radically changed the approach to sounds thanks to the unlimited possibilities offered by computers that made it possible to investigate sounds without physical constraints. In this chapter we describe investigations on timbre based on the analysis by synthesis approach that consists in using digital synthesis algorithms to reproduce sounds and further modify the parameters of the algorithms to investigate their perceptual relevance. In the first part of the chapter timbre is investigated in a musical context. An examination of the sound quality of different wood species for xylophone making is first presented. Then the influence of instrumental control on timbre is described in the case of clarinet and cello performances. In the second part of the chapter, we mainly focus on the identification of sound morphologies, so called invariant sound structures responsible for the evocations induced by environmental sounds by relating basic signal descriptors and timbre descriptors to evocations in the case of car door noises, motor noises, solid objects, and their interactions

Merging the Real and the Virtual: An Exploration of Interaction Methods to Blend Realities

We investigate, build, and design interaction methods to merge the real with the virtual. An initial investigation looks at spatial augmented reality (SAR) and its effects on pointing with a real mobile phone. A study reveals a set of trade-offs between the raycast, viewport, and direct pointing techniques. To further investigate the manipulation of virtual content within a SAR environment, we design an interaction technique that utilizes the distance that a user holds mobile phone away from their body. Our technique enables pushing virtual content from a mobile phone to an external SAR environment, interact with that content, rotate-scale-translate it, and pull the content back into the mobile phone. This is all done in a way that ensures seamless transitions between the real environment of the mobile phone and the virtual SAR environment. To investigate the issues that occur when the physical environment is hidden by a fully immersive virtual reality (VR) HMD, we design and investigate a system that merges a realtime 3D reconstruction of the real world with a virtual environment. This allows users to freely move, manipulate, observe, and communicate with people and objects situated in their physical reality without losing their sense of immersion or presence inside a virtual world. A study with VR users demonstrates the affordances provided by the system and how it can be used to enhance current VR experiences. We then move to AR, to investigate the limitations of optical see-through HMDs and the problem of communicating the internal state of the virtual world with unaugmented users. To address these issues and enable new ways to visualize, manipulate, and share virtual content, we propose a system that combines a wearable SAR projector. Demonstrations showcase ways to utilize the projected and head-mounted displays together, such as expanding field of view, distributing content across depth surfaces, and enabling bystander collaboration. We then turn to videogames to investigate how spectatorship of these virtual environments can be enhanced through expanded video rendering techniques. We extract and combine additional data to form a cumulative 3D representation of the live game environment for spectators, which enables each spectator to individually control a personal view into the stream while in VR. A study shows that users prefer spectating in VR when compared with a comparable desktop rendering

A Conceptual Framework for Integrating TPB With Context-Relevant Variables to Predict e-Learning Success During the Covid -19 Pandemic

The COVID-19 pandemic has necessitated the digitalization of some aspects of our lives including education. However, as we witness a phenomenal rise in the demand for online learning, the decision to migrate to online learning platforms is dependent on the learner’s preparedness to embrace it. The objective of this study is to conceptualize a framework that measures the tendency of learners to adopt online learning in an era characterised by so many disruptions. To do this, we adopt document analysis on databases such as SCOPUS, Web of Science, EBSCO and Google Scholar using Boolean search engines; AND, OR, NOT, *, (), ‘’’’, +, -, <,>. mainly on current scientific manuscripts through the use of the keywords “e-learning”, “theory of planned behaviour”, “Covid 19”, “distance learning”, “environmental factors” and “academic technology adoption”. Subsequently, we integrate the theory of planned behaviour with other context-relevant variables as the bases of the study, and conceptualise a framework to predict e-learning success in the covid-19 era. This study contributes to the scientific body of knowledge on e-learning, particularly from the perspective of a forced mass adoption of e-learning occasioned by a global pandemic

A Conceptual Framework for Integrating TPB With Context-Relevant Variables to Predict e-Learning Success During the Covid -19 Pandemic

The COVID-19 pandemic has necessitated the digitalization of some aspects of our lives including education. However, as we witness a phenomenal rise in the demand for online learning, the decision to migrate to online learning platforms is dependent on the learner’s preparedness to embrace it. The objective of this study is to conceptualize a framework that measures the tendency of learners to adopt online learning in an era characterised by so many disruptions. To do this, we adopt document analysis on databases such as SCOPUS, Web of Science, EBSCO and Google Scholar using Boolean search engines; AND, OR, NOT, *, (), ‘’’’, +, -, &lt;,&gt;. mainly on current scientific manuscripts through the use of the keywords “e-learning”, “theory of planned behaviour”, “Covid 19”, “distance learning”, “environmental factors” and “academic technology adoption”. Subsequently, we integrate the theory of planned behaviour with other context-relevant variables as the bases of the study, and conceptualise a framework to predict e-learning success in the covid-19 era. This study contributes to the scientific body of knowledge on e-learning, particularly from the perspective of a forced mass adoption of e-learning occasioned by a global pandemic.</p

A Conceptual Framework for Integrating TPB With Context-Relevant Variables to Predict e-Learning Success During the Covid -19 Pandemic

The COVID-19 pandemic has necessitated the digitalization of some aspects of our lives including education. However, as we witness a phenomenal rise in the demand for online learning, the decision to migrate to online learning platforms is dependent on the learner’s preparedness to embrace it. The objective of this study is to conceptualize a framework that measures the tendency of learners to adopt online learning in an era characterised by so many disruptions. To do this, we adopt document analysis on databases such as SCOPUS, Web of Science, EBSCO and Google Scholar using Boolean search engines; AND, OR, NOT, *, (), ‘’’’, +, -, &lt;,&gt;. mainly on current scientific manuscripts through the use of the keywords “e-learning”, “theory of planned behaviour”, “Covid 19”, “distance learning”, “environmental factors” and “academic technology adoption”. Subsequently, we integrate the theory of planned behaviour with other context-relevant variables as the bases of the study, and conceptualise a framework to predict e-learning success in the covid-19 era. This study contributes to the scientific body of knowledge on e-learning, particularly from the perspective of a forced mass adoption of e-learning occasioned by a global pandemic