Knowledge Discovery in Smart City Digital Twins

Despite the abundance of available urban data and the potential for reaching enhanced capabilities in the decision-making and management of city infrastructure, current data-driven approaches to knowledge discovery from city data often lack the capacity for collective data exploitation. Loosely defined data interpretation components, or disciplinary isolated interpretations of specific datasets make it easy to overlook necessary domain expertise, often resulting in speculative decision-making. Smart City Digital Twins are designed to overcome this barrier by integrating a more holistic analytics and visualization approach into the real-time knowledge discovery process from heterogeneous city data. Here, we present a spatiotemporal knowledge discovery framework for the collective exploitation of city data in smart city digital twins that incorporates both social and sensor data, and enables insights from human cognition. This is an initial step towards leveraging heterogeneous city data for digital twin-based decision-making

Augmented Reality and Its Application

Augmented Reality (AR) is a discipline that includes the interactive experience of a real-world environment, in which real-world objects and elements are enhanced using computer perceptual information. It has many potential applications in education, medicine, and engineering, among other fields. This book explores these potential uses, presenting case studies and investigations of AR for vocational training, emergency response, interior design, architecture, and much more

Mulsemedia Communication Research Challenges for Metaverse in 6G Wireless Systems

Although humans have five basic senses, sight, hearing, touch, smell, and taste, most multimedia systems in current systems only capture two of them, namely, sight and hearing. With the development of the metaverse and related technologies, there is a growing need for a more immersive media format that leverages all human senses. Multisensory media(Mulsemedia) that can stimulate multiple senses will play a critical role in the near future. This paper provides an overview of the history, background, use cases, existing research, devices, and standards of mulsemedia. Emerging mulsemedia technologies such as Extended Reality (XR) and Holographic-Type Communication (HTC) are introduced. Additionally, the challenges in mulsemedia research from the perspective of wireless communication and networking are discussed. The potential of 6G wireless systems to address these challenges is highlighted, and several research directions that can advance mulsemedia communications are identified

AR Shapes: Making Contextual Learning Fun via Augmented Reality Book

to teach children basic geometry based contextual environment. Nowadays, the attention span of children are reducing thus affect the learning process. It is difficult to maintain their focus during learning. With the interactive element and some animation implemented in the AR shapes, the learning process becomes more fun and interesting. Contextual environment learning allows children to relate the subject with their environment. Thus, increase the children understanding. The application will be developed for 3-7 years old children by using the augmented reality technology based on the contextual environment to basic geometry. By using the Rapid Application Development (RAD) methodology, the application will be developed to ensure it meets the objectives of the project. Exploring further into the project, analysis, planning, design, testing and implementation are going to be carried out to support the progress of this project. As a result, an android application that is able to support the learning of basic shapes through AR book based on contextual environment is built. An informal pilot study was conducted to 5 children to observe user perception towards AR Shapes. The results indicate the children reacted positively towards the books. Besides, when doing the exercise that relate with their environment, they are able to relate the subject with the object surrounding. When testing their understanding by asking them to draw the shapes, the result shows the positive progress of the learning shapes process. These results suggest the potential of AR Shapes book as a medium for learning shapes based contextual environment

The impact of virtual, augmented and mixed reality technologies on the customer experience

The arrival of Virtual-Reality, Augmented-Reality, and Mixed-Reality technologies is shaping a new environment where physical and virtual objects are integrated at different levels. Due to the development of portable and embodied devices, together with highly interactive, physical-virtual connections, the customer experience landscape is evolving into new types of hybrid experiences. However, the boundaries between these new realities, technologies and experiences have not yet been clearly established by researchers and practitioners. This paper aims to offer a better understanding of these concepts and integrate technological (embodiment), psychological (presence), and behavioral (interactivity) perspectives to propose a new taxonomy of technologies, namely the “EPI Cube”. The cube allows academics and managers to classify all technologies, current and potential, which might support or empower customer experiences, but can also produce new experiences along the customer journey. The paper concludes with theoretical and managerial implications, as well as a future research agenda

The Effect of Marker-less Augmented Reality on Task and Learning Performance

Augmented Reality (AR) technologies have evolved rapidly over the last years, particularly with regard to user interfaces, input devices, and cameras used in mobile devices for object and gesture recognition. While early AR systems relied on pre-defined trigger images or QR code markers, modern AR applications leverage machine learning techniques to identify objects in their physical environments. So far, only few empirical studies have investigated AR\u27s potential for supporting learning and task assistance using such marker-less AR. In order to address this research gap, we implemented an AR application (app)with the aim to analyze the effectiveness of marker-less AR applied in a mundane setting which can be used for on-the-job training and more formal educational settings. The results of our laboratory experiment show that while participants working with AR needed significantly more time to fulfill the given task, the participants who were supported by AR learned significantly more

An Operating System for Augmented Reality Ubiquitous Computing Environments

Ph.DDOCTOR OF PHILOSOPH

Technological disruptions in services: lessons from tourism and hospitality

Purpose: Technological disruptions such as the Internet of Things and autonomous devices, enhanced analytical capabilities (artificial intelligence) and rich media (virtual and augmented reality) are creating smart environments that are transforming industry structures, processes and practices. The purpose of this paper is to explore critical technological advancements using a value co-creation lens to provide insights into service innovations that impact ecosystems. The paper provides examples from tourism and hospitality industries as an information dependent service management context. Design/methodology/approach: The research synthesizes prevailing theories of co-creation, service ecosystems, networks and technology disruption with emerging technological developments. Findings: Findings highlight the need for research into service innovations in the tourism and hospitality sector at both macro-market and micro-firm levels, emanating from the rapid and radical nature of technological advancements. Specifically, the paper identifies three areas of likely future disruption in service experiences that may benefit from immediate attention: extra-sensory experiences, hyper-personalized experiences and beyond-automation experiences. Research limitations/implications: Tourism and hospitality services prevail under varying levels of infrastructure, organization and cultural constraints. This paper provides an overview of potential disruptions and developments and does not delve into individual destination types and settings. This will require future work that conceptualizes and examines how stakeholders may adapt within specific contexts. Social implications: Technological disruptions impact all facets of life. A comprehensive picture of developments here provides policymakers with nuanced perspectives to better prepare for impending change. Originality/value: Guest experiences in tourism and hospitality by definition take place in hostile environments that are outside the safety and familiarity of one’s own surroundings. The emergence of smart environments will redefine how customers navigate their experiences. At a conceptual level, this requires a complete rethink of how stakeholders should leverage technologies, engage and reengineer services to remain competitive. The paper illustrates how technology disrupts industry structures and stimulates value co-creation at the micro and macro-societal level

Towards Everyday Virtual Reality through Eye Tracking

Durch Entwicklungen in den Bereichen Computergrafik, Hardwaretechnologie, Perception Engineering und Mensch-Computer Interaktion, werden Virtual Reality und virtuelle Umgebungen immer mehr in unser tägliches Leben integriert. Head-Mounted Displays werden jedoch im Vergleich zu anderen mobilen Geräten, wie Smartphones und Smartwatches, noch nicht so häufig genutzt. Mit zunehmender Nutzung dieser Technologie und der Gewöhnung von Menschen an virtuelle Anwendungsszenarien ist es wahrscheinlich, dass in naher Zukunft ein alltägliches Virtual-Reality-Paradigma realisiert wird. Im Hinblick auf die Kombination von alltäglicher Virtual Reality und Head-Mounted-Displays, ist Eye Tracking eine neue Technologie, die es ermöglicht, menschliches Verhalten in Echtzeit und nicht-intrusiv zu messen. Bevor diese Technologien in großem Umfang im Alltag eingesetzt werden können, müssen jedoch noch zahlreiche Aspekte genauer erforscht werden. Zunächst sollten Aufmerksamkeits- und Kognitionsmodelle in Alltagsszenarien genau verstanden werden. Des Weiteren sind Maßnahmen zur Wahrung der Privatsphäre notwendig, da die Augen mit visuellen biometrischen Indikatoren assoziiert sind. Zuletzt sollten anstelle von Studien oder Anwendungen, die sich auf eine begrenzte Anzahl menschlicher Teilnehmer mit relativ homogenen Merkmalen stützen, Protokolle und Anwendungsfälle für eine bessere Zugänglichkeit dieser Technologie von wesentlicher Bedeutung sein. In dieser Arbeit wurde unter Berücksichtigung der oben genannten Punkte ein bedeutender wissenschaftlicher Vorstoß mit drei zentralen Forschungsbeiträgen in Richtung alltäglicher Virtual Reality unternommen. Menschliche visuelle Aufmerksamkeit und Kognition innerhalb von Virtual Reality wurden in zwei unterschiedlichen Bereichen, Bildung und Autofahren, erforscht. Die Forschung im Bildungsbereich konzentrierte sich auf die Auswirkungen verschiedener Manipulationen im Klassenraum auf das menschliche Sehverhalten, während die Forschung im Bereich des Autofahrens auf sicherheitsrelevante Fragen und Blickführung abzielte. Die Nutzerstudien in beiden Bereichen zeigen, dass Blickbewegungen signifikante Implikationen für diese alltäglichen Situationen haben. Der zweite wesentliche Beitrag fokussiert sich auf Privatsphäre bewahrendes Eye Tracking für Blickbewegungsdaten von Head-Mounted Displays. Dies beinhaltet Differential Privacy, welche zeitliche Korrelationen von Blickbewegungssignalen berücksichtigt und Privatsphäre wahrende Blickschätzung durch Verwendung eines auf randomisiertem Encoding basierenden Frameworks, welches Augenreferenzunkte verwendet. Die Ergebnisse beider Arbeiten zeigen, dass die Wahrung der Privatsphäre möglich ist und gleichzeitig der Nutzen in einem akzeptablen Bereich bleibt. Wenngleich es bisher nur wenig Forschung zu diesem Aspekt von Eye Tracking gibt, ist weitere Forschung notwendig, um den alltäglichen Gebrauch von Virtual Reality zu ermöglichen. Als letzter signifikanter Beitrag, wurde ein Blockchain- und Smart Contract-basiertes Protokoll zur Eye Tracking Datenerhebung für Virtual Reality vorgeschlagen, um Virtual Reality besser zugänglich zu machen. Die Ergebnisse liefern wertvolle Erkenntnisse für alltägliche Nutzung von Virtual Reality und treiben den aktuellen Stand der Forschung in mehrere Richtungen voran.With developments in computer graphics, hardware technology, perception engineering, and human-computer interaction, virtual reality and virtual environments are becoming more integrated into our daily lives. Head-mounted displays, however, are still not used as frequently as other mobile devices such as smart phones and watches. With increased usage of this technology and the acclimation of humans to virtual application scenarios, it is possible that in the near future an everyday virtual reality paradigm will be realized. When considering the marriage of everyday virtual reality and head-mounted displays, eye tracking is an emerging technology that helps to assess human behaviors in a real time and non-intrusive way. Still, multiple aspects need to be researched before these technologies become widely available in daily life. Firstly, attention and cognition models in everyday scenarios should be thoroughly understood. Secondly, as eyes are related to visual biometrics, privacy preserving methodologies are necessary. Lastly, instead of studies or applications utilizing limited human participants with relatively homogeneous characteristics, protocols and use-cases for making such technology more accessible should be essential. In this work, taking the aforementioned points into account, a significant scientific push towards everyday virtual reality has been completed with three main research contributions. Human visual attention and cognition have been researched in virtual reality in two different domains, including education and driving. Research in the education domain has focused on the effects of different classroom manipulations on human visual behaviors, whereas research in the driving domain has targeted safety related issues and gaze-guidance. The user studies in both domains show that eye movements offer significant implications for these everyday setups. The second substantial contribution focuses on privacy preserving eye tracking for the eye movement data that is gathered from head-mounted displays. This includes differential privacy, taking temporal correlations of eye movement signals into account, and privacy preserving gaze estimation task by utilizing a randomized encoding-based framework that uses eye landmarks. The results of both works have indicated that privacy considerations are possible by keeping utility in a reasonable range. Even though few works have focused on this aspect of eye tracking until now, more research is necessary to support everyday virtual reality. As a final significant contribution, a blockchain- and smart contract-based eye tracking data collection protocol for virtual reality is proposed to make virtual reality more accessible. The findings present valuable insights for everyday virtual reality and advance the state-of-the-art in several directions

A Wearable communications device

The purpose of this thesis is to develop a concept for a wearable communications device. Proposed for the market of ten years into the future, this device will integrate today\u27s multiple communications devices and be capable of wireless global communications