I-Light Symposium 2005 Proceedings

I-Light was made possible by a special appropriation by the State of Indiana. The research described at the I-Light Symposium has been supported by numerous grants from several sources. Any opinions, findings and conclusions, or recommendations expressed in the 2005 I-Light Symposium Proceedings are those of the researchers and authors and do not necessarily reflect the views of the granting agencies.Indiana University Office of the Vice President for Research and Information Technology, Purdue University Office of the Vice President for Information Technology and CI

Collision warning design in automotive head-up displays

Abstract. In the last few years, the automotive industry has experienced a large growth in the hardware and the underlying electronics. The industry benefits from both Human Machine Interface (HMI) research and modern technology. There are many applications of the Advanced Driver Assistant System (ADAS) and their positive impact on drivers is even more. Forward Collision Warning (FCW) is one of many applications of ADAS. In the last decades, different approaches and tools are used to implement FCW systems. Current Augmented Reality (AR) applications are feasible to integrate in modern cars. In this thesis work, we introduce three different FCW designs: static, animated and 3D animated warnings. We test the proposed designs in three different environments: day, night and rain. The designs static and animated achieve a minimum response time 0.486 s whereas the 3D animated warning achieves 1.153 s

Ray Tracing Gems

This book is a must-have for anyone serious about rendering in real time. With the announcement of new ray tracing APIs and hardware to support them, developers can easily create real-time applications with ray tracing as a core component. As ray tracing on the GPU becomes faster, it will play a more central role in real-time rendering. Ray Tracing Gems provides key building blocks for developers of games, architectural applications, visualizations, and more. Experts in rendering share their knowledge by explaining everything from nitty-gritty techniques that will improve any ray tracer to mastery of the new capabilities of current and future hardware. What you'll learn: The latest ray tracing techniques for developing real-time applications in multiple domains Guidance, advice, and best practices for rendering applications with Microsoft DirectX Raytracing (DXR) How to implement high-performance graphics for interactive visualizations, games, simulations, and more Who this book is for: Developers who are looking to leverage the latest APIs and GPU technology for real-time rendering and ray tracing Students looking to learn about best practices in these areas Enthusiasts who want to understand and experiment with their new GPU

The cockpit for the 21st century

Interactive surfaces are a growing trend in many domains. As one possible manifestation of Mark Weiser’s vision of ubiquitous and disappearing computers in everywhere objects, we see touchsensitive screens in many kinds of devices, such as smartphones, tablet computers and interactive tabletops. More advanced concepts of these have been an active research topic for many years. This has also influenced automotive cockpit development: concept cars and recent market releases show integrated touchscreens, growing in size. To meet the increasing information and interaction needs, interactive surfaces offer context-dependent functionality in combination with a direct input paradigm. However, interfaces in the car need to be operable while driving. Distraction, especially visual distraction from the driving task, can lead to critical situations if the sum of attentional demand emerging from both primary and secondary task overextends the available resources. So far, a touchscreen requires a lot of visual attention since its flat surface does not provide any haptic feedback. There have been approaches to make direct touch interaction accessible while driving for simple tasks. Outside the automotive domain, for example in office environments, concepts for sophisticated handling of large displays have already been introduced. Moreover, technological advances lead to new characteristics for interactive surfaces by enabling arbitrary surface shapes. In cars, two main characteristics for upcoming interactive surfaces are largeness and shape. On the one hand, spatial extension is not only increasing through larger displays, but also by taking objects in the surrounding into account for interaction. On the other hand, the flatness inherent in current screens can be overcome by upcoming technologies, and interactive surfaces can therefore provide haptically distinguishable surfaces. This thesis describes the systematic exploration of large and shaped interactive surfaces and analyzes their potential for interaction while driving. Therefore, different prototypes for each characteristic have been developed and evaluated in test settings suitable for their maturity level. Those prototypes were used to obtain subjective user feedback and objective data, to investigate effects on driving and glance behavior as well as usability and user experience. As a contribution, this thesis provides an analysis of the development of interactive surfaces in the car. Two characteristics, largeness and shape, are identified that can improve the interaction compared to conventional touchscreens. The presented studies show that large interactive surfaces can provide new and improved ways of interaction both in driver-only and driver-passenger situations. Furthermore, studies indicate a positive effect on visual distraction when additional static haptic feedback is provided by shaped interactive surfaces. Overall, various, non-exclusively applicable, interaction concepts prove the potential of interactive surfaces for the use in automotive cockpits, which is expected to be beneficial also in further environments where visual attention needs to be focused on additional tasks.Der Einsatz von interaktiven Oberflächen weitet sich mehr und mehr auf die unterschiedlichsten Lebensbereiche aus. Damit sind sie eine mögliche Ausprägung von Mark Weisers Vision der allgegenwärtigen Computer, die aus unserer direkten Wahrnehmung verschwinden. Bei einer Vielzahl von technischen Geräten des täglichen Lebens, wie Smartphones, Tablets oder interaktiven Tischen, sind berührungsempfindliche Oberflächen bereits heute in Benutzung. Schon seit vielen Jahren arbeiten Forscher an einer Weiterentwicklung der Technik, um ihre Vorteile auch in anderen Bereichen, wie beispielsweise der Interaktion zwischen Mensch und Automobil, nutzbar zu machen. Und das mit Erfolg: Interaktive Benutzeroberflächen werden mittlerweile serienmäßig in vielen Fahrzeugen eingesetzt. Der Einbau von immer größeren, in das Cockpit integrierten Touchscreens in Konzeptfahrzeuge zeigt, dass sich diese Entwicklung weiter in vollem Gange befindet. Interaktive Oberflächen ermöglichen das flexible Anzeigen von kontextsensitiven Inhalten und machen eine direkte Interaktion mit den Bildschirminhalten möglich. Auf diese Weise erfüllen sie die sich wandelnden Informations- und Interaktionsbedürfnisse in besonderem Maße. Beim Einsatz von Bedienschnittstellen im Fahrzeug ist die gefahrlose Benutzbarkeit während der Fahrt von besonderer Bedeutung. Insbesondere visuelle Ablenkung von der Fahraufgabe kann zu kritischen Situationen führen, wenn Primär- und Sekundäraufgaben mehr als die insgesamt verfügbare Aufmerksamkeit des Fahrers beanspruchen. Herkömmliche Touchscreens stellen dem Fahrer bisher lediglich eine flache Oberfläche bereit, die keinerlei haptische Rückmeldung bietet, weshalb deren Bedienung besonders viel visuelle Aufmerksamkeit erfordert. Verschiedene Ansätze ermöglichen dem Fahrer, direkte Touchinteraktion für einfache Aufgaben während der Fahrt zu nutzen. Außerhalb der Automobilindustrie, zum Beispiel für Büroarbeitsplätze, wurden bereits verschiedene Konzepte für eine komplexere Bedienung großer Bildschirme vorgestellt. Darüber hinaus führt der technologische Fortschritt zu neuen möglichen Ausprägungen interaktiver Oberflächen und erlaubt, diese beliebig zu formen. Für die nächste Generation von interaktiven Oberflächen im Fahrzeug wird vor allem an der Modifikation der Kategorien Größe und Form gearbeitet. Die Bedienschnittstelle wird nicht nur durch größere Bildschirme erweitert, sondern auch dadurch, dass Objekte wie Dekorleisten in die Interaktion einbezogen werden können. Andererseits heben aktuelle Technologieentwicklungen die Restriktion auf flache Oberflächen auf, so dass Touchscreens künftig ertastbare Strukturen aufweisen können. Diese Dissertation beschreibt die systematische Untersuchung großer und nicht-flacher interaktiver Oberflächen und analysiert ihr Potential für die Interaktion während der Fahrt. Dazu wurden für jede Charakteristik verschiedene Prototypen entwickelt und in Testumgebungen entsprechend ihres Reifegrads evaluiert. Auf diese Weise konnten subjektives Nutzerfeedback und objektive Daten erhoben, und die Effekte auf Fahr- und Blickverhalten sowie Nutzbarkeit untersucht werden. Diese Dissertation leistet den Beitrag einer Analyse der Entwicklung von interaktiven Oberflächen im Automobilbereich. Weiterhin werden die Aspekte Größe und Form untersucht, um mit ihrer Hilfe die Interaktion im Vergleich zu herkömmlichen Touchscreens zu verbessern. Die durchgeführten Studien belegen, dass große Flächen neue und verbesserte Bedienmöglichkeiten bieten können. Außerdem zeigt sich ein positiver Effekt auf die visuelle Ablenkung, wenn zusätzliches statisches, haptisches Feedback durch nicht-flache Oberflächen bereitgestellt wird. Zusammenfassend zeigen verschiedene, untereinander kombinierbare Interaktionskonzepte das Potential interaktiver Oberflächen für den automotiven Einsatz. Zudem können die Ergebnisse auch in anderen Bereichen Anwendung finden, in denen visuelle Aufmerksamkeit für andere Aufgaben benötigt wird

Scalable and Extensible Augmented Reality with Applications in Civil Infrastructure Systems.

In Civil Infrastructure System (CIS) applications, the requirement of blending synthetic and physical objects distinguishes Augmented Reality (AR) from other visualization technologies in three aspects: 1) it reinforces the connections between people and objects, and promotes engineers’ appreciation about their working context; 2) It allows engineers to perform field tasks with the awareness of both the physical and synthetic environment; 3) It offsets the significant cost of 3D Model Engineering by including the real world background. The research has successfully overcome several long-standing technical obstacles in AR and investigated technical approaches to address fundamental challenges that prevent the technology from being usefully deployed in CIS applications, such as the alignment of virtual objects with the real environment continuously across time and space; blending of virtual entities with their real background faithfully to create a sustained illusion of co- existence; integrating these methods to a scalable and extensible computing AR framework that is openly accessible to the teaching and research community, and can be readily reused and extended by other researchers and engineers. The research findings have been evaluated in several challenging CIS applications where the potential of having a significant economic and social impact is high. Examples of validation test beds implemented include an AR visual excavator-utility collision avoidance system that enables spotters to ”see” buried utilities hidden under the ground surface, thus helping prevent accidental utility strikes; an AR post-disaster reconnaissance framework that enables building inspectors to rapidly evaluate and quantify structural damage sustained by buildings in seismic events such as earthquakes or blasts; and a tabletop collaborative AR visualization framework that allows multiple users to observe and interact with visual simulations of engineering processes.PHDCivil EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/96145/1/dsuyang_1.pd

Architectures for ubiquitous 3D on heterogeneous computing platforms

Today, a wide scope for 3D graphics applications exists, including domains such as scientific visualization, 3D-enabled web pages, and entertainment. At the same time, the devices and platforms that run and display the applications are more heterogeneous than ever. Display environments range from mobile devices to desktop systems and ultimately to distributed displays that facilitate collaborative interaction. While the capability of the client devices may vary considerably, the visualization experiences running on them should be consistent. The field of application should dictate how and on what devices users access the application, not the technical requirements to realize the 3D output. The goal of this thesis is to examine the diverse challenges involved in providing consistent and scalable visualization experiences to heterogeneous computing platforms and display setups. While we could not address the myriad of possible use cases, we developed a comprehensive set of rendering architectures in the major domains of scientific and medical visualization, web-based 3D applications, and movie virtual production. To provide the required service quality, performance, and scalability for different client devices and displays, our architectures focus on the efficient utilization and combination of the available client, server, and network resources. We present innovative solutions that incorporate methods for hybrid and distributed rendering as well as means to manage data sets and stream rendering results. We establish the browser as a promising platform for accessible and portable visualization services. We collaborated with experts from the medical field and the movie industry to evaluate the usability of our technology in real-world scenarios. The presented architectures achieve a wide coverage of display and rendering setups and at the same time share major components and concepts. Thus, they build a strong foundation for a unified system that supports a variety of use cases.Heutzutage existiert ein großer Anwendungsbereich für 3D-Grafikapplikationen wie wissenschaftliche Visualisierungen, 3D-Inhalte in Webseiten, und Unterhaltungssoftware. Gleichzeitig sind die Geräte und Plattformen, welche die Anwendungen ausführen und anzeigen, heterogener als je zuvor. Anzeigegeräte reichen von mobilen Geräten zu Desktop-Systemen bis hin zu verteilten Bildschirmumgebungen, die eine kollaborative Anwendung begünstigen. Während die Leistungsfähigkeit der Geräte stark schwanken kann, sollten die dort laufenden Visualisierungen konsistent sein. Das Anwendungsfeld sollte bestimmen, wie und auf welchem Gerät Benutzer auf die Anwendung zugreifen, nicht die technischen Voraussetzungen zur Erzeugung der 3D-Grafik. Das Ziel dieser Thesis ist es, die diversen Herausforderungen zu untersuchen, die bei der Bereitstellung von konsistenten und skalierbaren Visualisierungsanwendungen auf heterogenen Plattformen eine Rolle spielen. Während wir nicht die Vielzahl an möglichen Anwendungsfällen abdecken konnten, haben wir eine repräsentative Auswahl an Rendering-Architekturen in den Kernbereichen wissenschaftliche Visualisierung, web-basierte 3D-Anwendungen, und virtuelle Filmproduktion entwickelt. Um die geforderte Qualität, Leistung, und Skalierbarkeit für verschiedene Client-Geräte und -Anzeigen zu gewährleisten, fokussieren sich unsere Architekturen auf die effiziente Nutzung und Kombination der verfügbaren Client-, Server-, und Netzwerkressourcen. Wir präsentieren innovative Lösungen, die hybrides und verteiltes Rendering als auch das Verwalten der Datensätze und Streaming der 3D-Ausgabe umfassen. Wir etablieren den Web-Browser als vielversprechende Plattform für zugängliche und portierbare Visualisierungsdienste. Um die Verwendbarkeit unserer Technologie in realitätsnahen Szenarien zu testen, haben wir mit Experten aus der Medizin und Filmindustrie zusammengearbeitet. Unsere Architekturen erreichen eine umfassende Abdeckung von Anzeige- und Rendering-Szenarien und teilen sich gleichzeitig wesentliche Komponenten und Konzepte. Sie bilden daher eine starke Grundlage für ein einheitliches System, das eine Vielzahl an Anwendungsfällen unterstützt

Simulation-Based Countermeasures Towards Accident Prevention : Virtual Reality Utilization in Industrial Processes and Activities

Despite growing industrial interests in fully immersive virtual reality (VR) applications for safety countermeasures, there is scanty research on the subject in the context of accident prevention during manufacturing processes and plant maintenance activities. This dissertation aims to explore and experiment with VR for accident prevention by targeting three workplace safety countermeasures: fire evacuation drills, hazard identification and risk assessments (HIRA), and emergency preparedness and response (EPR) procedures. Drawing on the virtual reality accident causation model (VR-ACM) (i.e., 3D modelling and simulation, accident causation, and safety drills) and the fire evacuation training model, two industrial 3D simulation models were utilized for the immersive assessment and training. These were a lithium-ion battery (LIB) manufacturing factory and a gas power plant (GPP). In total, five studies (publications) were designed to demonstrate the potential of VR in accident prevention during the manufacturing processes and maintenance activities at the facility conceptual stages. Two studies were with the LIB factory simulation to identify inherent hazards and assess risks for redesigning the factory to ensure workplace safety compliance. The other three studies constituted fire hazard identifications, emergency evacuations and hazard control/mitigations during the maintenance activity in the GPP simulation. Both study models incorporated several participants individually immersed in the virtual realm to experience the accident phenomena intuitively. These participants provided feedback for assessing the research objectives. Results of the studies indicated that several inherent hazards in the LIB factory were identified and controlled/mitigated. Secondly, the GPP experiment results suggested that although the maintenance activity in the virtual realm increased the perception of presence, a statistically significant delay was recorded at the pre-movement stage due to the lack of situational safety awareness. Overall, the study demonstrates that participants immersed in a VR plant maintenance activity and manufacturing factory process simulation environments can experience real-time emergency scenarios and conditions necessary for implementing the essential safety countermeasures to prevent accidents.Vaikka kiinnostus virtuaalitodellisuuden (VR) käyttöön turvallisuuden varotoimissa teollisuudessa on kasvanut, tutkimuksia ei ole juurikaan tehty onnettomuuksien ehkäisystä valmistus- ja kunnossapitotoiminnassa. Tämän väitöskirjan tavoitteena on tutkia ja kokeilla VR:ää tapaturmien ehkäisyssä kohdistuen kolmeen työpaikan turvallisuuden varotoimeen: paloharjoitukset, riskien arvioinnit sekä hätätilanteiden valmiusmenettelyt ja toimintasuunnitelmat (EPR). Kokemuksellisessa ja uppouttavassa koulutuksessa hyödynnettiin kahta teollisuuden 3D-simulointimallia, jotka nojautuvat virtuaalitodellisuuden onnettomuuksien aiheutumismalliin (VR-ACM) (eli 3D-mallinnus- ja simulointi, onnettomuussyy- ja turvallisuuskoulutus) sekä paloharjoitusmalliin. Nämä 3D-simulointimallit ovat litiuminoniakkuja (LIB) valmistava tehdas, joka rakennettiin Visual Components 3D-simulointiohjelmistolla (versio 4.0) ja kaasuvoimala (GPP) Unrealin reaaliaikaisella pelimoottorilla (versio 4.2). Yhteensä viisi tutkimusta (julkaisua) suunniteltiin havainnollistamaan VR:n potentiaalia tapaturmien ehkäisyssä valmistusprosessin layout-suunnittelun ja tehtaan konseptivaiheissa tehtävän kunnossapidon aikana. Kaksi tutkimusta tehtiin LIB-tehdassimulaatiolla vaarojen tunnistamiseksi sekä riskien arvioimiseksi. Tutkimukset tehtiin tehtaan uudelleensuunnittelua varten, työturvallisuuden noudattamisen varmistamiseksi. Muut kolme tutkimusta käsittelevät palovaaran tunnistamista, hätäevakuointia ja riskien vähentämistä huoltotoiminnan aikana GPP-simulaatiossa. Molemmissa tutkimusmalleissa oli useita virtuaalimaailmaan uppoutuneita osallistujia, jotka saivat kokea onnettomuudet yksilöllisesti ja intuitiivisesti. Osallistujat antoivat palautetta kokeen jälkeisessä kyselyssä. Kyselyn tuloksien avulla LIB-tehtaassa tunnistettiin ja lievennettiin useita vaaroja. GPP-kokeilun tulokset viittasivat siihen, että vaikka ylläpitotoiminta virtuaalimaailmassa lisäsi teleläsnäoloa, tilastollisesti merkittävä viive kirjattiin liikettä edeltävässä vaiheessa turvallisuustietoisuuden puuteen vuoksi. Kaiken kaikkiaan tutkimus osoittaa, että VR-laitoksen kunnossapitotoimintaan ja tuotantotehtaan prosessisimulaatioympäristöihin uppoutuvat osallistujat voivat kokea reaaliaikaisia hätäskenaarioita ja olosuhteita, jotka ovat välttämättömiä olennaisten turvallisuustoimien toteuttamiseksi.fi=vertaisarvioitu|en=peerReviewed

Android Based Chatbot and Mobile Application for Tour and Travel Company

Mobile Applications are rapidly growing segment of global mobile market. This paper involves an application for the android base operating system for a travel agent which will conduct booking transactions for train tickets, airline tickets, hotel, theme park, and tour. This application is integrated with a chatbot, an instant messaging applications. Chatbot is a computer program that can communicate with users. The purpose of chatbot is to support and scale business teams in their relations with customers. This chatbot can be placed in Facebook Messenger, telegram and own website, so it gives the potential to reach a bigger audience. Customers do not need to install new applications. The customer just simply adds chatbot as a friend and starts transacting with a conversation, without needing to understand the intended user interface in an application. By using chatbot, the company can also shorten sales transactions. Company can also broadcast information directly to customers easily. In this paper, we first discuss about chatbot and mobile application system design. Finally we will discuss about the system implementation

Quais as potencialidades da criação de um videoclip em Realidade Virtual?

The focus of this dissertation is in the potentiality of the creation of a music video in Virtual Reality (VR). As such, it was analyzed in the theoretical framework what are music videos, what is VR and, more specifically, what are music videos in VR, which is a unresearched topic in the academic field, to which this dissertation provides some basis for feature research in this area. A music video for VR was made for this dissertation as to better understand the potentialities of the medium. The music video was made under the conventional phases of audiovisual production. Then user tests were made for this music video in order to evaluate its characteristics. The tests were made with 3 independent samples because the music video was shown in desktop 360-2D, mobile-360-2D, and VR on a Head Mounted Display (HMD). This was done as to better understand the potentialities of VR by comparing it to other mediums. Each participant had to answer to a pre-test questionnaire, and to a post-test questionnaire. The analysis of the results showed that although VR offers the added benefit of immersion it also poses its own challenges and a completely new approach to music video making.O foco desta dissertação é na potencialidade de criação de videoclips em Realidade Virtual. Como tal, foi analisado no enquadramento teórico o que são videoclips, o que é a Realidade Virtual e, mais especificamente, o que são videoclips em Realidade Virtual, tópico sobre o qual não existe muita investigação no meio académico, de maneira a que esta dissertação serve como base para investigações futuras. Um videoclip foi feito para Realidade Virtual para a investigação da qual esta dissertação faz parte, a fim de perceber as potencialidades do meio. O videoclip foi criado com base nas fases convencionais de produção audiovisual. Feito isto foram feitos testes de utilizador para avaliar as características do videoclip. Estes testes foram feitos em 3 amostras independentes cada uma para um formato diferente de visualização de videoclips em Realidade Virtual, desktop-360-2D, mobile-360-2D e em Realidade Virtual com um Head Mounted Display. Isto foi feito de modo a perceber melhor as potencialidades da Realidade Virtual comparativamente com os outros meios. Cada participante teve de responder a um questionário pré-teste e a um questionário pós-teste. A análise dos resultados mostrou que apesar da Realidade Virtual oferecer o benefício da imersão, ela tem os seus desafios, e requere uma abordagem completamente nova para a realização de videoclips.Mestrado em Comunicação Multimédi

Towards Predictive Rendering in Virtual Reality

The strive for generating predictive images, i.e., images representing radiometrically correct renditions of reality, has been a longstanding problem in computer graphics. The exactness of such images is extremely important for Virtual Reality applications like Virtual Prototyping, where users need to make decisions impacting large investments based on the simulated images. Unfortunately, generation of predictive imagery is still an unsolved problem due to manifold reasons, especially if real-time restrictions apply. First, existing scenes used for rendering are not modeled accurately enough to create predictive images. Second, even with huge computational efforts existing rendering algorithms are not able to produce radiometrically correct images. Third, current display devices need to convert rendered images into some low-dimensional color space, which prohibits display of radiometrically correct images. Overcoming these limitations is the focus of current state-of-the-art research. This thesis also contributes to this task. First, it briefly introduces the necessary background and identifies the steps required for real-time predictive image generation. Then, existing techniques targeting these steps are presented and their limitations are pointed out. To solve some of the remaining problems, novel techniques are proposed. They cover various steps in the predictive image generation process, ranging from accurate scene modeling over efficient data representation to high-quality, real-time rendering. A special focus of this thesis lays on real-time generation of predictive images using bidirectional texture functions (BTFs), i.e., very accurate representations for spatially varying surface materials. The techniques proposed by this thesis enable efficient handling of BTFs by compressing the huge amount of data contained in this material representation, applying them to geometric surfaces using texture and BTF synthesis techniques, and rendering BTF covered objects in real-time. Further approaches proposed in this thesis target inclusion of real-time global illumination effects or more efficient rendering using novel level-of-detail representations for geometric objects. Finally, this thesis assesses the rendering quality achievable with BTF materials, indicating a significant increase in realism but also confirming the remainder of problems to be solved to achieve truly predictive image generation