Interaktion mit Medienfassaden : Design und Implementierung interaktiver Systeme für große urbane Displays

Media facades are a prominent example of the digital augmentation of urban spaces. They denote the concept of turning the surface of a building into a large-scale urban screen. Due to their enormous size, they require interaction at a distance and they have a high level of visibility. Additionally, they are situated in a highly dynamic urban environment with rapidly changing conditions, which results in settings that are neither comparable, nor reproducible. Altogether, this makes the development of interactive media facade installations a challenging task. This thesis investigates the design of interactive installations for media facades holistically. A theoretical analysis of the design space for interactive installations for media facades is conducted to derive taxonomies to put media facade installations into context. Along with this, a set of observations and guidelines is provided to derive properties of the interaction from the technical characteristics of an interactive media facade installation. This thesis further provides three novel interaction techniques addressing the form factor and resolution of the facade, without the need for additionally instrumenting the space around the facades. The thesis contributes to the design of interactive media facade installations by providing a generalized media facade toolkit for rapid prototyping and simulating interactive media facade installations, independent of the media facade’s size, form factor, technology and underlying hardware.Die wachsende Zahl an Medienfassenden ist ein eindrucksvolles Beispiel für die digitale Erweiterung des öffentlichen Raums. Medienfassaden beschreiben die Möglichkeit, die Oberfläche eines Gebäudes in ein digitales Display zu wandeln. Ihre Größe erfordert Interaktion aus einer gewissen Distanz und führt zu einer großen Sichtbarkeit der dargestellten Inhalte. Medienfassaden-Installationen sind bedingt durch ihre dynamische Umgebung nur schwerlich vergleich- und reproduzierbar. All dies macht die Entwicklung von Installationen für Medienfassaden zu einer großen Herausforderung. Diese Arbeit beschäftigt sich mit der Entwicklung interaktiver Installationen für Medienfassaden. Es wird eine theoretische Analyse des Design-Spaces interaktiver Medienfassaden-Installationen durchgeführt und es werden Taxonomien entwickelt, die Medienfassaden-Installationen in Bezug zueinander setzen. In diesem Zusammenhang werden ausgehend von den technischen Charakteristika Eigenschaften der Interaktion erarbeitet. Zur Interaktion mit Medienfassaden werden drei neue Interaktionstechniken vorgestellt, die Form und Auflösung der Fassade berücksichtigen, ohne notwendigerweise die Umgebung der Fassade zu instrumentieren. Die Ergebnisse dieser Arbeit verbessern darüber hinaus die Entwicklung von Installationen für Medienfassaden, indem ein einheitliches Medienfassaden-Toolkit zum Rapid-Prototyping und zur Simulation interaktiver Installationen vorgestellt wird, das unabhängig von Größe und Form der Medienfassade sowie unabhängig von der verwendeten Technologie und der zugrunde liegenden Hardware ist

The Applications of Additive Manufacturing Technologies in Cyber-Enabled Manufacturing Systems

The application of networked sensors and control in various areas, such as smart grids and infrastructures, has become a recent trend, called cyber-physical systems. The Cyber Enabled Manufacturing (CEM) environment is to apply these technologies in manufacturing systems to handle a significantly greater magnitude of manufacturing data. Additive manufacturing techniques print or place material layer by layer to form a part, thus have a great potential to help accelerate CEM process by printing or embedding sensors and actuators in the proper locations. This paper summarizes the roles of additive manufacturing technologies to help establish a CEM environment.Mechanical Engineerin

Schizophrenic molecules and materials with multiple personalities - how materials science could revolutionise how we do chemical sensing

Molecular photoswitches like spiropyrans derivatives offer exciting possibilities for the development of analytical platforms incorporating photo-responsive materials for functions such as light-activated guest uptake and release and optical reporting on status (passive form, free active form, guest bound to active form). In particular, these switchable materials hold tremendous promise for microflow-systems, in view of the fact that their behaviour can be controlled and interrogated remotely using light from LEDs, without the need for direct physical contact. We demonstrate the immobilisation of these materials on microbeads which can be incorporated into a microflow system to facilitate photoswitchable guest uptake and release. We also introduce novel hybrid materials based on spiropyrans derivatives grafted onto a polymer backbone which, in the presence of an ionic liquid, produces a gel-like material capable of significant photoactuation behaviour. We demonstrate how this material can be incorporated into microfluidic platforms to produce valve-like structures capable of controlling liquid movement using light

Spherical tangible user interfaces in mixed reality

The popularity of virtual reality (VR) and augmented reality (AR) has grown rapidly in recent years, both in academia and commercial applications. This is rooted in technological advances and affordable head-mounted displays (HMDs). Whether in games or professional applications, HMDs allow for immersive audio-visual experiences that transport users to compelling digital worlds or convincingly augment the real world. However, as true to life as these experiences have become in a visual and auditory sense, the question remains how we can model interaction with these virtual environments in an equally natural way. Solutions providing intuitive tangible interaction would bear the potential to fundamentally make the mixed reality (MR) spectrum more accessible, especially for novice users. Research on tangible user interfaces (TUIs) has pursued this goal by coupling virtual to real-world objects. Tangible interaction has been shown to provide significant advantages for numerous use cases. Spherical tangible user interfaces (STUIs) present a special case of these devices, mainly due to their ability to fully embody any spherical virtual content. In general, spherical devices increasingly transition from mere technology demonstrators to usable multi-modal interfaces. For this dissertation, we explore the application of STUIs in MR environments primarily by comparing them to state-of-the-art input techniques in four different contexts. Thus, investigating the questions of embodiment, overall user performance, and the ability of STUIs relying on their shape alone to support complex interaction techniques. First, we examine how spherical devices can embody immersive visualizations. In an initial study, we test the practicality of a tracked sphere embodying three kinds of visualizations. We examine simulated multi-touch interaction on a spherical surface and compare two different sphere sizes to VR controllers. Results confirmed our prototype's viability and indicate improved pattern recognition and advantages for the smaller sphere. Second, to further substantiate VR as a prototyping technology, we demonstrate how a large tangible spherical display can be simulated in VR. We show how VR can fundamentally extend the capabilities of real spherical displays by adding physical rotation to a simulated multi-touch surface. After a first study evaluating the general viability of simulating such a display in VR, our second study revealed the superiority of a rotating spherical display. Third, we present a concept for a spherical input device for tangible AR (TAR). We show how such a device can provide basic object manipulation capabilities utilizing two different modes and compare it to controller techniques with increasing hardware complexity. Our results show that our button-less sphere-based technique is only outperformed by a mode-less controller variant that uses physical buttons and a touchpad. Fourth, to study the intrinsic problem of VR locomotion, we explore two opposing approaches: a continuous and a discrete technique. For the first, we demonstrate a spherical locomotion device supporting two different locomotion paradigms that propel a user's first-person avatar accordingly. We found that a position control paradigm applied to a sphere performed mostly superior in comparison to button-supported controller interaction. For discrete locomotion, we evaluate the concept of a spherical world in miniature (SWIM) used for avatar teleportation in a large virtual environment. Results showed that users subjectively preferred the sphere-based technique over regular controllers and on average, achieved lower task times and higher accuracy. To conclude the thesis, we discuss our findings, insights, and subsequent contribution to our central research questions to derive recommendations for designing techniques based on spherical input devices and an outlook on the future development of spherical devices in the mixed reality spectrum.Die Popularität von Virtual Reality (VR) und Augmented Reality (AR) hat in den letzten Jahren rasant zugenommen, sowohl im akademischen Bereich als auch bei kommerziellen Anwendungen. Dies ist in erster Linie auf technologische Fortschritte und erschwingliche Head-Mounted Displays (HMDs) zurückzuführen. Ob in Spielen oder professionellen Anwendungen, HMDs ermöglichen immersive audiovisuelle Erfahrungen, die uns in fesselnde digitale Welten versetzen oder die reale Welt überzeugend erweitern. Doch so lebensecht diese Erfahrungen in visueller und auditiver Hinsicht geworden sind, so bleibt doch die Frage, wie die Interaktion mit diesen virtuellen Umgebungen auf ebenso natürliche Weise gestaltet werden kann. Lösungen, die eine intuitive, greifbare Interaktion ermöglichen, hätten das Potenzial, das Spektrum der Mixed Reality (MR) fundamental zugänglicher zu machen, insbesondere für Unerfahrene. Die Forschung an Tangible User Interfaces (TUIs) hat dieses Ziel durch das Koppeln virtueller und realer Objekte verfolgt und so hat sich gezeigt, dass greifbare Interaktion für zahlreiche Anwendungsfälle signifikante Vorteile bietet. Spherical Tangible User Interfaces (STUIs) stellen einen Spezialfall von greifbaren Interfaces dar, insbesondere aufgrund ihrer Fähigkeit, beliebige sphärische virtuelle Inhalte vollständig verkörpern zu können. Generell entwickeln sich sphärische Geräte zunehmend von reinen Technologiedemonstratoren zu nutzbaren multimodalen Instrumenten, die auf eine breite Palette von Interaktionstechniken zurückgreifen können. Diese Dissertation untersucht primär die Anwendung von STUIs in MR-Umgebungen durch einen Vergleich mit State-of-the-Art-Eingabetechniken in vier verschiedenen Kontexten. Dies ermöglicht die Erforschung der Bedeutung der Verkörperung virtueller Objekte, der Benutzerleistung im Allgemeinen und der Fähigkeit von STUIs, die sich lediglich auf ihre Form verlassen, komplexe Interaktionstechniken zu unterstützen. Zunächst erforschen wir, wie sphärische Geräte immersive Visualisierungen verkörpern können. Eine erste Studie ergründet die Praxistauglichkeit einer einfach konstruierten, getrackten Kugel, die drei Arten von Visualisierungen verkörpert. Wir testen simulierte Multi-Touch-Interaktion auf einer sphärischen Oberfläche und vergleichen zwei Kugelgrößen mit VR-Controllern. Die Ergebnisse bestätigten die Praxistauglichkeit des Prototyps und deuten auf verbesserte Mustererkennung sowie Vorteile für die kleinere Kugel hin. Zweitens, um die Validität von VR als Prototyping-Technologie zu bekräftigen, demonstrieren wir, wie ein großes, anfassbares sphärisches Display in VR simuliert werden kann. Es zeigt sich, wie VR die Möglichkeiten realer sphärischer Displays substantiell erweitern kann, indem eine simulierte Multi-Touch-Oberfläche um die Fähigkeit der physischen Rotation ergänzt wird. Nach einer ersten Studie, die die generelle Machbarkeit der Simulation eines solchen Displays in VR evaluiert, zeigte eine zweite Studie die Überlegenheit des drehbaren sphärischen Displays. Drittens präsentiert diese Arbeit ein Konzept für ein sphärisches Eingabegerät für Tangible AR (TAR). Wir zeigen, wie ein solches Werkzeug grundlegende Fähigkeiten zur Objektmanipulation unter Verwendung von zwei verschiedenen Modi bereitstellen kann und vergleichen es mit Eingabetechniken deren Hardwarekomplexität zunehmend steigt. Unsere Ergebnisse zeigen, dass die kugelbasierte Technik, die ohne Knöpfe auskommt, nur von einer Controller-Variante übertroffen wird, die physische Knöpfe und ein Touchpad verwendet und somit nicht auf unterschiedliche Modi angewiesen ist. Viertens, um das intrinsische Problem der Fortbewegung in VR zu erforschen, untersuchen wir zwei gegensätzliche Ansätze: eine kontinuierliche und eine diskrete Technik. Für die erste präsentieren wir ein sphärisches Eingabegerät zur Fortbewegung, das zwei verschiedene Paradigmen unterstützt, die einen First-Person-Avatar entsprechend bewegen. Es zeigte sich, dass das Paradigma der direkten Positionssteuerung, angewandt auf einen Kugel-Controller, im Vergleich zu regulärer Controller-Interaktion, die zusätzlich auf physische Knöpfe zurückgreifen kann, meist besser abschneidet. Im Bereich der diskreten Fortbewegung evaluieren wir das Konzept einer kugelförmingen Miniaturwelt (Spherical World in Miniature, SWIM), die für die Avatar-Teleportation in einer großen virtuellen Umgebung verwendet werden kann. Die Ergebnisse zeigten eine subjektive Bevorzugung der kugelbasierten Technik im Vergleich zu regulären Controllern und im Durchschnitt eine schnellere Lösung der Aufgaben sowie eine höhere Genauigkeit. Zum Abschluss der Arbeit diskutieren wir unsere Ergebnisse, Erkenntnisse und die daraus resultierenden Beiträge zu unseren zentralen Forschungsfragen, um daraus Empfehlungen für die Gestaltung von Techniken auf Basis kugelförmiger Eingabegeräte und einen Ausblick auf die mögliche zukünftige Entwicklung sphärischer Eingabegräte im Mixed-Reality-Bereich abzuleiten

AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures

AirConstellations supports a unique semi-fixed style of cross-device interactions via multiple self-spatially-aware armatures to which users can easily attach (or detach) tablets and other devices. In particular, AirConstellations affords highly flexible and dynamic device formations where the users can bring multiple devices together in-air - with 2-5 armatures poseable in 7DoF within the same workspace - to suit the demands of their current task, social situation, app scenario, or mobility needs. This affords an interaction metaphor where relative orientation, proximity, attaching (or detaching) devices, and continuous movement into and out of ad-hoc ensembles can drive context-sensitive interactions. Yet all devices remain self-stable in useful configurations even when released in mid-air. We explore flexible physical arrangement, feedforward of transition options, and layering of devices in-air across a variety of multi-device app scenarios. These include video conferencing with flexible arrangement of the person-space of multiple remote participants around a shared task-space, layered and tiled device formations with overview+detail and shared-to-personal transitions, and flexible composition of UI panels and tool palettes across devices for productivity applications. A preliminary interview study highlights user reactions to AirConstellations, such as for minimally disruptive device formations, easier physical transitions, and balancing "seeing and being seen"in remote work

SAFETY BRAKES AND WIRELESS WARNING SYSTEM FOR BABY STROLLER

Safety Brakes and Wireless Warning System is a design-based project where a 'Radio Frequency (RF) Wireless Communication System' plays the main roles to stop the baby stroller automatically. This system comprises an external motor controller circuit that interfaces with the RF receiver on the stroller. The author will deal with RF devices and motor controller for Final Year Project I. The goals for Radio Frequency (RF) devices are to design and construct a wireless-based system that monitors and informs their status which will then be used to transfer the signals tu controller circuit and in other similar applications. The benefits of this system are to replace the current safety methods by brakes the stroller manually and it also offer a better enhancement system. For advanced application, other application such as alarming system can be integrated together with the RF devices if security is the major concern. The final output from the direct current motor is a prototype of a braking system which is the integration of RF communication based and controller circuit connected via wired link to the baby stroller. The RF receiver and RF transmitter devices can be applied by leaving the devices alone but separated in any place that in the frequency range so that they can communicate. The receiver can receives the transmitted signal from the transmitter. Overall, the project is the best platform to improve the safety braking system and ignites another innovative invention in the future

A creative journey developing an integrated high-fashion knitwear development process using computerized seamless v-bed knitting systems

This PhD applied a participatory action research approach to address the organizational problems that compromise the use of computerized seamless V-bed knitwear systems in the high-fashion knitwear sector. The research is a response to a widely acknowledged conflict between high-fashion design processes and processes by which designs are developed on computerized seamless V-bed knitting systems. The social, organizational, and technical aspects of design and manufacturing using computerized seamless V-bed knitting technology in high-fashion knitwear design were analyzed as a socio-technical system (STS). This approach led to a review of the workflows, tasks and roles; identifying and testing new design and manufacturing processes, design methods, and garment solutions; creating a theory model of a new integrated design process; and developing and testing new design processes, design methods, and fashion design education courses that teach these new fashion knitwear approaches.The research was undertaken using a Shima Seiki WholeGarment® system, a current computerized seamless V-bed knitting design and manufacturing technology. The studio workspace, yarn, use of the Shima Seiki system; involvement in fashion projects, and associate supervision were provided by the Department of Agriculture and Food Western Australia (DAFWA).The research demonstrated a high-fashion knitwear designer can undertake all aspects of managing computerized seamless V-bed knitwear design and production to the completion of 1st sample, the first successful sample of a new fabric or garment, was produced using the computer knit data. This finding was developed into a new integrated design process and design methods that remove most of the problems of computerized seamless V-bed knitting systems in high-fashion and offers additional benefits including reduction in time to market and design costs, and increases in the creative solution space for high-fashion knitwear design.The researcher has called this new role, a ‘designer-interpreter’ to denote a professional knitwear designer with additional training in managing computerized seamless knitting machines. Within the context of ‘designer-interpreter’, this research also established the feasibility of a new form of a ‘post-industrial craft-based one-person knitwear production system’

Electrifying Opera, Amplifying Agency: Designing a performer-controlled interactive audio system for opera singers

This artistic research project examines the artistic, technical, and pedagogical challenges of developing a performer-controlled interactive technology for real-time vocal processing of the operatic voice. As a classically trained singer-composer, I have explored ways to merge the compositional aspects of transforming electronic sound with the performative aspects of embodied singing. I set out to design, develop, and test a prototype for an interactive vocal processing system using sampling and audio processing methods. The aim was to foreground and accommodate an unamplified operatic voice interacting with the room's acoustics and the extended disembodied voices of the same performer. The iterative prototyping explored the performer's relationship to the acoustic space, the relationship between the embodied acoustic voice and disembodied processed voice(s), and the relationship to memory and time. One of the core challenges was to design a system that would accommodate mobility and allow interaction based on auditory and haptic cues rather than visual. In other words, a system allowing the singer to control their sonic output without standing behind a laptop. I wished to highlight and amplify the performer's agency with a system that would enable nuanced and variable vocal processing, be robust, teachable, and suitable for use in various settings: solo performances, various types and sizes of ensembles, and opera. This entailed mediating different needs, training, and working methods of both electronic music and opera practitioners. One key finding was that even simple audio processing could achieve complex musical results. The audio processes used were primarily combinations of feedback and delay lines. However, performers could get complex musical results quickly through continuous gestural control and the ability to route signals to four channels. This complexity sometimes led to surprising results, eliciting improvisatory responses also from singers without musical improvisation experience. The project has resulted in numerous vocal solo, chamber, and operatic performances in Norway, the Netherlands, Belgium, and the United States. The research contributes to developing emerging technologies for live electronic vocal processing in opera, developing the improvisational performance skills needed to engage with those technologies, and exploring alternatives for sound diffusion conducive to working with unamplified operatic voices. Links: Exposition and documentation of PhD research in Research Catalogue: Electrifying Opera, Amplifying Agency. Artistic results. Reflection and Public Presentations (PhD) (2023): https://www.researchcatalogue.net/profile/show-exposition?exposition=2222429 Home/Reflections: https://www.researchcatalogue.net/view/2222429/2222460 Mapping & Prototyping: https://www.researchcatalogue.net/view/2222429/2247120 Space & Speakers: https://www.researchcatalogue.net/view/2222429/2222430 Presentations: https://www.researchcatalogue.net/view/2222429/2247155 Artistic Results: https://www.researchcatalogue.net/view/2222429/222248

Coraline

Coraline (Henry Selick, 2009) is stop-motion studio LAIKA's feature-length debut based on the popular children's novel by British author Neil Gaiman. Heralding a revival in global interest in stop-motion animation, the film is both an international cultural phenomenon and a breakthrough moment in the technological evolution of the craft. This open access collection brings together an international group of practitioners and scholars to examine Coraline’s place in animation history and culture, dissect its politics, and unpack its role in the technological and aesthetic development of its medium. More broadly, it celebrates stop motion as a unique and enduring artform while embracing its capacity to evolve in response to cultural, political, and technological changes, as well as shifting critical and audience demands. Divided into three sections, this volume’s chapters situate Coraline within an interconnected network of historical, industrial, discursive, theoretical, and cultural contexts. They place the film in conversation with the medium’s aesthetic and technological history, broader global intellectual and political traditions, and questions of animation reception and spectatorship. In doing so, they invite recognition – and appreciation – of the fact that Coraline occupies many liminal spaces at once. It straddles the boundary between children’s entertainment and traditional ‘adult’ genres, such as horror and thriller. It complicates a seemingly straight(forward) depiction of normative family life with gestures of queer resistance. Finally, it marks a pivotal point in stop-motion animation’s digital turn. Following the film’s recent tenth anniversary, the time is right to revisit its production history, evaluate its cultural and industry impact, and celebrate its legacy as contemporary stop-motion cinema’s gifted child. As the first book-length academic study of this contemporary animation classic, this volume serves as an authoritative introduction and a primary reference on the film for scholars, students, practitioners, and animation fans. The ebook editions of this book are available open access under a CC BY-NC-ND 4.0 licence on bloomsburycollections.com