Artistic Path Space Editing of Physically Based Light Transport

Die Erzeugung realistischer Bilder ist ein wichtiges Ziel der Computergrafik, mit Anwendungen u.a. in der Spielfilmindustrie, Architektur und Medizin. Die physikalisch basierte Bildsynthese, welche in letzter Zeit anwendungsübergreifend weiten Anklang findet, bedient sich der numerischen Simulation des Lichttransports entlang durch die geometrische Optik vorgegebener Ausbreitungspfade; ein Modell, welches für übliche Szenen ausreicht, Photorealismus zu erzielen. Insgesamt gesehen ist heute das computergestützte Verfassen von Bildern und Animationen mit wohlgestalteter und theoretisch fundierter Schattierung stark vereinfacht. Allerdings ist bei der praktischen Umsetzung auch die Rücksichtnahme auf Details wie die Struktur des Ausgabegeräts wichtig und z.B. das Teilproblem der effizienten physikalisch basierten Bildsynthese in partizipierenden Medien ist noch weit davon entfernt, als gelöst zu gelten. Weiterhin ist die Bildsynthese als Teil eines weiteren Kontextes zu sehen: der effektiven Kommunikation von Ideen und Informationen. Seien es nun Form und Funktion eines Gebäudes, die medizinische Visualisierung einer Computertomografie oder aber die Stimmung einer Filmsequenz -- Botschaften in Form digitaler Bilder sind heutzutage omnipräsent. Leider hat die Verbreitung der -- auf Simulation ausgelegten -- Methodik der physikalisch basierten Bildsynthese generell zu einem Verlust intuitiver, feingestalteter und lokaler künstlerischer Kontrolle des finalen Bildinhalts geführt, welche in vorherigen, weniger strikten Paradigmen vorhanden war. Die Beiträge dieser Dissertation decken unterschiedliche Aspekte der Bildsynthese ab. Dies sind zunächst einmal die grundlegende Subpixel-Bildsynthese sowie effiziente Bildsyntheseverfahren für partizipierende Medien. Im Mittelpunkt der Arbeit stehen jedoch Ansätze zum effektiven visuellen Verständnis der Lichtausbreitung, die eine lokale künstlerische Einflussnahme ermöglichen und gleichzeitig auf globaler Ebene konsistente und glaubwürdige Ergebnisse erzielen. Hierbei ist die Kernidee, Visualisierung und Bearbeitung des Lichts direkt im alle möglichen Lichtpfade einschließenden "Pfadraum" durchzuführen. Dies steht im Gegensatz zu Verfahren nach Stand der Forschung, die entweder im Bildraum arbeiten oder auf bestimmte, isolierte Beleuchtungseffekte wie perfekte Spiegelungen, Schatten oder Kaustiken zugeschnitten sind. Die Erprobung der vorgestellten Verfahren hat gezeigt, dass mit ihnen real existierende Probleme der Bilderzeugung für Filmproduktionen gelöst werden können

Bridging the gap: rewritable electronics using real-time light-induced dielectrophoresis on lithium niobate

In the context of micro-electronics, the real-time manipulation and placement of components using optics alone promises a route towards increasingly dynamic systems, where the geometry and function of the device is not fixed at the point of fabrication. Here, we demonstrate physically reconfigurable circuitry through light-induced dielectrophoresis on lithium niobate. Using virtual electrodes, patterned by light, to trap, move, and chain individual micro-solder-beads in real-time via dielectrophoresis, we demonstrate rewritable electrical contacts which can make electrical connections between surface-bound components. The completed micro-solder-bead bridges were found to have relatively low resistances that were not solely dominated by the number of interfaces, or the number of discrete beads, in the connection. Significantly, these connections are formed without any melting/fusing of the beads, a key feature of this technique that enables reconfigurability. Requiring only a low-power (~3.5 mW) laser source to activate, and without the need for external power supply or signal generation, the all-optical simplicity of virtual-electrodes may prove significant for the future development of reconfigurable electronic systems

Autonomy Infused Teleoperation with Application to BCI Manipulation

Robot teleoperation systems face a common set of challenges including latency, low-dimensional user commands, and asymmetric control inputs. User control with Brain-Computer Interfaces (BCIs) exacerbates these problems through especially noisy and erratic low-dimensional motion commands due to the difficulty in decoding neural activity. We introduce a general framework to address these challenges through a combination of computer vision, user intent inference, and arbitration between the human input and autonomous control schemes. Adjustable levels of assistance allow the system to balance the operator's capabilities and feelings of comfort and control while compensating for a task's difficulty. We present experimental results demonstrating significant performance improvement using the shared-control assistance framework on adapted rehabilitation benchmarks with two subjects implanted with intracortical brain-computer interfaces controlling a seven degree-of-freedom robotic manipulator as a prosthetic. Our results further indicate that shared assistance mitigates perceived user difficulty and even enables successful performance on previously infeasible tasks. We showcase the extensibility of our architecture with applications to quality-of-life tasks such as opening a door, pouring liquids from containers, and manipulation with novel objects in densely cluttered environments

Optical phase noise engineering via acousto-optic interaction and its interferometric applications

We exercise rapid and fine control over the phase of light by transferring digitally gen- erated phase jumps from radio frequency (rf) electrical signals onto light by means of acousto-optic interaction. By tailoring the statistics of phase jumps in the electrical signal and thereby engineering the optical phase noise, we manipulate the visibil- ity of interference fringes in a Mach-Zehnder interferometer that incorporates two acousto-optic modulators. Such controlled dephasing finds applications in modern experiments involving the spread or diffusion of light in an optical network. Further, we analytically show how engineered partial phase noise can convert the dark port of a stabilised interferometer to a weak source of highly correlated photons.Comment: 5 figure

Plausible Shading Decomposition For Layered Photo Retouching

Photographers routinely compose multiple manipulated photos of the same scene (layers) into a single image, which is better than any individual photo could be alone. Similarly, 3D artists set up rendering systems to produce layered images to contain only individual aspects of the light transport, which are composed into the final result in post-production. Regrettably, both approaches either take considerable time to capture, or remain limited to synthetic scenes. In this paper, we suggest a system to allow decomposing a single image into a plausible shading decomposition (PSD) that approximates effects such as shadow, diffuse illumination, albedo, and specular shading. This decomposition can then be manipulated in any off-the-shelf image manipulation software and recomposited back. We perform such a decomposition by learning a convolutional neural network trained using synthetic data. We demonstrate the effectiveness of our decomposition on synthetic (i.e., rendered) and real data (i.e., photographs), and use them for common photo manipulation, which are nearly impossible to perform otherwise from single images

Novel topological beam-splitting in photonic crystals

We create a passive wave splitter, created purely by geometry, to engineer three-way beam splitting in electromagnetism in transverse electric polarisation. We do so by considering arrangements of Indium Phosphide dielectric pillars in air, in particular we place several inclusions within a cell that is then extended periodically upon a square lattice. Hexagonal lattice structures more commonly used in topological valleytronics but, as we discuss, three-way splitting is only possible using a square, or rectangular, lattice. To achieve splitting and transport around a sharp bend we use accidental, and not symmetry-induced, Dirac cones. Within each cell pillars are either arranged around a triangle or square; we demonstrate the mechanism of splitting and why it does not occur for one of the cases. The theory is developed and full scattering simulations demonstrate the effectiveness of the proposed designs