Single-shot ultrafast optical imaging

Single-shot ultrafast optical imaging can capture two-dimensional transient scenes in the optical spectral range at ≥100 million frames per second. This rapidly evolving field surpasses conventional pump-probe methods by possessing real-time imaging capability, which is indispensable for recording nonrepeatable and difficult-to-reproduce events and for understanding physical, chemical, and biological mechanisms. In this mini-review, we survey state-of-the-art single-shot ultrafast optical imaging comprehensively. Based on the illumination requirement, we categorized the field into active-detection and passive-detection domains. Depending on the specific image acquisition and reconstruction strategies, these two categories are further divided into a total of six subcategories. Under each subcategory, we describe operating principles, present representative cutting-edge techniques, with a particular emphasis on their methodology and applications, and discuss their advantages and challenges. Finally, we envision prospects for technical advancement in this field

Roadmap on holography

From its inception holography has proven an extremely productive and attractive area of research. While specific technical applications give rise to 'hot topics', and three-dimensional (3D) visualisation comes in and out of fashion, the core principals involved continue to lead to exciting innovations in a wide range of areas. We humbly submit that it is impossible, in any journal document of this type, to fully reflect current and potential activity; however, our valiant contributors have produced a series of documents that go no small way to neatly capture progress across a wide range of core activities. As editors we have attempted to spread our net wide in order to illustrate the breadth of international activity. In relation to this we believe we have been at least partially successful.This work was supported by Ministerio de Economía, Industria y Competitividad (Spain) under projects FIS2017-82919-R (MINECO/AEI/FEDER, UE) and FIS2015-66570-P (MINECO/FEDER), and by Generalitat Valenciana (Spain) under project PROMETEO II/2015/015

3D Capture and 3D Contents Generation for Holographic Imaging

The intrinsic properties of holograms make 3D holographic imaging the best candidate for a 3D display. The holographic display is an autostereoscopic display which provides highly realistic images with unique perspective for an arbitrary number of viewers, motion parallax both vertically and horizontally, and focusing at different depths. The 3D content generation for this display is carried out by means of digital holography. Digital holography implements the classic holographic principle as a two‐step process of wavefront capture in the form of a 2D interference pattern and wavefront reconstruction by applying numerically or optically a reference wave. The chapter follows the two main tendencies in forming the 3D holographic content—direct feeding of optically recorded digital holograms to a holographic display and computer generation of interference fringes from directional, depth and colour information about the 3D objects. The focus is set on important issues that comprise encoding of 3D information for holographic imaging starting from conversion of optically captured holographic data to the display data format, going through different approaches for forming the content for computer generation of holograms from coherently or incoherently captured 3D data and finishing with methods for the accelerated computing of these holograms

Single-shot ultrafast optical imaging

Single-shot ultrafast optical imaging can capture two-dimensional transient scenes in the optical spectral range at ≥100 million frames per second. This rapidly evolving field surpasses conventional pump-probe methods by possessing real-time imaging capability, which is indispensable for recording nonrepeatable and difficult-to-reproduce events and for understanding physical, chemical, and biological mechanisms. In this mini-review, we survey state-of-the-art single-shot ultrafast optical imaging comprehensively. Based on the illumination requirement, we categorized the field into active-detection and passive-detection domains. Depending on the specific image acquisition and reconstruction strategies, these two categories are further divided into a total of six subcategories. Under each subcategory, we describe operating principles, present representative cutting-edge techniques, with a particular emphasis on their methodology and applications, and discuss their advantages and challenges. Finally, we envision prospects for technical advancement in this field

Roadmap on holography

From its inception holography has proven an extremely productive and attractive area of research. While specific technical applications give rise to 'hot topics', and three-dimensional (3D) visualisation comes in and out of fashion, the core principals involved continue to lead to exciting innovations in a wide range of areas. We humbly submit that it is impossible, in any journal document of this type, to fully reflect current and potential activity; however, our valiant contributors have produced a series of documents that go no small way to neatly capture progress across a wide range of core activities. As editors we have attempted to spread our net wide in order to illustrate the breadth of international activity. In relation to this we believe we have been at least partially successful

Synchronization of High-Dimensional Dynamical Systems

There are many examples of high-dimensional systems in nature. Often these systems behave in synchrony even though they possess a large number of degrees of freedom. Far fewer of these types of systems exist in the laboratory, and even fewer techniques exist with which to analyze them. As experimental capability increases, and more high-dimensional laboratory systems are fabricated, universal tools must be developed to observe and analyze the dynamics of these systems. This thesis will present experiments and analysis of two high-dimensional systems, coupled fiber ring lasers and a liquid crystal spatial light modulator with optoelectronic feedback. Two identically constructed mutually coupled erbium doped fiber ring lasers were studied and were found to synchronize at very low coupling strengths. Synchronization error was characterized as a function of coupling strength. Optical frequency-locking and hopping as a result of the mutual coupling was also observed. Methods for detecting the leader and follower laser as well as role switching, a form of spontaneous symmetry-breaking, were developed. These include a spatiotemporal representation of the intensities within each ring laser and the use of Karhunen-Loeve decomposition. A delay-differential equation model was developed and the numerical simulations were in agreement with the experiment. Chaotic communication was achieved in this system with bit rates of 125 MHz, limited by the detection speed. A liquid crystal spatial light modulator (SLM) was also studied. When used as a dynamic holographic grating, this device allowed the fabrication of a variety of reshaped laser beams, including multiple Gaussian beams, optical billiards, and propagating Bessel beams. When configured in an optoelectronic feedback loop, the SLM displays spatiotemporal chaos and using the auxiliary system method, we have achieved generalized synchronization of this system. The space-time patterns as well as the transients to synchronization have been characterized as a function of the bias voltage across the liquid crystal. The analysis techniques used in this thesis can be applied to other high-dimensional systems

Molding Free-Space Light with Guided-Wave-Driven Metasurfaces

Metasurfaces with unparalleled controllability of light have shown great potential to revolutionize conventional optics. However, they mainly work with free-space light input, which makes it difficult for full on-chip integration. On the other hand, integrated photonics enables densely packed devices but has limited free-space light controllability. Here, we show that judiciously designed guided-wave-driven metasurfaces can mold guided waves into arbitrary free-space modes to achieve complex free-space functions, such as beam steering and focusing, with ultrasmall footprints and potentially no diffraction loss. Based on the same concept together with broken inversion symmetry induced by metasurfaces, we also realized direct orbital angular momentum (OAM) lasing from a micro-ring resonator. Our study works towards complete control of light across integrated photonics and free-space platforms, and paves new exciting ways for creating multifunctional photonic integrated devices with agile access to free space which could enable a plethora of applications in communications, remote sensing, displays, and etc.Comment: 37 pages, 5 figure

Highly Efficient and Data Compressed Ultrafast Single-Pixel Imaging based on Photonic Time-Stretch

The research presented in this thesis is focused on highly efficient and data compressed ultrafast single pixel imaging (SPI) systems based on photonic time stretch (PTS) technique. Three ultrafast SPI systems are presented and analysed with unique features of low-cost, compact, highly efficient and optical data compression. The first ultrafast SPI system is a highly efficient, fibre-compatible ultrafast imaging system based on PTS using a 45° tilted fibre grating (45° TFG). The 45° TFG serves as an in-fibre lateral diffraction element, replacing bulky and lossy free- space diffraction gratings in conventional PTS imaging systems. This new design significantly reduces the volume of conventional PTS imaging systems, improves energy efficiency and system stability. A proof-of-principle demonstration of our proposed PTS imaging system is performed for the first time with improved spatial resolution and ultrafast detecting speed of 46 m/s. Secondly, data compressed ultrafast photonic time stretch imaging is investigated with the help of a spatial mask for spatial domain compressed sensing. In practice, a spatial light modulator (SLM) is utilized as a passive optical random pattern modulator, namely, spatial mask, in spatial domain. This combines the benefit of compressed sensing (CS) and PTS techniques. And a high speed CS imaging system is obtained with a compression ratio of 55.6%. Besides, time-domain CS applied in ultrafast real-time optical coherent tomography (OCT) is experimentally demonstrated as well. Finally, an all-optical CS imaging system based on PTS and multimode interference using a multimode fibre (MMF) is demonstrated. The MMF acts as a low-cost random optical speckle pattern generator based on ultrafast wavelength tuning in PTS. Each wavelength of the optical light generates a repeatable and stable random optical speckle pattern, which has the feature of low- correlated relation between different optical speckle patterns. This technique can overcome the speed limit in existing CS photonic time stretch imaging, where imaging speed is much lower than the pulse repetition rate

Coherent and Holographic Imaging Methods for Immersive Near-Eye Displays

Lähinäytöt on suunniteltu tarjoamaan realistisia kolmiulotteisia katselukokemuksia, joille on merkittävää tarvetta esimerkiksi työkoneiden etäkäytössä ja 3D-suunnittelussa. Nykyaikaiset lähinäytöt tuottavat kuitenkin edelleen ristiriitaisia visuaalisia vihjeitä, jotka heikentävät immersiivistä kokemusta ja haittaavat niiden miellyttävää käyttöä. Merkittävänä ratkaisuvaihtoehtona pidetään koherentin valon, kuten laservalon, käyttöä näytön valaistukseen, millä voidaan korjata nykyisten lähinäyttöjen puutteita. Erityisesti koherentti valaistus mahdollistaa holografisen kuvantamisen, jota käyttävät holografiset näytöt voivat tarkasti jäljitellä kolmiulotteisten mallien todellisia valoaaltoja. Koherentin valon käyttäminen näyttöjen valaisemiseen aiheuttaa kuitenkin huomiota vaativaa korkean kontrastin häiriötä pilkkukuvioiden muodossa. Lisäksi holografisten näyttöjen laskentamenetelmät ovat laskennallisesti vaativia ja asettavat uusia haasteita analyysin, pilkkuhäiriön ja valon mallintamisen suhteen. Tässä väitöskirjassa tutkitaan laskennallisia menetelmiä lähinäytöille koherentissa kuvantamisjärjestelmässä käyttäen signaalinkäsittelyä, koneoppimista sekä geometrista (säde) ja fysikaalista (aalto) optiikan mallintamista. Työn ensimmäisessä osassa keskitytään holografisten kuvantamismuotojen analysointiin sekä kehitetään hologrammien laskennallisia menetelmiä. Holografian korkeiden laskentavaatimusten ratkaisemiseksi otamme käyttöön holografiset stereogrammit holografisen datan likimääräisenä esitysmuotona. Tarkastelemme kyseisen esitysmuodon visuaalista oikeellisuutta kehittämällä analyysikehyksen holografisen stereogrammin tarjoamien visuaalisten vihjeiden tarkkuudelle akkommodaatiota varten suhteessa sen suunnitteluparametreihin. Lisäksi ehdotamme signaalinkäsittelyratkaisua pilkkuhäiriön vähentämiseksi, ratkaistaksemme nykyisten menetelmien valon mallintamiseen liittyvät visuaalisia artefakteja aiheuttavat ongelmat. Kehitämme myös uudenlaisen holografisen kuvantamismenetelmän, jolla voidaan mallintaa tarkasti valon käyttäytymistä haastavissa olosuhteissa, kuten peiliheijastuksissa. Väitöskirjan toisessa osassa lähestytään koherentin näyttökuvantamisen laskennallista taakkaa koneoppimisen avulla. Kehitämme koherentin akkommodaatioinvariantin lähinäytön suunnittelukehyksen, jossa optimoidaan yhtäaikaisesti näytön staattista optiikka ja näytön kuvan esikäsittelyverkkoa. Lopuksi nopeutamme ehdottamaamme uutta holografista kuvantamismenetelmää koneoppimisen avulla reaaliaikaisia sovelluksia varten. Kyseiseen ratkaisuun sisältyy myös tehokkaan menettelyn kehittäminen funktionaalisten satunnais-3D-ympäristöjen tuottamiseksi. Kehittämämme menetelmä mahdollistaa suurten synteettisten moninäkökulmaisten kuvien datasettien tuottamisen, joilla voidaan kouluttaa sopivia neuroverkkoja mallintamaan holografista kuvantamismenetelmäämme reaaliajassa. Kaiken kaikkiaan tässä työssä kehitettyjen menetelmien osoitetaan olevan erittäin kilpailukykyisiä uusimpien koherentin valon lähinäyttöjen laskentamenetelmien kanssa. Työn tuloksena nähdään kaksi vaihtoehtoista lähestymistapaa ristiriitaisten visuaalisten vihjeiden aiheuttamien nykyisten lähinäyttöongelmien ratkaisemiseksi joko staattisella tai dynaamisella optiikalla ja reaaliaikaiseen käyttöön soveltuvilla laskentamenetelmillä. Esitetyt tulokset ovat näin ollen tärkeitä seuraavan sukupolven immersiivisille lähinäytöille.Near-eye displays have been designed to provide realistic 3D viewing experience, strongly demanded in applications, such as remote machine operation, entertainment, and 3D design. However, contemporary near-eye displays still generate conflicting visual cues which degrade the immersive experience and hinders their comfortable use. Approaches using coherent, e.g., laser light for display illumination have been considered prominent for tackling the current near-eye display deficiencies. Coherent illumination enables holographic imaging whereas holographic displays are expected to accurately recreate the true light waves of a desired 3D scene. However, the use of coherent light for driving displays introduces additional high contrast noise in the form of speckle patterns, which has to be taken care of. Furthermore, imaging methods for holographic displays are computationally demanding and impose new challenges in analysis, speckle noise and light modelling. This thesis examines computational methods for near-eye displays in the coherent imaging regime using signal processing, machine learning, and geometrical (ray) and physical (wave) optics modeling. In the first part of the thesis, we concentrate on analysis of holographic imaging modalities and develop corresponding computational methods. To tackle the high computational demands of holography, we adopt holographic stereograms as an approximative holographic data representation. We address the visual correctness of such representation by developing a framework for analyzing the accuracy of accommodation visual cues provided by a holographic stereogram in relation to its design parameters. Additionally, we propose a signal processing solution for speckle noise reduction to overcome existing issues in light modelling causing visual artefacts. We also develop a novel holographic imaging method to accurately model lighting effects in challenging conditions, such as mirror reflections. In the second part of the thesis, we approach the computational complexity aspects of coherent display imaging through deep learning. We develop a coherent accommodation-invariant near-eye display framework to jointly optimize static display optics and a display image pre-processing network. Finally, we accelerate the corresponding novel holographic imaging method via deep learning aimed at real-time applications. This includes developing an efficient procedure for generating functional random 3D scenes for forming a large synthetic data set of multiperspective images, and training a neural network to approximate the holographic imaging method under the real-time processing constraints. Altogether, the methods developed in this thesis are shown to be highly competitive with the state-of-the-art computational methods for coherent-light near-eye displays. The results of the work demonstrate two alternative approaches for resolving the existing near-eye display problems of conflicting visual cues using either static or dynamic optics and computational methods suitable for real-time use. The presented results are therefore instrumental for the next-generation immersive near-eye displays