Lifting GIS Maps into Strong Geometric Context for Scene Understanding

Contextual information can have a substantial impact on the performance of visual tasks such as semantic segmentation, object detection, and geometric estimation. Data stored in Geographic Information Systems (GIS) offers a rich source of contextual information that has been largely untapped by computer vision. We propose to leverage such information for scene understanding by combining GIS resources with large sets of unorganized photographs using Structure from Motion (SfM) techniques. We present a pipeline to quickly generate strong 3D geometric priors from 2D GIS data using SfM models aligned with minimal user input. Given an image resectioned against this model, we generate robust predictions of depth, surface normals, and semantic labels. We show that the precision of the predicted geometry is substantially more accurate other single-image depth estimation methods. We then demonstrate the utility of these contextual constraints for re-scoring pedestrian detections, and use these GIS contextual features alongside object detection score maps to improve a CRF-based semantic segmentation framework, boosting accuracy over baseline models

On negative higher-order Kerr effect and filamentation

As a contribution to the ongoing controversy about the role of higher-order Kerr effect (HOKE) in laser filamentation, we first provide thorough details about the protocol that has been employed to infer the HOKE indices from the experiment. Next, we discuss potential sources of artifact in the experimental measurements of these terms and show that neither the value of the observed birefringence, nor its inversion, nor the intensity at which it is observed, appear to be flawed. Furthermore, we argue that, independently on our values, the principle of including HOKE is straightforward. Due to the different temporal and spectral dynamics, the respective efficiency of defocusing by the plasma and by the HOKE is expected to depend substantially on both incident wavelength and pulse duration. The discussion should therefore focus on defining the conditions where each filamentation regime dominates.Comment: 22 pages, 11 figures. Submitted to Laser physics as proceedings of the Laser Physics 2010 conferenc

Vibrational Spectroscopic Map, Vibrational Spectroscopy, and Intermolecular Interaction

© 2020 American Chemical Society. Vibrational spectroscopy is an essential tool in chemical analyses, biological assays, and studies of functional materials. Over the past decade, various coherent nonlinear vibrational spectroscopic techniques have been developed and enabled researchers to study time-correlations of the fluctuating frequencies that are directly related to solute-solvent dynamics, dynamical changes in molecular conformations and local electrostatic environments, chemical and biochemical reactions, protein structural dynamics and functions, characteristic processes of functional materials, and so on. In order to gain incisive and quantitative information on the local electrostatic environment, molecular conformation, protein structure and interprotein contacts, ligand binding kinetics, and electric and optical properties of functional materials, a variety of vibrational probes have been developed and site-specifically incorporated into molecular, biological, and material systems for time-resolved vibrational spectroscopic investigation. However, still, an all-encompassing theory that describes the vibrational solvatochromism, electrochromism, and dynamic fluctuation of vibrational frequencies has not been completely established mainly due to the intrinsic complexity of intermolecular interactions in condensed phases. In particular, the amount of data obtained from the linear and nonlinear vibrational spectroscopic experiments has been rapidly increasing, but the lack of a quantitative method to interpret these measurements has been one major obstacle in broadening the applications of these methods. Among various theoretical models, one of the most successful approaches is a semiempirical model generally referred to as the vibrational spectroscopic map that is based on a rigorous theory of intermolecular interactions. Recently, genetic algorithm, neural network, and machine learning approaches have been applied to the development of vibrational solvatochromism theory. In this review, we provide comprehensive descriptions of the theoretical foundation and various examples showing its extraordinary successes in the interpretations of experimental observations. In addition, a brief introduction to a newly created repository Web site (http://frequencymap.org) for vibrational spectroscopic maps is presented. We anticipate that a combination of the vibrational frequency map approach and state-of-the-art multidimensional vibrational spectroscopy will be one of the most fruitful ways to study the structure and dynamics of chemical, biological, and functional molecular systems in the future

Site-Specific Characterization of Cytochrome P450cam Conformations by Infrared Spectroscopy

Conformational changes are central to protein function but challenging to characterize with both high spatial and temporal precision. The inherently fast time scale and small chromophores of infrared (IR) spectroscopy are well-suited for characterization of potentially rapidly fluctuating environments, and when frequency-resolved probes are incorporated to overcome spectral congestion, enable characterization of specific sites in proteins. We selectively incorporated p-cyanophenylalanine (CNF) as a vibrational probe at five distinct locations in the enzyme cytochrome P450cam and used IR spectroscopy to characterize the environments in substrate and/or ligand complexes reflecting those in the catalytic cycle. Molecular dynamics (MD) simulations were performed to provide a structural basis for spectral interpretation. Together the experimental and simulation data suggest that the CN frequencies are sensitive to both long-range influences, resulting from the particular location of a residue within the enzyme, as well as short-range influences from hydrogen bonding and packing interactions. The IR spectra demonstrate that the environments and effects of substrate and/or ligand binding are different at each position probed and also provide evidence that a single site can experience multiple environments. This study illustrates how IR spectroscopy, when combined with the spectral decongestion and spatial selectivity afforded by CNF incorporation, provides detailed information about protein structural changes that underlie function. © 2016 American Chemical Society1991sciescopu

Quantum optical measurement with tripartite entangled photons generated by triple parametric down-conversion

Parametric down-conversion is a second-order nonlinear optical process annihilating a pump photon and creating a pair of photons in the signal and idler modes. Then, by using two parametric down-converters and introducing a path indistinguishability for the two generated idler modes, a quantum coherence between two conjugate signal beams can be induced. Such a double spontaneous or stimulated parametric down-conversion scheme has been used to demonstrate quantum spectroscopy and imaging with undetected idler photons via measuring one-photon interference between their correlated signal beams. Recently, we considered another quantum optical measurement scheme utilizing W-type tripartite entangled signal photons that can be generated by employing three spontaneous parametric down-conversion crystals and by inducing coherences or path-indistinguishabilities between their correlated idler beams and between quantum vacuum fields. Here, we consider an extended triple stimulated parametric down-conversion scheme for quantum optical measurement of sample properties with undetected idler and photons. Noting the real effect of vacuum field indistinguishability on the fringe visibility as well as the role of zero-point field energy in the interferometry, we show that this scheme is an ideal and efficient way to create a coherent state of W-type entangled signal photons. We anticipate that this scheme would be of critical use in further developing quantum optical measurements in spectroscopy and microscopy with undetected photons.

Low-frequency vibronic mixing modulates the excitation energy flow in bacterial light-harvesting complex II

Oscillatory features observed in two-dimensional electronic spectroscopy (2DES) manifest coherent vibrational and electronic dynamics and even the interplay of them. Recently, we developed a 2DES technique utilizing a pair of synchronized repetition-frequency-stabilized lasers, which enables the wide dynamic range measurements of 2DES signals rapidly. Here, we apply this dual-laser 2DES technique to investigate the electronic energy transfer (EET) process in bacterial light-harvesting complex II consisting of B800 and B850 circular aggregates at ambient temperature, and the coherent vibrational wavepakcet associated with the EET between the two aggregates are measured. Examining the principal component analysis of the time-resolved 2DES signal, we found that the EET from B800 to low-lying B850 states is modulated by a low-frequency (156 cm–1) vibrational mode of the exciton donor (B800). This observation suggests that the donor transition density is modulated by this vibration, which, in turn, modulates the energy transfer dynamics

Site-Specific Characterization of Cytochrome P450cam Conformations by Infrared Spectroscopy

Conformational changes are central to protein function but challenging to characterize with both high spatial and temporal precision. The inherently fast time scale and small chromophores of infrared (IR) spectroscopy are well-suited for characterization of potentially rapidly fluctuating environments, and when frequency-resolved probes are incorporated to overcome spectral congestion, enable characterization of specific sites in proteins. We selectively incorporated <i>p</i>-cyanophenylalanine (CNF) as a vibrational probe at five distinct locations in the enzyme cytochrome P450cam and used IR spectroscopy to characterize the environments in substrate and/or ligand complexes reflecting those in the catalytic cycle. Molecular dynamics (MD) simulations were performed to provide a structural basis for spectral interpretation. Together the experimental and simulation data suggest that the CN frequencies are sensitive to both long-range influences, resulting from the particular location of a residue within the enzyme, as well as short-range influences from hydrogen bonding and packing interactions. The IR spectra demonstrate that the environments and effects of substrate and/or ligand binding are different at each position probed and also provide evidence that a single site can experience multiple environments. This study illustrates how IR spectroscopy, when combined with the spectral decongestion and spatial selectivity afforded by CNF incorporation, provides detailed information about protein structural changes that underlie function

Vibrational modes promoting exciton relaxation in the B850 band of LH2

Exciton relaxation dynamics in multichromophore systems are often modeled using Redfield theory, where bath fluctuations mediate the relaxation among the exciton eigenstates. Identifying the vibrational or phonon modes that are implicated in exciton relaxation allows more detailed understanding of exciton dynamics. Here we focus on a well-studied light-harvesting II complex (LH2) isolated from the photosynthetic purple bacterium Rhodoblastus acidophilus strain 10050. Using two synchronized mode-locked lasers, we carried out a polarization-dependent two-dimensional electronic spectroscopy (2DES) study of an ultrafast exciton relaxation in the B850 band of LH2. 2DES data with different polarization configurations enable us to investigate the exciton relaxation between the k = ±1 exciton states. Then, we identify vibrational modes coupled to the exciton relaxation by analyzing the coherent wavepackets in the 2DES signals. Focusing on the coherent vibrational wavepackets, the data suggest that certain symmetry-breaking modes of monomeric units play a key role in exciton relaxation