9,698 research outputs found

    Image processing by Intensity-Dependent Spread (IDS)

    Get PDF
    As retinal illuminance is lowered, the human visual system integrates the effects of photon absorptions over larger areas and longer times. A theory of the process that might underlie these changes is called Intensity-Dependent Spread (IDS). Each input point gives rise to a pattern of excitation that spreads to a region of the total excitation it sees. The unique aspect of the theory is the assumption that, although the amplitude of the excitation pattern at its center increases with input illuminance, its width decreases in such a way that its volume remains constant. Application of this theory to image processing reveals that it displays a number of unexpected and potentially useful properties. Among them are edge enhancement and independence from scene illumination

    Seeing into Darkness: Scotopic Visual Recognition

    Get PDF
    Images are formed by counting how many photons traveling from a given set of directions hit an image sensor during a given time interval. When photons are few and far in between, the concept of `image' breaks down and it is best to consider directly the flow of photons. Computer vision in this regime, which we call `scotopic', is radically different from the classical image-based paradigm in that visual computations (classification, control, search) have to take place while the stream of photons is captured and decisions may be taken as soon as enough information is available. The scotopic regime is important for biomedical imaging, security, astronomy and many other fields. Here we develop a framework that allows a machine to classify objects with as few photons as possible, while maintaining the error rate below an acceptable threshold. A dynamic and asymptotically optimal speed-accuracy tradeoff is a key feature of this framework. We propose and study an algorithm to optimize the tradeoff of a convolutional network directly from lowlight images and evaluate on simulated images from standard datasets. Surprisingly, scotopic systems can achieve comparable classification performance as traditional vision systems while using less than 0.1% of the photons in a conventional image. In addition, we demonstrate that our algorithms work even when the illuminance of the environment is unknown and varying. Last, we outline a spiking neural network coupled with photon-counting sensors as a power-efficient hardware realization of scotopic algorithms.Comment: 23 pages, 6 figure

    Quantum-inspired computational imaging

    Get PDF
    Computational imaging combines measurement and computational methods with the aim of forming images even when the measurement conditions are weak, few in number, or highly indirect. The recent surge in quantum-inspired imaging sensors, together with a new wave of algorithms allowing on-chip, scalable and robust data processing, has induced an increase of activity with notable results in the domain of low-light flux imaging and sensing. We provide an overview of the major challenges encountered in low-illumination (e.g., ultrafast) imaging and how these problems have recently been addressed for imaging applications in extreme conditions. These methods provide examples of the future imaging solutions to be developed, for which the best results are expected to arise from an efficient codesign of the sensors and data analysis tools.Y.A. acknowledges support from the UK Royal Academy of Engineering under the Research Fellowship Scheme (RF201617/16/31). S.McL. acknowledges financial support from the UK Engineering and Physical Sciences Research Council (grant EP/J015180/1). V.G. acknowledges support from the U.S. Defense Advanced Research Projects Agency (DARPA) InPho program through U.S. Army Research Office award W911NF-10-1-0404, the U.S. DARPA REVEAL program through contract HR0011-16-C-0030, and U.S. National Science Foundation through grants 1161413 and 1422034. A.H. acknowledges support from U.S. Army Research Office award W911NF-15-1-0479, U.S. Department of the Air Force grant FA8650-15-D-1845, and U.S. Department of Energy National Nuclear Security Administration grant DE-NA0002534. D.F. acknowledges financial support from the UK Engineering and Physical Sciences Research Council (grants EP/M006514/1 and EP/M01326X/1). (RF201617/16/31 - UK Royal Academy of Engineering; EP/J015180/1 - UK Engineering and Physical Sciences Research Council; EP/M006514/1 - UK Engineering and Physical Sciences Research Council; EP/M01326X/1 - UK Engineering and Physical Sciences Research Council; W911NF-10-1-0404 - U.S. Defense Advanced Research Projects Agency (DARPA) InPho program through U.S. Army Research Office; HR0011-16-C-0030 - U.S. DARPA REVEAL program; 1161413 - U.S. National Science Foundation; 1422034 - U.S. National Science Foundation; W911NF-15-1-0479 - U.S. Army Research Office; FA8650-15-D-1845 - U.S. Department of the Air Force; DE-NA0002534 - U.S. Department of Energy National Nuclear Security Administration)Accepted manuscrip

    A Fiber Optic Probe for the Detection of Cataracts

    Get PDF
    A compact fiber optic probe developed for on-orbit science experiments was used to detect the onset of cataracts, a capability that could eliminate physicians' guesswork and result in new drugs to 'dissolve' or slow down the cataract formation before surgery is necessary. The probe is based upon dynamic light scattering (DLS) principles. It has no moving parts, no apertures, and requires no optical alignment. It is flexible and easy to use. Results are presented for excised but intact human eye lenses. In a clinical setting, the device can be easily incorporated into a slit-lamp apparatus (ophthalmoscope) for complete eye diagnostics. In this set-up, the integrated fiber optic probe, the size of a pencil, delivers a low power cone of laser light into the eye of a patient and guides the light which is backscattered by the protein molecules of the lens through a receiving optical fiber to a photo detector. The non-invasive DLS measurements provide rapid determination of protein crystalline size and its size distribution in the eye lens

    The science of color and color vision

    Get PDF
    A survey of color science and color vision

    The Quantum Measurement Problem - Collapse of the Wave Function explained

    Get PDF
    Quantum physicists have made many attempts to solve the quantum measurement problem, but no solution seems to have received widespread acceptance. The time has come for a new approach. In Sense Perception and Reality: A Theory of Perceptual Relativity, Quantum Mechanics and the Observer Dependent Universe I suggest the quantum measurement problem is caused by a failure to understand that each species has its own sensory world and that when we say the wave function collapses and brings a particle into existence we mean the particle is brought into existence in the human sensory world by the combined operation of the human sensory apparatus, particle detectors and the experimental set up. This is similar to the Copenhagen Interpretation suggested by Niels Bohr and others, but the understanding that the collapse of the wave function brings a particle into existence in the human sensory world removes the need for a dividing line between the quantum world and the macro world. The same rules can apply to both worlds and the ideas stated in this paper considerably strengthen the Copenhagen Interpretation of quantum mechanics

    Vision Science and Technology at NASA: Results of a Workshop

    Get PDF
    A broad review is given of vision science and technology within NASA. The subject is defined and its applications in both NASA and the nation at large are noted. A survey of current NASA efforts is given, noting strengths and weaknesses of the NASA program
    corecore