9,698 research outputs found
Image processing by Intensity-Dependent Spread (IDS)
As retinal illuminance is lowered, the human visual system integrates the effects of photon absorptions over larger areas and longer times. A theory of the process that might underlie these changes is called Intensity-Dependent Spread (IDS). Each input point gives rise to a pattern of excitation that spreads to a region of the total excitation it sees. The unique aspect of the theory is the assumption that, although the amplitude of the excitation pattern at its center increases with input illuminance, its width decreases in such a way that its volume remains constant. Application of this theory to image processing reveals that it displays a number of unexpected and potentially useful properties. Among them are edge enhancement and independence from scene illumination
Seeing into Darkness: Scotopic Visual Recognition
Images are formed by counting how many photons traveling from a given set of
directions hit an image sensor during a given time interval. When photons are
few and far in between, the concept of `image' breaks down and it is best to
consider directly the flow of photons. Computer vision in this regime, which we
call `scotopic', is radically different from the classical image-based paradigm
in that visual computations (classification, control, search) have to take
place while the stream of photons is captured and decisions may be taken as
soon as enough information is available. The scotopic regime is important for
biomedical imaging, security, astronomy and many other fields. Here we develop
a framework that allows a machine to classify objects with as few photons as
possible, while maintaining the error rate below an acceptable threshold. A
dynamic and asymptotically optimal speed-accuracy tradeoff is a key feature of
this framework. We propose and study an algorithm to optimize the tradeoff of a
convolutional network directly from lowlight images and evaluate on simulated
images from standard datasets. Surprisingly, scotopic systems can achieve
comparable classification performance as traditional vision systems while using
less than 0.1% of the photons in a conventional image. In addition, we
demonstrate that our algorithms work even when the illuminance of the
environment is unknown and varying. Last, we outline a spiking neural network
coupled with photon-counting sensors as a power-efficient hardware realization
of scotopic algorithms.Comment: 23 pages, 6 figure
Quantum-inspired computational imaging
Computational imaging combines measurement and computational methods with the aim of forming images even when the measurement conditions are weak, few in number, or highly indirect. The recent surge in quantum-inspired imaging sensors, together with a new wave of algorithms allowing on-chip, scalable and robust data processing, has induced an increase of activity with notable results in the domain of low-light flux imaging and sensing. We provide an overview of the major challenges encountered in low-illumination (e.g., ultrafast) imaging and how these problems have recently been addressed for imaging applications in extreme conditions. These methods provide examples of the future imaging solutions to be developed, for which the best results are expected to arise from an efficient codesign of the sensors and data analysis tools.Y.A. acknowledges support from the UK Royal Academy of Engineering under the Research Fellowship Scheme (RF201617/16/31). S.McL. acknowledges financial support from the UK Engineering and Physical Sciences Research Council (grant EP/J015180/1). V.G. acknowledges support from the U.S. Defense Advanced Research Projects Agency (DARPA) InPho program through U.S. Army Research Office award W911NF-10-1-0404, the U.S. DARPA REVEAL program through contract HR0011-16-C-0030, and U.S. National Science Foundation through grants 1161413 and 1422034. A.H. acknowledges support from U.S. Army Research Office award W911NF-15-1-0479, U.S. Department of the Air Force grant FA8650-15-D-1845, and U.S. Department of Energy National Nuclear Security Administration grant DE-NA0002534. D.F. acknowledges financial support from the UK Engineering and Physical Sciences Research Council (grants EP/M006514/1 and EP/M01326X/1). (RF201617/16/31 - UK Royal Academy of Engineering; EP/J015180/1 - UK Engineering and Physical Sciences Research Council; EP/M006514/1 - UK Engineering and Physical Sciences Research Council; EP/M01326X/1 - UK Engineering and Physical Sciences Research Council; W911NF-10-1-0404 - U.S. Defense Advanced Research Projects Agency (DARPA) InPho program through U.S. Army Research Office; HR0011-16-C-0030 - U.S. DARPA REVEAL program; 1161413 - U.S. National Science Foundation; 1422034 - U.S. National Science Foundation; W911NF-15-1-0479 - U.S. Army Research Office; FA8650-15-D-1845 - U.S. Department of the Air Force; DE-NA0002534 - U.S. Department of Energy National Nuclear Security Administration)Accepted manuscrip
A Fiber Optic Probe for the Detection of Cataracts
A compact fiber optic probe developed for on-orbit science experiments was used to detect the onset of cataracts, a capability that could eliminate physicians' guesswork and result in new drugs to 'dissolve' or slow down the cataract formation before surgery is necessary. The probe is based upon dynamic light scattering (DLS) principles. It has no moving parts, no apertures, and requires no optical alignment. It is flexible and easy to use. Results are presented for excised but intact human eye lenses. In a clinical setting, the device can be easily incorporated into a slit-lamp apparatus (ophthalmoscope) for complete eye diagnostics. In this set-up, the integrated fiber optic probe, the size of a pencil, delivers a low power cone of laser light into the eye of a patient and guides the light which is backscattered by the protein molecules of the lens through a receiving optical fiber to a photo detector. The non-invasive DLS measurements provide rapid determination of protein crystalline size and its size distribution in the eye lens
The Quantum Measurement Problem - Collapse of the Wave Function explained
Quantum physicists have made many attempts to solve the quantum measurement problem, but no solution seems to have received widespread acceptance. The time has come for a new approach. In Sense Perception and Reality: A Theory of Perceptual Relativity, Quantum Mechanics and the Observer Dependent Universe I suggest the quantum measurement problem is caused by a failure to understand that each species has its own sensory world and that when we say the wave function collapses and brings a particle into existence we mean the particle is brought into existence in the human sensory world by the combined operation of the human sensory apparatus, particle detectors and the experimental set up. This is similar to the Copenhagen Interpretation suggested by Niels Bohr and others, but the understanding that the collapse of the wave function brings a particle into existence in the human sensory world removes the need for a dividing line between the quantum world and the macro world. The same rules can apply to both worlds and the ideas stated in this paper considerably strengthen the Copenhagen Interpretation of quantum mechanics
Vision Science and Technology at NASA: Results of a Workshop
A broad review is given of vision science and technology within NASA. The subject is defined and its applications in both NASA and the nation at large are noted. A survey of current NASA efforts is given, noting strengths and weaknesses of the NASA program
- …