Video Acceleration Magnification

The ability to amplify or reduce subtle image changes over time is useful in contexts such as video editing, medical video analysis, product quality control and sports. In these contexts there is often large motion present which severely distorts current video amplification methods that magnify change linearly. In this work we propose a method to cope with large motions while still magnifying small changes. We make the following two observations: i) large motions are linear on the temporal scale of the small changes; ii) small changes deviate from this linearity. We ignore linear motion and propose to magnify acceleration. Our method is pure Eulerian and does not require any optical flow, temporal alignment or region annotations. We link temporal second-order derivative filtering to spatial acceleration magnification. We apply our method to moving objects where we show motion magnification and color magnification. We provide quantitative as well as qualitative evidence for our method while comparing to the state-of-the-art.Comment: Accepted paper at CVPR 2017. Project webpage: http://acceleration-magnification.github.io

Stereoscopic camera and viewing systems with undistorted depth presentation and reduced or eliminated erroneous acceleration and deceleration perceptions, or with perceptions produced or enhanced for special effects

Methods for providing stereoscopic image presentation and stereoscopic configurations using stereoscopic viewing systems having converged or parallel cameras may be set up to reduce or eliminate erroneously perceived accelerations and decelerations by proper selection of parameters, such as an image magnification factor, q, and intercamera distance, 2w. For converged cameras, q is selected to be equal to Ve - qwl = 0, where V is the camera distance, e is half the interocular distance of an observer, w is half the intercamera distance, and l is the actual distance from the first nodal point of each camera to the convergence point, and for parallel cameras, q is selected to be equal to e/w. While converged cameras cannot be set up to provide fully undistorted three-dimensional views, they can be set up to provide a linear relationship between real and apparent depth and thus minimize erroneously perceived accelerations and decelerations for three sagittal planes, x = -w, x = 0, and x = +w which are indicated to the observer. Parallel cameras can be set up to provide fully undistorted three-dimensional views by controlling the location of the observer and by magnification and shifting of left and right images. In addition, the teachings of this disclosure can be used to provide methods of stereoscopic image presentation and stereoscopic camera configurations to produce a nonlinear relation between perceived and real depth, and erroneously produce or enhance perceived accelerations and decelerations in order to provide special effects for entertainment, training, or educational purposes

Scallop swimming kinematics and muscle performance: modelling the effects of "within-animal" variation in temperature sensitivity

Escape behaviour was investigated in Queen scallops (Aequipecten opercularis) acclimated to 5, 10 or 15 degrees C and tested at their acclimation temperature. Scallops are active molluscs, able to escape from predators by jet-propelled swimming using a striated muscle working in opposition to an elastic hinge ligament. The first cycle of the escape response was recorded using high-speed video ( 250 Hz) and whole-animal velocity and acceleration determined. Muscle shortening velocity, force and power output were calculated using measurements of valve movement and jet area, and a simple biomechanical model. The average shortening speed of the adductor muscle had a Q(10) of 2.04, significantly reducing the duration of the jetting phase of the cycle with increased temperature. Muscle lengthening velocity and the overall duration of the clap cycle were changed little over the range 5 - 15 degrees C, as these parameters were controlled by the relatively temperature-insensitive, hinge ligament. Improvements in the average power output of the adductor muscle over the first clap cycle ( 222 vs. 139 W kg(-1) wet mass at 15 and 5 degrees C respectively) were not translated into proportional increases in overall swimming velocity, which was only 32% higher at 15 degrees C ( 0.37m s(-1)) than 5 degrees C (0.28 m s(-1))

Higher Order of Motion Magnification for Vessel Identification in Surgical Video

Locating vessels during surgery is critical for avoiding inadvertent damage, yet vasculature can be difficult to identify. Video motion magnification can potentially highlight vessels by exaggerating subtle motion embedded within the video to become perceivable to the surgeon. In this paper, we explore a physiological model of artery distension to extend motion magnification to incorporate higher orders of motion, leveraging the difference in acceleration over time (jerk) in pulsatile motion to highlight the vascular pulse wave. Our method is compared to first and second order motion based Eulerian video magnification algorithms. Using data from a surgical video retrieved during a robotic prostatectomy, we show that our method can accentuate cardio-physiological features and produce a more succinct and clearer video for motion magnification, with more similarities in areas without motion to the source video at large magnifications. We validate the approach with a Structure Similarity (SSIM) and Peak Signal to Noise Ratio (PSNR) assessment of three videos at an increasing working distance, using three different levels of optical magnification. Spatio-temporal cross sections are presented to show the effectiveness of our proposal and video samples are provided to demonstrates qualitatively our results

Development of systems and techniques for landing an aircraft using onboard television

A flight program was conducted to develop a landing technique with which a pilot could consistently and safely land a remotely piloted research vehicle (RPRV) without outside visual reference except through television. Otherwise, instrumentation was standard. Such factors as the selection of video parameters, the pilot's understanding of the television presentation, the pilot's ground cockpit environment, and the operational procedures for landing were considered. About 30 landings were necessary for a pilot to become sufficiently familiar and competent with the test aircraft to make powered approaches and landings with outside visual references only through television. When steep approaches and landings were made by remote control, the pilot's workload was extremely high. The test aircraft was used as a simulator for the F-15 RPRV, and as such was considered to be essential to the success of landing the F-15 RPRV

Large scale Micro-Photometry for high resolution pH-characterization during electro-osmotic pumping and modular micro-swimming

Micro-fluidic pumps as well as artificial micro-swimmers are conveniently realized exploiting phoretic solvent flows based on local gradients of temperature, electrolyte concentration or pH. We here present a facile micro-photometric method for monitoring pH gradients and demonstrate its performance and scope on different experimental situations including an electro-osmotic pump and modular micro-swimmers assembled from ion exchange resin beads and polystyrene colloids. In combination with the present microscope and DSLR camera our method offers a 2 \mu m spatial resolution at video frame rate over a field of view of 3920x2602 \mu m^2. Under optimal conditions we achieve a pH-resolution of 0.05 with about equal contributions from statistical and systematical uncertainties. Our quantitative micro-photometric characterization of pH gradients which develop in time and reach out several mm is anticipated to provide valuable input for reliable modeling and simulations of a large variety of complex flow situations involving pH-gradients including artificial micro-swimmers, microfluidic pumping or even electro-convection.Comment: 5 figures, 15 page

Studies of the effects of gravitational and inertial forces on cardiovascular and respiratory dynamics Semiannual status report

Effects of gravitational and inertial forces on cardiovascular and respiratory dynamic

Performance trade-offs in the flight initiation of Drosophila

The fruit fly Drosophila melanogaster performs at least two distinct types of flight initiation. One kind is a stereotyped escape response to a visual stimulus that is mediated by the hard-wired giant fiber neural pathway, and the other is a more variable `voluntary' response that can be performed without giant fiber activation. Because the simpler escape take-offs are apparently successful, it is unclear why the fly has multiple pathways to coordinate flight initiation. In this study we use high-speed videography to observe flight initiation in unrestrained wild-type flies and assess the flight performance of each of the two types of take-off. Three-dimensional kinematic analysis of take-off sequences indicates that wing use during the jumping phase of flight initiation is essential for stabilizing flight. During voluntary take-offs, early wing elevation leads to a slower and more stable take-off. In contrast, during visually elicited escapes, the wings are pulled down close to the body during take-off, resulting in tumbling flights in which the fly translates faster but also rotates rapidly about all three of its body axes. Additionally, we find evidence that the power delivered by the legs is substantially greater during visually elicited escapes than during voluntary take-offs. Thus, we find that the two types of Drosophila flight initiation result in different flight performances once the fly is airborne, and that these performances are distinguished by a trade-off between speed and stability