The visual microphone: Passive recovery of sound from video

When sound hits an object, it causes small vibrations of the object's surface. We show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects---a glass of water, a potted plant, a box of tissues, or a bag of chips---into visual microphones. We recover sounds from high-speed footage of a variety of objects with different properties, and use both real and simulated data to examine some of the factors that affect our ability to visually recover sound. We evaluate the quality of recovered sounds using intelligibility and SNR metrics and provide input and recovered audio samples for direct comparison. We also explore how to leverage the rolling shutter in regular consumer cameras to recover audio from standard frame-rate videos, and use the spatial resolution of our method to visualize how sound-related vibrations vary over an object's surface, which we can use to recover the vibration modes of an object.Qatar Computing Research InstituteNational Science Foundation (U.S.) (CGV-1111415)National Science Foundation (U.S.). Graduate Research Fellowship (Grant 1122374)Massachusetts Institute of Technology. Department of MathematicsMicrosoft Research (PhD Fellowship

Small business innovation research. Abstracts of completed 1987 phase 1 projects

Non-proprietary summaries of Phase 1 Small Business Innovation Research (SBIR) projects supported by NASA in the 1987 program year are given. Work in the areas of aeronautical propulsion, aerodynamics, acoustics, aircraft systems, materials and structures, teleoperators and robotics, computer sciences, information systems, spacecraft systems, spacecraft power supplies, spacecraft propulsion, bioastronautics, satellite communication, and space processing are covered

Measurement and analysis of breath sounds

Existing breath sound measurement systems and possible new methods have been critically investigated. The frequency response of each part of the measurement system has been studied. Emphasis has been placed on frequency response of acoustic sensors; especially, a method to study a diaphragm type air-coupler in contact use has been proposed. Two new methods of breath sounds measurement have been studied: laser Doppler vibrometer and mobile phones. It has been shown that these two methods can find applications in breath sounds measurement, however there are some restrictions. A reliable automatic wheeze detection algorithm based on auditory modelling has been developed. That is the human’s auditory system is modelled as a bank of band pass filters, in which the bandwidths are frequency dependent. Wheezes are treated as signals additive to normal breath sounds (masker). Thus wheeze is detectable when it is above the masking threshold. This new algorithm has been validated using simulated and real data. It is superior to previous algorithms, being more reliable to detect wheezes and less prone to mistakes. Simulation of cardiorespiratory sounds and wheeze audibility tests have been developed. Simulated breath sounds can be used as a training tool, as well as an evaluation method. These simulations have shown that, under certain circumstance, there are wheezes but they are inaudible. It is postulated that this could also happen in real measurements. It has been shown that simulated sounds with predefined characteristics can be used as an objective method to evaluate automatic algorithms. Finally, the efficiency and necessity of heart sounds reduction procedures has been investigated. Based on wavelet decomposition and selective synthesis, heart sounds can be reduced with a cost of unnatural breath sounds. Heart sound reduction is shown not to be necessary if a time-frequency representation is used, as heart sounds have a fixed pattern in the time-frequency plane

Avionics test bed development plan

A development plan for a proposed avionics test bed facility for the early investigation and evaluation of new concepts for the control of large space structures, orbiter attached flex body experiments, and orbiter enhancements is presented. A distributed data processing facility that utilizes the current laboratory resources for the test bed development is outlined. Future studies required for implementation, the management system for project control, and the baseline system configuration are defined. A background analysis of the specific hardware system for the preliminary baseline avionics test bed system is included

Office of Exploration: Exploration studies technical report. Volume 2: Studies approach and results

The NASA Office of Exploration has been tasked with defining and recommending alternatives for an early 1990's national decision on a focused program of human exploration of the solar system. The Mission Analysis and System Engineering (MASE) group, which is managed by the Exploration Studies Office at the Johnson Space Center, is responsible for coordinating the technical studies necessary for accomplishing such a task. This technical report describes the process that has been developed in a case study approach. The four case studies that were developed in FY88 include: (1) human expedition to Phobos; (2) human expeditions to Mars; (3) lunar observatory; and (4) lunar outpost to early Mars evolution. The final outcome of this effort is a set of programmatic and technical conclusions and recommendations for the following year's work. Volume 2 describes the case study process, the technical results of each of the case studies, and opportunities for additional study. Included in the discussion of each case study is a description of the mission key features and profile. Mission definition and manifesting are detailed, followed by a description of the mission architecture and infrastructure. Systems concepts for the required orbital nodes, transportation systems, and planetary surface systems are discussed. Prerequisite implementation plans resulting from the synthesized case studies are described and in-depth assessments are presented

Guidebook on Detection Technologies and Systems for Humanitarian Demining

The aim of this publication is to provide the mine action community, and those supporting mine action, with a consolidated review and status summary of detection technologies that could be applied to humanitarian demining operations. This Guidebook is meant to provide information to a wide variety of readers. For those not familiar with the spectrum of technologies being considered for the detection of landmines and for area reduction, there is a brief overview of the principle of operation for each technology as well as a summary listing of the strengths, limitations, and potential for use of the technology to humanitarian demining. For those with an intermediate level of understanding for detection technologies, there is information regarding some of the more technical details of the system to give an expanded overview of the principles involved and hardware development that has taken place. Where possible, technical specifications for the systems are provided. For those requiring more information for a particular system, relevant publications lists and contact information are also provided

State of the art 3D technologies and MVV end to end system design

L’oggetto del presente lavoro di tesi è costituito dall’analisi e dalla recensione di tutte le tecnologie 3D: esistenti e in via di sviluppo per ambienti domestici; tenendo come punto di riferimento le tecnologie multiview video (MVV). Tutte le sezioni della catena dalla fase di cattura a quella di riproduzione sono analizzate. Lo scopo è di progettare una possibile architettura satellitare per un futuro sistema MVV televisivo, nell’ambito di due possibili scenari, broadcast o interattivo. L’analisi coprirà considerazioni tecniche, ma anche limitazioni commerciali

Aeronautical engineering: A continuing bibliography with indexes (supplement 240)

This bibliography lists 629 reports, articles, and other documents introduced into the NASA scientific and technical information system in May, 1989. Subject coverage includes: design, construction and testing of aircraft and aircraft engines; aircraft components, equipment and systems; ground support systems; and theoretical and applied aspects of aerodynamics and general fluid dynamics

The 1995 NASA guide to graduate support

The future of the United States is in the classrooms of America and tomorrow's scientific and technological capabilities are derived from today's investments in research. In 1980, NASA initiated the Graduate Student Researchers Program (GSRP) to cultivate additional research ties to the academic community and to support promising students pursuing advanced degrees in science and engineering. Since then, approximately 1300 students have completed the program's requirements. In 1987, the program was expanded to include the Underrepresented Minority and Disabled Focus (UMDF) Component. This program was designed to increase participation of underrepresented groups in graduate study and research and, ultimately, in space science and aerospace technology careers. Approximately 270 minority students have completed the program's requirements while making significant contributions to the nation's aerospace efforts. Continuing to expand fellowship opportunities, NASA announced the Graduate Student Fellowships in Global Change Research in 1990. Designed to support the rapid growth in the study of earth as a system, more than 250 fellowships have been awarded. And, in 1992, NASA announced opportunities in the multiagency High Performance Computing and Communications (HPCC) Program designed to accelerate the development and application of massively parallel processing. Approximately five new fellowships will be awarded yearly. This booklet will guide you in your efforts to participate in programs for graduate student support