ANALYSIS OF VOCAL FOLD KINEMATICS USING HIGH SPEED VIDEO

Vocal folds are the twin in-folding of the mucous membrane stretched horizontally across the larynx. They vibrate modulating the constant air flow initiated from the lungs. The pulsating pressure wave blowing through the glottis is thus the source for voiced speech production. Study of vocal fold dynamics during voicing are critical for the treatment of voice pathologies. Since the vocal folds move at 100 - 350 cycles per second, their visual inspection is currently done by strobosocopy which merges information from multiple cycles to present an apparent motion. High Speed Digital Laryngeal Imaging(HSDLI) with a temporal resolution of up to 10,000 frames per second has been established as better suited for assessing the vocal fold vibratory function through direct recording. But the widespread use of HSDLI is limited due to lack of consensus on the modalities like features to be examined. Development of the image processing techniques which circumvents the need for the tedious and time consuming effort of examining large volumes of recording has room for improvement. Fundamental questions like the required frame rate or resolution for the recordings is still not adequately answered. HSDLI cannot get the absolute physical measurement of the anatomical features and vocal fold displacement. This work addresses these challenges through improved signal processing. A vocal fold edge extraction technique with subpixel accuracy, suited even for hard to record pediatric population is developed first. The algorithm which is equally applicable for pediatric and adult subjects, is implemented to facilitate user inspection and intervention. Objective features describing the fold dynamics, which are extracted from the edge displacement waveform are proposed and analyzed on a diverse dataset of healthy males, females and children. The sampling and quantization noise present in the recordings are analyzed and methods to mitigate them are investigated. A customized Kalman smoothing and spline interpolation on the displacement waveform is found to improve the feature estimation stability. The relationship between frame rate, spatial resolution and vibration for efficient capturing of information is derived. Finally, to address the inability to measure physical measurement, a structured light projection calibrated with respect to the endoscope is prototyped

Knee Joint Angle Measuring Portable Embedded System based on Inertial Measurement Units for Gait Analysis

Inside clinical research, gait analysis is a fundamental part of the functional evaluation of the human body's movement. Its evaluation has been carried out through different methods and tools, which allow early diagnosis of diseases, and monitoring and assessing the effectiveness of therapeutic plans applied to patients for rehabilitation. The observational method is one of the most used in specialized centers in Colombia; however, to avoid any possible errors associated with the subjectivity observation, technological tools that provide quantitative data can support this method. This paper deals with the methodological process for developing a computational tool and hardware device for the analysis of gait, specifically on articular kinematics of the knee.  This work develops a prototype based on the fusion of inertial measurement units (IMU) data as an alternative for the attenuation of errors associated with each of these technologies. A videogrammetry technique measured the same human gait patterns to validate the proposed system, in terms of accuracy and repeatability of the recorded data. Results showed that the developed prototype successfully captured the knee-joint angles of the flexion-extension motions with high consistency and accuracy in with the measurements obtained from the videogrammetry technique. Statistical analysis (ICC and RMSE) exhibited a high correlation between the two systems for the measures of the joint angles. These results suggest the possibility of using an IMU-based prototype in realistic scenarios for accurately tracking a patient’s knee-joint kinematics during a human gait

Quaternionic Attitude Estimation with Inertial Measuring Unit for Robotic and Human Body Motion Tracking using Sequential Monte Carlo Methods with Hyper-Dimensional Spherical Distributions

This dissertation examined the inertial tracking technology for robotics and human tracking applications. This is a multi-discipline research that builds on the embedded system engineering, Bayesian estimation theory, software engineering, directional statistics, and biomedical engineering. A discussion of the orientation tracking representations and fundamentals of attitude estimation are presented briefly to outline the some of the issues in each approach. In addition, a discussion regarding to inertial tracking sensors gives an insight to the basic science and limitations in each of the sensing components. An initial experiment was conducted with existing inertial tracker to study the feasibility of using this technology in human motion tracking. Several areas of improvement were made based on the results and analyses from the experiment. As the performance of the system relies on multiple factors from different disciplines, the only viable solution is to optimize the performance in each area. Hence, a top-down approach was used in developing this system. The implementations of the new generation of hardware system design and firmware structure are presented in this dissertation. The calibration of the system, which is one of the most important factors to minimize the estimation error to the system, is also discussed in details. A practical approach using sequential Monte Carlo method with hyper-dimensional statistical geometry is taken to develop the algorithm for recursive estimation with quaternions. An analysis conducted from a simulation study provides insights to the capability of the new algorithms. An extensive testing and experiments was conducted with robotic manipulator and free hand human motion to demonstrate the improvements with the new generation of inertial tracker and the accuracy and stability of the algorithm. In addition, the tracking unit is used to demonstrate the potential in multiple biomedical applications including kinematics tracking and diagnosis instrumentation. The inertial tracking technologies presented in this dissertation is aimed to use specifically for human motion tracking. The goal is to integrate this technology into the next generation of medical diagnostic system

High-accuracy Motion Estimation for MEMS Devices with Capacitive Sensors

With the development of micro-electro-mechanical system (MEMS) technologies, emerging MEMS applications such as in-situ MEMS IMU calibration, medical imaging via endomicroscopy, and feedback control for nano-positioning and laser scanning impose needs for especially accurate measurements of motion using on-chip sensors. Due to their advantages of simple fabrication and integration within system level architectures, capacitive sensors are a primary choice for motion tracking in those applications. However, challenges arise as often the capacitive sensing scheme in those applications is unconventional due to the nature of the application and/or the design and fabrication restrictions imposed, and MEMS sensors are traditionally susceptible to accuracy errors, as from nonlinear sensor behavior, gain and bias drift, feedthrough disturbances, etc. Those challenges prevent traditional sensing and estimation techniques from fulfilling the accuracy requirements of the candidate applications. The goal of this dissertation is to provide a framework for such MEMS devices to achieve high-accuracy motion estimation, and specifically to focus on innovative sensing and estimation techniques that leverage unconventional capacitive sensing schemes to improve estimation accuracy. Several research studies with this specific aim have been conducted, and the methodologies, results and findings are presented in the context of three applications. The general procedure of the study includes proposing and devising the capacitive sensing scheme, deriving a sensor model based on first principles of capacitor configuration and sensing circuit, analyzing the sensor’s characteristics in simulation with tuning of key parameters, conducting experimental investigations by constructing testbeds and identifying actuation and sensing models, formulating estimation schemes is to include identified actuation dynamics and sensor models, and validating the estimation schemes and evaluating their performance against ground truth measurements. The studies show that the proposed techniques are valid and effective, as the estimation schemes adopted either fulfill the requirements imposed or improve the overall estimation performance. Highlighted results presented in this dissertation include a scale factor calibration accuracy of 286 ppm for a MEMS gyroscope (Chapter 3), an improvement of 15.1% of angular displacement estimation accuracy by adopting a threshold sensing technique for a scanning micro-mirror (Chapter 4), and a phase shift prediction error of 0.39 degree for a electrostatic micro-scanner using shared electrodes for actuation and sensing (Chapter 5).PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/147568/1/davidsky_1.pd

Testing of the Possibilities of Using IMUs with Different Types of Movements

Inertial navigation system (INS) is a self-contained navigation technique. Its main purpose is to determinate the position and the trajectory of the object´s movement in space. This technique is well represented not only as a supplementary method (GPS/INS integrated system) but as an autonomous system for navigation of vehicles and pedestrians, also. The aim of this paper is to design a test for low-cost inertial measurement units. The test results give us information about accuracy, which determine the possible use in indoor navigation or other applications. There are described some methods for processing the data obtained by inertial measurement units, which remove noise and improve accuracy of position and orientation

Danae++: A smart approach for denoising underwater attitude estimation

One of the main issues for the navigation of underwater robots consists in accurate vehicle positioning, which heavily depends on the orientation estimation phase. The systems employed to this end are affected by different noise typologies, mainly related to the sensors and to the irregular noise of the underwater environment. Filtering algorithms can reduce their effect if opportunely con-figured, but this process usually requires fine techniques and time. This paper presents DANAE++, an improved denoising autoencoder based on DANAE (deep Denoising AutoeNcoder for Attitude Estimation), which is able to recover Kalman Filter (KF) IMU/AHRS orientation estimations from any kind of noise, independently of its nature. This deep learning-based architecture already proved to be robust and reliable, but in its enhanced implementation significant improvements are obtained in terms of both results and performance. In fact, DANAE++ is able to denoise the three angles describing the attitude at the same time, and that is verified also using the estimations provided by an extended KF. Further tests could make this method suitable for real-time applications in navigation tasks

Using BP Neural Network and Kalman Filter to Signal Processing of MEMS Inertial Sensors

The paper put forward using BP neural network and Kalman filter to signal processing of MEMS inertial sensors. This paper uses Kalman filter value for information fusion of gyroscope and accelerometer, and the attitude angle is accurate. The state and observation equation of attitude angle measuring system with characteristic of BP neural network, and the design of the Kalman filter is simple and gyroscope measurement information data fusion, the preparation of the corresponding MATLAB program Kalman filter is designed. Through the simulation results of the image, this method can compensate the zero drift of gyroscope, improves the measurement precision of the attitude angle

Entwicklung und Implementierung eines Peer-to-Peer Kalman Filters für Fußgänger- und Indoor-Navigation

Smartphones are an integral part of our society by now. They are used for messaging, searching the Internet, working on documents, and of course for navigation. Although smartphones are also used for car navigation their main area of application is pedestrian navigation. Almost all smartphones sold today comprise a GPS L1 receiver which provides position computation with accuracy between 1 and 10 m as long as the environment in beneficial, i.e. the line-of-sight to satellites is not obstructed by trees or high buildings. But this is often the case in areas where smartphones are used primarily for navigation. Users walk in narrow streets with high density, in city centers, enter, and leave buildings and the smartphone is not able to follow their movement because it loses satellite signals. The approach presented in this thesis addresses the problem to enable seamless navigation for the user independently of the current environment and based on cooperative positioning and inertial navigation. It is intended to realize location-based services in areas and buildings with limited or no access to satellite data and a large amount of users like e.g. shopping malls, city centers, airports, railway stations and similar environments. The idea of this concept was for a start based on cooperative positioning between users’ devices denoted here as peers moving within an area with only limited access to satellite signals at certain places (windows, doors) or no access at all. The devices are therefore not able to provide a position by means of satellite signals. Instead of deploying solutions based on infrastructure, surveying, and centralized computations like range measurements, individual signal strength, and similar approaches a decentralized concept was developed. This concept suggests that the smartphone automatically detects if no satellite signals are available and uses its already integrated inertial sensors like magnetic field sensor, accelerometer, and gyroscope for seamless navigation. Since the quality of those sensors is very low the accuracy of the position estimation decreases with each step of the user. To avoid a continuously growing bias between real position and estimated position an update has to be performed to stabilize the position estimate. This update is either provided by the computation of a position based on satellite signals or if signals are not available by the exchange of position data with another peer in the near vicinity using peer-to-peer ad-hoc networks. The received and the own position are processed in a Kalman Filter algorithm and the result is then used as new position estimate and new start position for further navigation based on inertial sensors. The here presented concept is therefore denoted as Peer-to-Peer Kalman Filter (P2PKF)

Innovative Solutions for Navigation and Mission Management of Unmanned Aircraft Systems

The last decades have witnessed a significant increase in Unmanned Aircraft Systems (UAS) of all shapes and sizes. UAS are finding many new applications in supporting several human activities, offering solutions to many dirty, dull, and dangerous missions, carried out by military and civilian users. However, limited access to the airspace is the principal barrier to the realization of the full potential that can be derived from UAS capabilities. The aim of this thesis is to support the safe integration of UAS operations, taking into account both the user's requirements and flight regulations. The main technical and operational issues, considered among the principal inhibitors to the integration and wide-spread acceptance of UAS, are identified and two solutions for safe UAS operations are proposed: A. Improving navigation performance of UAS by exploiting low-cost sensors. To enhance the performance of the low-cost and light-weight integrated navigation system based on Global Navigation Satellite System (GNSS) and Micro Electro-Mechanical Systems (MEMS) inertial sensors, an efficient calibration method for MEMS inertial sensors is required. Two solutions are proposed: 1) The innovative Thermal Compensated Zero Velocity Update (TCZUPT) filter, which embeds the compensation of thermal effect on bias in the filter itself and uses Back-Propagation Neural Networks to build the calibration function. Experimental results show that the TCZUPT filter is faster than the traditional ZUPT filter in mapping significant bias variations and presents better performance in the overall testing period. Moreover, no calibration pre-processing stage is required to keep measurement drift under control, improving the accuracy, reliability, and maintainability of the processing software; 2) A redundant configuration of consumer grade inertial sensors to obtain a self-calibration of typical inertial sensors biases. The result is a significant reduction of uncertainty in attitude determination. In conclusion, both methods improve dead-reckoning performance for handling intermittent GNSS coverage. B. Proposing novel solutions for mission management to support the Unmanned Traffic Management (UTM) system in monitoring and coordinating the operations of a large number of UAS. Two solutions are proposed: 1) A trajectory prediction tool for small UAS, based on Learning Vector Quantization (LVQ) Neural Networks. By exploiting flight data collected when the UAS executes a pre-assigned flight path, the tool is able to predict the time taken to fly generic trajectory elements. Moreover, being self-adaptive in constructing a mathematical model, LVQ Neural Networks allow creating different models for the different UAS types in several environmental conditions; 2) A software tool aimed at supporting standardized procedures for decision-making process to identify UAS/payload configurations suitable for any type of mission that can be authorized standing flight regulations. The proposed methods improve the management and safe operation of large-scale UAS missions, speeding up the flight authorization process by the UTM system and supporting the increasing level of autonomy in UAS operations