Spatial Data Performance Test of Mid-cost UAS with Direct Georeferencing

Recent development of lightweight and small size multi-frequency GNSS receivers allows determination of the precise position of the moving platform and spatial data acquisition without the need for setting up and measuring of ground control points. The main advantage of this approach is a higher operational capacity with reduced time and cost of field measurement. This relates to fieldwork in inaccessible areas with demanding terrain configuration. In this paper development and use of a UAS with direct georeferencing of camera sensor for spatial data acquisition is described, and the possibility of 3D scene reconstruction based on the precise position of the camera with predetermined interior parameters is examined. Modern computer vision-based SfM photogrammetry algorithms are used for determining attitude parameters and reconstruction of the scene. For that purpose, several tests on two different test fields were performed using various system parameters for collecting and analysis of several spatial data sets. The presented results demonstrate a satisfactory accuracy (3.1 cm planar and 6.4 cm spatial) of the system for various applications in geodesy

Software Tools and Analysis Methods for the Use of Electromagnetic Articulography Data in Speech Research

Recent work with Electromagnetic Articulography (EMA) has shown it to be an excellent tool for characterizing speech kinematics. By tracking the position and orientation of sensors placed on the jaws, lips, teeth and tongue as they move in an electromagnetic field, information about movement and coordination of the articulators can be obtained with great time resolution. This technique has far-reaching applications for advancing fields related to speech articulation, including recognition, synthesis, motor learning, and clinical assessments. As more EMA data becomes widely available, a growing need exists for software that performs basic processing and analysis functions. The objective of this work is to create and demonstrate the use of new software tools that make full use of the information provided in EMA datasets, with a goal of maximizing the impact of EMA research. A new method for biteplate-correcting orientation data is presented, allowing orientation data to be used for articulatory analysis. Two examples of applications using orientation data are presented: a tool for jaw-angle measurement using a single EMA sensor, and a tongue interpolation tool based on three EMA sensors attached to the tongue. The results demonstrate that combined position and orientation data give a more complete picture of articulation than position data alone, and that orientation data should be incorporated in future work with EMA. A new standalone, GUI-based software tool is also presented for visualization of EMA data. It includes simultaneous real-time playback of kinematic and acoustic data, as well as basic analysis capabilities for both types of data. A comparison of the visualization tool to existing EMA software shows that it provides superior visualization and comparable analysis features to existing software. The tool will be included with the Marquette University EMA-MAE database to aid researchers working with this dataset

Detecting fish aggregations from reef habitats mapped with high resolution side scan sonar imagery

As part of a multibeam and side scan sonar (SSS) benthic survey of the Marine Conservation District (MCD) south of St. Thomas, USVI and the seasonal closed areas in St. Croix—Lang Bank (LB) for red hind (Epinephelus guttatus) and the Mutton Snapper (MS) (Lutjanus analis) area—we extracted signals from water column targets that represent individual and aggregated fish over various benthic habitats encountered in the SSS imagery. The survey covered a total of 18 km2 throughout the federal jurisdiction fishery management areas. The complementary set of 28 habitat classification digital maps covered a total of 5,462.3 ha; MCDW (West) accounted for 45% of that area, and MCDE (East) 26%, LB 17%, and MS the remaining 13%. With the exception of MS, corals and gorgonians on consolidated habitats were significantly more abundant than submerged aquatic vegetation (SAV) on unconsolidated sediments or unconsolidated sediments. Continuous coral habitat was the most abundant consolidated habitat for both MCDW and MCDE (41% and 43% respectively). Consolidated habitats in LB and MS predominantly consisted of gorgonian plain habitat with 95% and 83% respectively. Coral limestone habitat was more abundant than coral patch habitat; it was found near the shelf break in MS, MCDW, and MCDE. Coral limestone and coral patch habitats only covered LB minimally. The high spatial resolution (0.15 m) of the acquired imagery allowed the detection of differing fish aggregation (FA) types. The largest FA densities were located at MCDW and MCDE over coral communities that occupy up to 70% of the bottom cover. Counts of unidentified swimming objects (USOs), likely representing individual fish, were similar among locations and occurred primarily over sand and shelf edge areas. Fish aggregation school sizes were significantly smaller at MS than the other three locations (MCDW, MCDE, and LB). This study shows the advantages of utilizing SSS in determining fish distributions and density

Validation of map matching algorithms using high precision positioning with GPS

Map Matching (MM) algorithms are usually employed for a range of transport telematics applications to correctly identify the physical location of a vehicle travelling on a road network. Two essential components for MM algorithms are (1) navigation sensors such as the Global Positioning System (GPS) and dead reckoning (DR), among others, to estimate the position of the vehicle, and (2) a digital base map for spatial referencing of the vehicle location. Previous research by the authors (Quddus et al., 2003; Ochieng et al., 2003) has developed improved MM algorithms that take account of the vehicle speed and the error sources associated with the navigation sensors and the digital map data previously ignored in conventional MM approaches. However, no validation study assessing the performance of MM algorithms has been presented in the literature. This paper describes a generic validation strategy and results for the MM algorithm previously developed in Ochieng et al. (2003). The validation technique is based on a higher accuracy reference (truth) of the vehicle trajectory as determined by high precision positioning achieved by the carrier-phase observable from GPS. The results show that the vehicle positions determined from the MM results are within 6 m of the true positions. The results also demonstrate the importance of the quality of the digital map data to the map matching process

Quantitative Assessment of Upper Limb Motion in Neurorehabilitation Utilizing Inertial Sensors

Two inertial sensor systems were developed for 3-D tracking of upper limb movement. One utilizes four sensors and a kinematic model to track the positions of all four upper limb segments/joints and the other uses one sensor and a dead reckoning algorithm to track a single upper limb segment/joint. Initial evaluation indicates that the system using the kinematic model is able to track orientation to 1 degree and position to within 0.1 cm over a distance of 10 cm. The dead reckoning system combined with the “zero velocity update” correction can reduce errors introduced through double integration of errors in the estimate in offsets of the acceleration from several meters to 0.8% of the total movement distance. Preliminary evaluation of the systems has been carried out on ten healthy volunteers and the kinematic system has also been evaluated on one patient undergoing neurorehabilitation over a period of ten weeks. The initial evaluation of the two systems also shows that they can monitor dynamic information of joint rotation and position and assess rehabilitation process in an objective way, providing additional clinical insight into the rehabilitation process

Development of Kinematic Templates for Automatic Pronunciation Assessment Using Acoustic-to-Articulatory Inversion

Computer-aided pronunciation training (CAPT) is a subcategory of computer-aided language learning (CALL) that deals with the correction of mispronunciation during language learning. For a CAPT system to be effective, it must provide useful and informative feedback that is comprehensive, qualitative, quantitative, and corrective. While the majority of modern systems address the first 3 aspects of feedback, most of these systems do not provide corrective feedback. As part of the National Science Foundation (NSF) funded study “RI: Small: Speaker Independent Acoustic-Articulator Inversion for Pronunciation Assessment”, the Marquette Speech and Swallowing Lab and Marquette Speech and Signal Processing Lab are conducting a pilot study on the feasibility of the use of acoustic-to-articulatory inversion for CAPT. In order to evaluate the results of a speaker’s acoustic-to-articulatory inversion to determine pronunciation accuracy, kinematic templates are required. The templates would represent the vowels, consonant clusters, and stress characteristics of a typical American English (AE) speaker in the midsagittal plane. The Marquette University electromagnetic articulography Mandarin-accented English (EMA-MAE) database, which contains acoustic and kinematic speech data for 40 speakers (20 of which are native AE speakers), provides the data used to form the kinematic templates. The objective of this work is the development and implementation of these templates. The data provided in the EMA-MAE database is analyzed in detail, and the information obtained from the analysis is used to develop the kinematic templates. The vowel templates are designed as sets of concentric confidence ellipses, which specify (in the midsagittal plane) the ranges of tongue and lip positions corresponding to correct pronunciation. These ranges were defined using the typical articulator positioning of all English speakers of the EMA-MAE database. The data from these English speakers were also used to model the magnitude, speed history, movement pattern, and duration (MSTD) features of each consonant cluster in the EMA-MAE corpus. Cluster templates were designed as set of average MSTD parameters across English speakers for each cluster. Finally, English stress characteristics were similarly modeled as a set of average magnitude, speed, and duration parameters across English speakers. The kinematic templates developed in this work, while still in early stages, form the groundwork for assessment of features returned by the acoustic-to-articulatory inversion system. This in turn allows for assessment of articulatory inversion as a pronunciation training tool