Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs

We address the problem of making human motion capture in the wild more practical by using a small set of inertial sensors attached to the body. Since the problem is heavily under-constrained, previous methods either use a large number of sensors, which is intrusive, or they require additional video input. We take a different approach and constrain the problem by: (i) making use of a realistic statistical body model that includes anthropometric constraints and (ii) using a joint optimization framework to fit the model to orientation and acceleration measurements over multiple frames. The resulting tracker Sparse Inertial Poser (SIP) enables 3D human pose estimation using only 6 sensors (attached to the wrists, lower legs, back and head) and works for arbitrary human motions. Experiments on the recently released TNT15 dataset show that, using the same number of sensors, SIP achieves higher accuracy than the dataset baseline without using any video data. We further demonstrate the effectiveness of SIP on newly recorded challenging motions in outdoor scenarios such as climbing or jumping over a wall.Comment: 12 pages, Accepted at Eurographics 201

Human Motion Analysis Using Very Few Inertial Measurement Units

Realistic character animation and human motion analysis have become major topics of research. In this doctoral research work, three different aspects of human motion analysis and synthesis have been explored. Firstly, on the level of better management of tens of gigabytes of publicly available human motion capture data sets, a relational database approach has been proposed. We show that organizing motion capture data in a relational database provides several benefits such as centralized access to major freely available mocap data sets, fast search and retrieval of data, annotations based retrieval of contents, entertaining data from non-mocap sensor modalities etc. Moreover, the same idea is also proposed for managing quadruped motion capture data. Secondly, a new method of full body human motion reconstruction using very sparse configuration of sensors is proposed. In this setup, two sensor are attached to the upper extremities and one sensor is attached to the lower trunk. The lower trunk sensor is used to estimate ground contacts, which are later used in the reconstruction process along with the low dimensional inputs from the sensors attached to the upper extremities. The reconstruction results of the proposed method have been compared with the reconstruction results of the existing approaches and it has been observed that the proposed method generates lower average reconstruction errors. Thirdly, in the field of human motion analysis, a novel method of estimation of human soft biometrics such as gender, height, and age from the inertial data of a simple human walk is proposed. The proposed method extracts several features from the time and frequency domains for each individual step. A random forest classifier is fed with the extracted features in order to estimate the soft biometrics of a human. The results of classification have shown that it is possible with a higher accuracy to estimate the gender, height, and age of a human from the inertial data of a single step of his/her walk

Combining ground penetrating radar and seismic surveys in the assessment of cultural heritage buildings: The study of roofs, columns, and ground of the gothic church Santa Maria del Mar, in Barcelona (Spain)

Combined non-destructive techniques are applied in the study of a historical building in Barcelona. Santa Maria del Mar is a magnificent Mediterranean gothic church built between 1329 and 1383. Two of the most important characteristics of this building are the slender columns and the almost flat rooftop. This structure, used to create a visual impression of a unique space, transmits high loads to the tall columns. Previous to restoration, vaults, roofs, and columns were extensively assessed with non-destructive tests, in order to improve the knowledge of those structures. This information will be used in further simulations to analyse load distributions at each part of the structure. Ground and floor were also studied. The analysis of the columns was based on ground- penetrating radar (GPR) surveys and on seismic tomography. Finally, the dynamic behaviour of the structure was determined by seismic monitoring of the main nave and the bell tower. Results obtained at the radar survey highlight the existence of unexpected anomalies in homogeneous materials, supporting the hypothesis of an inner structure between arches and roof composed by hollow elements. Seismic tomography defined the inner geometry of the columns and detected some damage or lower quality stone in various zones. Seismic monitoring established the perfect junction between the bell tower and the main nave. GPR survey on the floor allowed detecting a large number of graves, and some images suggest the existence of large underground walls and some of the foundations of the main façade.Peer ReviewedPostprint (published version

Body sensor networks: smart monitoring solutions after reconstructive surgery

Advances in reconstructive surgery are providing treatment options in the face of major trauma and cancer. Body Sensor Networks (BSN) have the potential to offer smart solutions to a range of clinical challenges. The aim of this thesis was to review the current state of the art devices, then develop and apply bespoke technologies developed by the Hamlyn Centre BSN engineering team supported by the EPSRC ESPRIT programme to deliver post-operative monitoring options for patients undergoing reconstructive surgery. A wireless optical sensor was developed to provide a continuous monitoring solution for free tissue transplants (free flaps). By recording backscattered light from 2 different source wavelengths, we were able to estimate the oxygenation of the superficial microvasculature. In a custom-made upper limb pressure cuff model, forearm deoxygenation measured by our sensor and gold standard equipment showed strong correlations, with incremental reductions in response to increased cuff inflation durations. Such a device might allow early detection of flap failure, optimising the likelihood of flap salvage. An ear-worn activity recognition sensor was utilised to provide a platform capable of facilitating objective assessment of functional mobility. This work evolved from an initial feasibility study in a knee replacement cohort, to a larger clinical trial designed to establish a novel mobility score in patients recovering from open tibial fractures (OTF). The Hamlyn Mobility Score (HMS) assesses mobility over 3 activities of daily living: walking, stair climbing, and standing from a chair. Sensor-derived parameters including variation in both temporal and force aspects of gait were validated to measure differences in performance in line with fracture severity, which also matched questionnaire-based assessments. Monitoring the OTF cohort over 12 months with the HMS allowed functional recovery to be profiled in great detail. Further, a novel finding of continued improvements in walking quality after a plateau in walking quantity was demonstrated objectively. The methods described in this thesis provide an opportunity to revamp the recovery paradigm through continuous, objective patient monitoring along with self-directed, personalised rehabilitation strategies, which has the potential to improve both the quality and cost-effectiveness of reconstructive surgery services.Open Acces

Technology for an intelligent, free-flying robot for crew and equipment retrieval in space

Crew rescue and equipment retrieval is a Space Station Freedom requirement. During Freedom's lifetime, there is a high probability that a number of objects will accidently become separated. Members of the crew, replacement units, and key tools are examples. Retrieval of these objects within a short time is essential. Systems engineering studies were conducted to identify system requirements and candidate approaches. One such approach, based on a voice-supervised, intelligent, free-flying robot was selected for further analysis. A ground-based technology demonstration, now in its second phase, was designed to provide an integrated robotic hardware and software testbed supporting design of a space-borne system. The ground system, known as the EVA Retriever, is examining the problem of autonomously planning and executing a target rendezvous, grapple, and return to base while avoiding stationary and moving obstacles. The current prototype is an anthropomorphic manipulator unit with dexterous arms and hands attached to a robot body and latched in a manned maneuvering unit. A precision air-bearing floor is used to simulate space. Sensor data include two vision systems and force/proximity/tactile sensors on the hands and arms. Planning for a shuttle file experiment is underway. A set of scenarios and strawman requirements were defined to support conceptual development. Initial design activities are expected to begin in late 1989 with the flight occurring in 1994. The flight hardware and software will be based on lessons learned from both the ground prototype and computer simulations

Inertial sensors signal processing methods for gait analysis of patients with impaired gait patterns

Analiza hoda je postala široko rasprostranjen klinički alat koji se koristi za objektivnu evaluaciju obrasca hoda, efekata hirurških intervencija, oporavka ili efekata terapije. Sve veći broj kliničara bira pogodne tretmane za lečenje pacijenata na osnovu informacija o kinematici i kinetici hoda. Procena i kvantifikacija parametara hoda je važan zahtev u oblasti ortopedije i rehabilitacije, ali takođe i u sportu, rekreaciji i posebno u razvoju tehnologija za ljude u procesu starenja. U cilju objektivne procene obrasca hoda, razvijen je bežični senzorski sistem čije su senzorske jedinice bežične, malih dimenzija i jednostavno se montiraju na segmente nogu subjekta čiji se hoda analizira. Senzorske jedinice podržavaju 3D inercijalne senzore (senzore ubrzanja i ugaonih brzina, tj. akcelerometre i žiroskope), kao i senzore sile. Osnovni cilj istraživanja je doprinos metodologiji za obradu podataka sa inercijalnih senzora i razvoj novih metoda obrade signala sa inercijalnih senzora u procesu određivanja kinematičkih veličina koje su uobičajene u analizi hoda (uglovi u zglobovima, brzina kretanja, dužina koraka). Ova metodologija je od posebne važnosti za objektivnu procenu nivoa motornog deficita, progresa bolesti i efikasnosti terapija, kao i efikasnosti primenjene motorne kontrole (prilikom funkcionalne električne stimulacije). U toku istraživanja razvijeno je nekoliko metoda za računanje uglova segmenata nogu ili zglobova, u zavisnosti od senzorske konfiguracije i složenosti algoritma. U disertaciji su odvojeno prikazani slučajevi u kojima je neophodno posmatrati kretanje u prostoru (3D analiza) i mnogo češći slučaj kad se kinematika može redukovati na sagitalnu ravan (2D analiza). Algoritmi uključuju i kalibraciju senzora, eliminaciju viii drifta, rekonstrukciju trajektorije i izračunavanje niza drugih relevantnih podataka koji karakterišu obrazac hoda. Dobijeni rezultati su poređeni sa postojećim sistemima za analizu hoda koji su validirani za kliničke primene. (sistemi sa kamerama, goniometri, enkoderi)...Gait analysis has become a widely used clinical tool which provides objective evaluation of the gait pattern, the effects of surgical interventions, recovery or therapy progress, and more and more clinicians are choosing therapy treatments based on gait kinematics and kinetics. Measuring gait parameters is an important requirement in the orthopedic and rehabilitation fields, but also in sports and fitness, and development of technologies for elderly population. In order to provide objective evaluation of the gait pattern, we have developed sensor system with light and small wireless sensor units, which can be easily mounted on body. These sensor units comprise 3-D inertial sensors (accelerometers and gyroscopes) and force sensing resistors, and our recommended setup includes one sensor unit per each segment of both legs. The main goal of this research is contribution to the methodology for processing of signals from inertial sensors (accelerometer pairs, or accelerometer and gyroscope sensor units). By using signal processing algorithms developed for this research, inertial sensors allow objective assessment of the quality of the gait pattern. This methodology is especially important for assessment of the motor deficit, progress of the disease and therapy effectiveness, and effectiveness of performed motor control (functional electrical stimulation). We have developed several methods for estimation of leg segment angles and joint angles, which differ in sensor configuration and algorithm complexity. Methods based only on accelerometers offer reliable angle estimations, which are limited to sagittal plane analysis, while the method using accelerometers and gyroscopes allows 3- D analysis. All this algorithms include sensor calibration, drift minimization, trajectory x reconstruction and calculation of numerous other parameters relevant to gait pattern analysis. The obtained results were compared with other commercial systems which are validated for clinical applications (camera systems, goniometers, encoders)..

Bridges Structural Health Monitoring and Deterioration Detection Synthesis of Knowledge and Technology

INE/AUTC 10.0

Study of direct versus orbital entry for Mars missions. Volume 6 - Appendix D - Subsystem studies and parametric data Final report

Subsystems analyses and parametric data on configurations for direct versus orbital entry for Mars mission