Sample Efficient Optimization for Learning Controllers for Bipedal Locomotion

Learning policies for bipedal locomotion can be difficult, as experiments are expensive and simulation does not usually transfer well to hardware. To counter this, we need al- gorithms that are sample efficient and inherently safe. Bayesian Optimization is a powerful sample-efficient tool for optimizing non-convex black-box functions. However, its performance can degrade in higher dimensions. We develop a distance metric for bipedal locomotion that enhances the sample-efficiency of Bayesian Optimization and use it to train a 16 dimensional neuromuscular model for planar walking. This distance metric reflects some basic gait features of healthy walking and helps us quickly eliminate a majority of unstable controllers. With our approach we can learn policies for walking in less than 100 trials for a range of challenging settings. In simulation, we show results on two different costs and on various terrains including rough ground and ramps, sloping upwards and downwards. We also perturb our models with unknown inertial disturbances analogous with differences between simulation and hardware. These results are promising, as they indicate that this method can potentially be used to learn control policies on hardware.Comment: To appear in International Conference on Humanoid Robots (Humanoids '2016), IEEE-RAS. (Rika Antonova and Akshara Rai contributed equally

Computational neurorehabilitation: modeling plasticity and learning to predict recovery

Despite progress in using computational approaches to inform medicine and neuroscience in the last 30 years, there have been few attempts to model the mechanisms underlying sensorimotor rehabilitation. We argue that a fundamental understanding of neurologic recovery, and as a result accurate predictions at the individual level, will be facilitated by developing computational models of the salient neural processes, including plasticity and learning systems of the brain, and integrating them into a context specific to rehabilitation. Here, we therefore discuss Computational Neurorehabilitation, a newly emerging field aimed at modeling plasticity and motor learning to understand and improve movement recovery of individuals with neurologic impairment. We first explain how the emergence of robotics and wearable sensors for rehabilitation is providing data that make development and testing of such models increasingly feasible. We then review key aspects of plasticity and motor learning that such models will incorporate. We proceed by discussing how computational neurorehabilitation models relate to the current benchmark in rehabilitation modeling – regression-based, prognostic modeling. We then critically discuss the first computational neurorehabilitation models, which have primarily focused on modeling rehabilitation of the upper extremity after stroke, and show how even simple models have produced novel ideas for future investigation. Finally, we conclude with key directions for future research, anticipating that soon we will see the emergence of mechanistic models of motor recovery that are informed by clinical imaging results and driven by the actual movement content of rehabilitation therapy as well as wearable sensor-based records of daily activity

Biosensing platform combining label-free and labelled analysis using Bloch surface waves

Bloch surface waves (BSW) propagating at the boundary of truncated photonic crystals (1D-PC) have emerged as an attractive approach for label-free sensing in plasmon-like sensor configurations. Due to the very low losses in such dielectric thin film stacks, BSW feature very low angular resonance widths compared to the surface plasmon resonance (SPR) case. Besides label-free operation, the large field enhancement and the absence of quenching allow utilizing BSW coupled fluorescence detection to additionally sense the presence of fluorescent labels. This approach can be adapted to the case of angularly resolved resonance detection, thus giving rise to a combined label-free / labelled biosensor platform. It features a parallel analysis of multiple spots arranged as a one-dimensional array inside a microfluidic channel of a disposable chip. Application of such a combined biosensing approach to the detection of the Angiopoietin-2 cancer biomarker in buffer solutions is reported

Aggregating multiple body sensors for analysis in sports

Real time monitoring of the wellness of sportspersons, during their sporting activity and training, is important in order to maximise performance during the sporting event itself and during training, as well as being important for the health of the sportsperson overall. We have combined a suite of common, off-the-shelf sensors with specialist body sensing technology we are developing ourselves and constructed a software system for recording, analysing and presenting sensed data gathered from a single player during a sporting activity, a football match. We gather readings for heart rate, galvanic skin response, motion, heat flux, respiration, and location (GPS) using on-body sensors, while simultaneously tracking player activity using a combination of a playercam video and pitch-wide video recording. We have aggregated all this sensed data into a single overview of player performance and activity which can be reviewed, post-event. We are currently working on integrating other non-invasive methods for real-time on-body monitoring of sweat electrolytes and pH via a textile-based sweat sampling and analysis platform. Our work is heading in two directions; firstly from post-event data aggregation to real-time monitoring, and secondly, to convert raw sensor readings into performance indicators that are meaningful to practitioners in the field

Assistance strategies for robotized laparoscopy

Robotizing laparoscopic surgery not only allows achieving better accuracy to operate when a scale factor is applied between master and slave or thanks to the use of tools with 3 DoF, which cannot be used in conventional manual surgery, but also due to additional informatic support. Relying on computer assistance different strategies that facilitate the task of the surgeon can be incorporated, either in the form of autonomous navigation or cooperative guidance, providing sensory or visual feedback, or introducing certain limitations of movements. This paper describes different ways of assistance aimed at improving the work capacity of the surgeon and achieving more safety for the patient, and the results obtained with the prototype developed at UPC.Peer ReviewedPostprint (author's final draft

Hybrid dispersion laser scanner.

Laser scanning technology is one of the most integral parts of today's scientific research, manufacturing, defense, and biomedicine. In many applications, high-speed scanning capability is essential for scanning a large area in a short time and multi-dimensional sensing of moving objects and dynamical processes with fine temporal resolution. Unfortunately, conventional laser scanners are often too slow, resulting in limited precision and utility. Here we present a new type of laser scanner that offers ∼1,000 times higher scan rates than conventional state-of-the-art scanners. This method employs spatial dispersion of temporally stretched broadband optical pulses onto the target, enabling inertia-free laser scans at unprecedented scan rates of nearly 100 MHz at 800 nm. To show our scanner's broad utility, we use it to demonstrate unique and previously difficult-to-achieve capabilities in imaging, surface vibrometry, and flow cytometry at a record 2D raster scan rate of more than 100 kHz with 27,000 resolvable points

Sparse Proteomics Analysis - A compressed sensing-based approach for feature selection and classification of high-dimensional proteomics mass spectrometry data

Background: High-throughput proteomics techniques, such as mass spectrometry (MS)-based approaches, produce very high-dimensional data-sets. In a clinical setting one is often interested in how mass spectra differ between patients of different classes, for example spectra from healthy patients vs. spectra from patients having a particular disease. Machine learning algorithms are needed to (a) identify these discriminating features and (b) classify unknown spectra based on this feature set. Since the acquired data is usually noisy, the algorithms should be robust against noise and outliers, while the identified feature set should be as small as possible. Results: We present a new algorithm, Sparse Proteomics Analysis (SPA), based on the theory of compressed sensing that allows us to identify a minimal discriminating set of features from mass spectrometry data-sets. We show (1) how our method performs on artificial and real-world data-sets, (2) that its performance is competitive with standard (and widely used) algorithms for analyzing proteomics data, and (3) that it is robust against random and systematic noise. We further demonstrate the applicability of our algorithm to two previously published clinical data-sets