Network Modeling of Motor Pathways from Neural Recordings

During cued motor tasks, for both speech and limb movement, information propagates from primary sensory areas, to association areas, to primary and supplementary motor and language areas. Through the recent advent of high density recordings at multiple scales, it has become possible to simultaneously observe activity occurring from these disparate regions at varying resolution. Models of brain activity generally used in brain-computer interface (BCI) control do not take into account the global differences in recording site function, or the interactions between them. Through the use of connectivity measures, however, it has been made possible to determine the contribution of individual recording sites to the global activity, as they vary with task progression. This dissertation extends those connectivity models to provide summary information about the importance of individual sites. This is achieved through the application of network measures on the adjacency structure determined by connectivity measures. Similarly, by analyzing the coordinated activity of all of the electrode sites simultaneously during task performance, it is possible to elucidate discrete functional units through clustering analysis of the electrode recordings. In this dissertation, I first describe a BCI system using simple motor movement imagination at single recording sites. I then incorporate connectivity through the use of TV-DBN modeling on higher resolution electrode recordings, specifically electrocorticography (ECoG). I show that PageRank centrality reveals information about task progression and regional specificity which was obscured by direct application of the connectivity measures, due to the combinatorial increase in feature dimensionality. I then show that clustering of ECoG recordings using a method to determine the inherent cluster count algorithmically provides insight into how network involvement in task execution evolves, though in a manner dependent on grid coverage. Finally, I extend clustering analysis to show how individual neurons in motor cortex form distinct functional communities. These communities are shown to be task-specific, suggesting that neurons can form functional units with distinct neural populations across multiple recording sites in a context dependent impermanent manner. This work demonstrates that network measures of connectivity models of neurophysiological recordings are a rich source of information relevant to the field of neuroscience, as well as offering the promise of improved degree-of-freedom and naturalness possible through direct BCI control. These models are shown to be useful at multiple recording scales, from cortical-area level ECoG, to highly localized single unit microelectrode recordings

Improving the mechanistic study of neuromuscular diseases through the development of a fully wireless and implantable recording device

Neuromuscular diseases manifest by a handful of known phenotypes affecting the peripheral nerves, skeletal muscle fibers, and neuromuscular junction. Common signs of these diseases include demyelination, myasthenia, atrophy, and aberrant muscle activity—all of which may be tracked over time using one or more electrophysiological markers. Mice, which are the predominant mammalian model for most human diseases, have been used to study congenital neuromuscular diseases for decades. However, our understanding of the mechanisms underlying these pathologies is still incomplete. This is in part due to the lack of instrumentation available to easily collect longitudinal, in vivo electrophysiological activity from mice. There remains a need for a fully wireless, batteryless, and implantable recording system that can be adapted for a variety of electrophysiological measurements and also enable long-term, continuous data collection in very small animals. To meet this need a miniature, chronically implantable device has been developed that is capable of wirelessly coupling energy from electromagnetic fields while implanted within a body. This device can both record and trigger bioelectric events and may be chronically implanted in rodents as small as mice. This grants investigators the ability to continuously observe electrophysiological changes corresponding to disease progression in a single, freely behaving, untethered animal. The fully wireless closed-loop system is an adaptable solution for a range of long-term mechanistic and diagnostic studies in rodent disease models. Its high level of functionality, adjustable parameters, accessible building blocks, reprogrammable firmware, and modular electrode interface offer flexibility that is distinctive among fully implantable recording or stimulating devices. The key significance of this work is that it has generated novel instrumentation in the form of a fully implantable bioelectric recording device having a much higher level of functionality than any other fully wireless system available for mouse work. This has incidentally led to contributions in the areas of wireless power transfer and neural interfaces for upper-limb prosthesis control. Herein the solution space for wireless power transfer is examined including a close inspection of far-field power transfer to implanted bioelectric sensors. Methods of design and characterization for the iterative development of the device are detailed. Furthermore, its performance and utility in remote bioelectric sensing applications is demonstrated with humans, rats, healthy mice, and mouse models for degenerative neuromuscular and motoneuron diseases

On the Utility of Representation Learning Algorithms for Myoelectric Interfacing

Electrical activity produced by muscles during voluntary movement is a reflection of the firing patterns of relevant motor neurons and, by extension, the latent motor intent driving the movement. Once transduced via electromyography (EMG) and converted into digital form, this activity can be processed to provide an estimate of the original motor intent and is as such a feasible basis for non-invasive efferent neural interfacing. EMG-based motor intent decoding has so far received the most attention in the field of upper-limb prosthetics, where alternative means of interfacing are scarce and the utility of better control apparent. Whereas myoelectric prostheses have been available since the 1960s, available EMG control interfaces still lag behind the mechanical capabilities of the artificial limbs they are intended to steer—a gap at least partially due to limitations in current methods for translating EMG into appropriate motion commands. As the relationship between EMG signals and concurrent effector kinematics is highly non-linear and apparently stochastic, finding ways to accurately extract and combine relevant information from across electrode sites is still an active area of inquiry.This dissertation comprises an introduction and eight papers that explore issues afflicting the status quo of myoelectric decoding and possible solutions, all related through their use of learning algorithms and deep Artificial Neural Network (ANN) models. Paper I presents a Convolutional Neural Network (CNN) for multi-label movement decoding of high-density surface EMG (HD-sEMG) signals. Inspired by the successful use of CNNs in Paper I and the work of others, Paper II presents a method for automatic design of CNN architectures for use in myocontrol. Paper III introduces an ANN architecture with an appertaining training framework from which simultaneous and proportional control emerges. Paper Iv introduce a dataset of HD-sEMG signals for use with learning algorithms. Paper v applies a Recurrent Neural Network (RNN) model to decode finger forces from intramuscular EMG. Paper vI introduces a Transformer model for myoelectric interfacing that do not need additional training data to function with previously unseen users. Paper vII compares the performance of a Long Short-Term Memory (LSTM) network to that of classical pattern recognition algorithms. Lastly, paper vIII describes a framework for synthesizing EMG from multi-articulate gestures intended to reduce training burden

Co-adaptive myoelectric control for upper limb prostheses

[ES] Mucha gente en el mundo se ve afectada por la pérdida de una extremidad (las predicciones estiman que en 2050 habrá más de 3 millones de personas afectadas únicamente en los Estados Unidos de América). A pesar de la continua mejora en las técnicas de amputación y la prostética, vivir sin una extremidad sigue limitando las actividades de los afectados en su vida diaria, provocando una disminución en su calidad de vida. En este trabajo nos centramos en los casos de amputaciones de extremidades superiores, entendiendo por ello la pérdida de cualquier parte del brazo o antebrazo. Esta tesis trata sobre el control mioeléctrico (potenciales eléctricos superficiales generados por la contracción de los músculos) de prótesis de extremidades superiores. Los estudios en este campo han crecido exponencialmente en las últimas décadas intentando reducir el hueco entre la parte investigadora más dinámica y propensa a los cambios e innovación (por ejemplo, usando técnicas como la inteligencia artificial) y la industria prostética, con una gran inercia y poco propensa a introducir cambios en sus controladores y dispositivos. El principal objetivo de esta tesis es desarrollar un nuevo controlador implementable basado en filtros adaptativos que supere los principales problemas del estado del arte. Desde el punto de vista teórico, podríamos considerar dos contribuciones principales. Primero, proponemos un nuevo sistema para modelar la relación entre los patrones de la señales mioélectricas y los movimientos deseados; este nuevo modelo tiene en cuenta a la hora de estimar la posición actual el valor de los estados pasados generando una nueva sinergia entre máquina y ser humano. En segundo lugar, introducimos un nuevo paradigma de entrenamiento más eficiente y personalizado autónomamente, el cual puede aplicarse no sólo a nuestro nuevo controlador, sino a otros regresores disponibles en la literatura. Como consecuencia de este nuevo protocolo, la estructura humano-máquina difiere con respecto del actual estado del arte en dos características: el proceso de aprendizaje del controlador y la estrategia para la generación de las señales de entrada. Como consecuencia directa de todo esto, el diseño de la fase experimental resulta mucho más complejo que con los controladores tradicionales. La dependencia de la posición actual de la prótesis con respecto a estados pasados fuerza a la realización de todos los experimentos de validación del nuevo controlador en tiempo real, algo costoso en recursos tanto humanos como de tiempo. Por lo tanto, una gran parte de esta tesis está dedicada al trabajo de campo necesario para validar el nuevo modelo y estrategia de entrenamiento. Como el objetivo final es proveer un nuevo controlador implementable, la última parte de la tesis está destinada a testear los métodos propuestos en casos reales, tanto en entornos simulados para validar su robustez ante rutinas diarias, como su uso en dispositivos prostéticos comerciales. Como conclusión, este trabajo propone un nuevo paradigma de control mioélectrico para prótesis que puede ser implementado en una prótesis real. Una vez se ha demostrado la viabilidad del sistema, la tesis propone futuras líneas de investigación, mostrando algunos resultados iniciales.[CA] Molta gent en el món es veu afectada per la pèrdua d'una extremitat (les prediccions estimen que en 2050 hi haurà més de 3 milions de persones afectades únicament als Estats Units d'Amèrica). Malgrat la contínua millora en les tècniques d'amputació i la prostètica, viure sense una extremitat continua limitant les activitats dels afectats en la seua vida diària, provocant una disminució en la seua qualitat de vida. En aquest treball ens centrem en els casos d'amputacions d'extremitats superiors, entenent per això la pèrdua de qualsevol part del braç o avantbraç. Aquesta tesi tracta sobre el control mioelèctric (potencials elèctrics superficials generats per la contracció dels músculs) de pròtesis d'extremitats superiors. Els estudis en aquest camp han crescut exponencialment en les últimes dècades intentant reduir el buit entre la part investigadora més dinàmica i propensa als canvis i innovació (per exemple, usant tècniques com la intel·ligència artificial) i la indústria prostètica, amb una gran inèrcia i poc propensa a introduir canvis en els seus controladors i dispositius. Aquesta tesi contribueix a la investigació des de diversos punts de vista. El principal objectiu és desenvolupar un nou controlador basat en filtres adaptatius que supere els principals problemes de l'estat de l'art. Des del punt de vista teòric, podríem considerar dues contribucions principals. Primer, proposem un nou sistema per a modelar la relació entre els patrons de la senyals mioelèctrics i els moviments desitjats; aquest nou model té en compte a l'hora d'estimar la posició actual el valor dels estats passats generant una nova sinergia entre màquina i ésser humà. En segon lloc, introduïm un nou paradigma d'entrenament més eficient i personalitzat autònomament, el qual pot aplicar-se no sols al nostre nou controlador, sinó a uns altres regresors disponibles en la literatura. Com a conseqüència d'aquest nou protocol, l'estructura humà-màquina difereix respecte a l'actual estat de l'art en dues característiques: el procés d'aprenentatge del controlador i l'estratègia per a la generació dels senyals d'entrada. Com a conseqüència directa de tot això, el disseny de la fase experimental resulta molt més complex que amb els controladors tradicionals. La dependència de la posició actual de la pròtesi respecte a estats passats força a la realització de tots els experiments de validació del nou controlador en temps real, una cosa costosa en recursos tant humans com de temps. Per tant, una gran part d'aquesta tesi està dedicada al treball de camp necessari per a validar el nou model i estratègia d'entrenament. Com l'objectiu final és proveir un nou controlador implementable, l'última part de la tesi està destinada a testar els mètodes proposats en casos reals, tant en entorns simulats per a validar la seua robustesa davant rutines diàries, com el seu ús en dispositius prostètics comercials. Com a conclusió, aquest treball proposa un nou paradigma de control mioelèctric per a pròtesi que pot ser implementat en una pròtesi real. Una vegada s'ha demostrat la viabilitat del sistema, la tesi proposa futures línies d'investigació, mostrant alguns resultats inicials.[EN] Many people in the world suffer from the loss of a limb (predictions estimate more than 3 million people by 2050 only in the USA). In spite of the continuous improvement in the amputation rehabilitation and prosthetic restoration, living without a limb keeps limiting the daily life activities leading to a lower quality of life. In this work, we focus in the upper limb amputation case, i.e., the removal of any part of the arm or forearm. This thesis is about upper limb prosthesis control using electromyographic signals (the superficial electric potentials generated during muscle contractions). Studies in this field have grown exponentially in the past decades trying to reduce the gap between a fast growing prosthetic research field, with the introduction of machine learning, and a slower prosthetic industry and limited manufacturing innovation. This thesis contributes to the field from different perspectives. The main goal is to provide and implementable new controller based on adaptive filtering that overcomes the most common state of the art concerns. From the theoretical point of view, there are two main contributions. First, we propose a new system to model the relationship between electromyographic signals and the desired prosthesis movements; this new model takes into account previous states for the estimation of the current position generating a new human-machine synergy. Second, we introduce a new and more efficient autonomously personalized training paradigm, which can benefit not only to our new proposed controller but also other state of the art regressors. As a consequence of this new protocol, the human-machine structure differs with respect to current state of the art in two features: the controller learning process and the input signal generation strategy. As a direct aftereffect of all of this, the experimental phase design results more complex than with traditional controllers. The current state dependency on past states forces the experimentation to be in real time, a very high demanding task in human and time resources. Therefore, a major part of this thesis is the associated fieldwork needed to validate the new model and training strategy. Since the final goal is to provide an implementable new controller, the last part of the thesis is devoted to test the proposed methods in real cases, not only analyzing the robustness and reliability of the controller in real life situations but in real prosthetic devices. As a conclusion, this work provides a new paradigm for the myoelectric prosthetic control that can be implemented in a real device. Once the thesis has proven the system's viability, future work should continue with the development of a physical device where all these ideas are deployed and used by final patients in a daily basis.The work of Carles Igual Bañó to carry out this research and elaborate this dissertation has been supported by the Ministerio de Educación, Cultura y Deporte under the FPU Grant FPU15/02870. One visiting research fellowships (EST18/00544) was also funded by the Ministerio de Educación, Cultura y Deporte of Spain.Igual Bañó, C. (2021). Co-adaptive myoelectric control for upper limb prostheses [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/168192TESI

Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

Use of stance control knee-ankle-foot orthoses : a review of the literature

The use of stance control orthotic knee joints are becoming increasingly popular as unlike locked knee-ankle-foot orthoses, these joints allow the limb to swing freely in swing phase while providing stance phase stability, thus aiming to promote a more physiological and energy efficient gait. It is of paramount importance that all aspects of this technology is monitored and evaluated as the demand for evidence based practice and cost effective rehabilitation increases. A robust and thorough literature review was conducted to retrieve all articles which evaluated the use of stance control orthotic knee joints. All relevant databases were searched, including The Knowledge Network, ProQuest, Web of Knowledge, RECAL Legacy, PubMed and Engineering Village. Papers were selected for review if they addressed the use and effectiveness of commercially available stance control orthotic knee joints and included participant(s) trialling the SCKAFO. A total of 11 publications were reviewed and the following questions were developed and answered according to the best available evidence: 1. The effect SCKAFO (stance control knee-ankle-foot orthoses) systems have on kinetic and kinematic gait parameters 2. The effect SCKAFO systems have on the temporal and spatial parameters of gait 3. The effect SCKAFO systems have on the cardiopulmonary and metabolic cost of walking. 4. The effect SCKAFO systems have on muscle power/generation 5. Patient’s perceptions/ compliance of SCKAFO systems Although current research is limited and lacks in methodological quality the evidence available does, on a whole, indicate a positive benefit in the use of SCKAFOs. This is with respect to increased knee flexion during swing phase resulting in sufficient ground clearance, decreased compensatory movements to facilitate swing phase clearance and improved temporal and spatial gait parameters. With the right methodological approach, the benefits of using a SCKAFO system can be evidenced and the research more effectively converted into clinical practice

The effect of prefabricated wrist-hand orthoses on grip strength

Prefabricated wrist-hand orthoses (WHOs) are commonly prescribed to manage the functional deficit and compromised grip strength as a result of rheumatoid changes. It is thought that an orthosis which improves wrist extension, reduces synovitis and increases the mechanical advantage of the flexor muscles will improve hand function. Previous studies report an initial reduction in grip strength with WHO use which may increase following prolonged use. Using normal subjects, and thus in the absence of pain as a limiting factor, the impact of ten WHOs on grip strength was measured using a Jamar dynamometer. Tests were performed with and without WHOs by right-handed, female subjects, aged 20-50 years over a ten week period. During each test, a wrist goniometer and a forearm torsiometer were used to measure wrist joint position when maximum grip strength was achieved. The majority of participants achieved maximum grip strength with no orthosis at 30° extension. All the orthoses reduced initial grip strength but surprisingly the restriction of wrist extension did not appear to contribute in a significant way to this. Reduction in grip must therefore also be attributable to WHO design characteristics or the quality of fit. The authors recognize the need for research into the long term effect of WHOs on grip strength. However if grip is initially adversely affected, patients may be unlikely to persevere with treatment thereby negating all therapeutic benefits. In studies investigating patient opinions on WHO use, it was a stable wrist rather than a stronger grip reported to have facilitated task performance. This may explain why orthoses that interfere with maximum grip strength can improve functional task performance. Therefore while it is important to measure grip strength, it is only one factor to be considered when evaluating the efficacy of WHOs