Toward Building Hybrid Biological/in silico Neural Networks for Motor Neuroprosthetic Control

WOS: 000370402900001PubMed ID: 26321943In this article, we introduce the Bioinspired Neuroprosthetic Design Environment (BNDE) as a practical platform for the development of novel brain-machine interface (BMI) controllers, which are based on spiking model neurons. We built the BNDE around a hard real-time system so that it is capable of creating simulated synapses from extra-cellularly recorded neurons to model neurons. In order to evaluate the practicality of the BNDE for neuroprosthetic control experiments, a novel, adaptive BMI controller was developed and tested using real-time closed-loop simulations. The present controller consists of two in silico medium spiny neurons, which receive simulated synaptic inputs from recorded motor cortical neurons. In the closed-loop simulations, the recordings from the cortical neurons were imitated using an external, hardware-based neural signal synthesizer. By implementing a reward-modulated spike timing-dependent plasticity rule, the controller achieved perfect target reach accuracy for a two-target reaching task in one-dimensional space. The BNDE combines the flexibility of software-based spiking neural network (SNN) simulations with powerful online data visualization tools and is a low-cost, PC-based, and all-in-one solution for developing neurally inspired BMI controllers. We believe that the BNDE is the first implementation, which is capable of creating hybrid biological/in silico neural networks for motor neuroprosthetic control and utilizes multiple CPU cores for computationally intensive real-time SNN simulations.Bogazici University BAP Grants [10XD3]; Bogazici University Life Sciences and Technologies Research Center [09K120520]This research was supported by Bogazici University BAP Grants #10XD3 and Bogazici University Life Sciences and Technologies Research Center #09K120520

Bionic hand: A brief review

The hand is one of the most crucial organs in the human body. Hand loss causes the loss of functionality in daily and work life and psychological disorders for the patients. Hand transplantation is best option to gain most of the hand function. However, the applicability of this option is limited since the side effects and the need for tissue compatibility. Electromechanical hand prosthesis also called bionic hand is an alternative option to hand transplantation. This study presents a quick review of bionic hand technology

Human Hand Anatomy-Based Prosthetic Hand

[EN] The present paper describes the development of a prosthetic hand based on human hand anatomy. The hand phalanges are printed with 3D printing with Polylactic Acid material. One of the main contributions is the investigation on the prosthetic hand joins; the proposed design enables one to create personalized joins that provide the prosthetic hand a high level of movement by increasing the degrees of freedom of the fingers. Moreover, the driven wire tendons show a progressive grasping movement, being the friction of the tendons with the phalanges very low. Another important point is the use of force sensitive resistors (FSR) for simulating the hand touch pressure. These are used for the grasping stop simulating touch pressure of the fingers. Surface Electromyogram (EMG) sensors allow the user to control the prosthetic hand-grasping start. Their use may provide the prosthetic hand the possibility of the classification of the hand movements. The practical results included in the paper prove the importance of the soft joins for the object manipulation and to get adapted to the object surface. Finally, the force sensitive sensors allow the prosthesis to actuate more naturally by adding conditions and classifications to the Electromyogram sensoDunai, L.; Novak, M.; Garcia Espert, C. (2021). Human Hand Anatomy-Based Prosthetic Hand. Sensors. 21(1):1-15. https://doi.org/10.3390/s21010137S11521

Biologically structured materials

In this paper bio-tissue mathematical modeling serves as a central repository to interface design, simulation, and tissue fabrication. Finite element computer analyses will be used to study the role of local tissue mechanics on endochondral ossification patterns, skeletal morphology and mandible thickness distributions using single and multi-phase continuum material representations of clinical cases of patients implanted with the traditional protocols. New protocols will be hypothesized for the use of the new biologically techno-structured hybrid materials

Neuromorphic hardware for somatosensory neuroprostheses

In individuals with sensory-motor impairments, missing limb functions can be restored using neuroprosthetic devices that directly interface with the nervous system. However, restoring the natural tactile experience through electrical neural stimulation requires complex encoding strategies. Indeed, they are presently limited in effectively conveying or restoring tactile sensations by bandwidth constraints. Neuromorphic technology, which mimics the natural behavior of neurons and synapses, holds promise for replicating the encoding of natural touch, potentially informing neurostimulation design. In this perspective, we propose that incorporating neuromorphic technologies into neuroprostheses could be an effective approach for developing more natural human-machine interfaces, potentially leading to advancements in device performance, acceptability, and embeddability. We also highlight ongoing challenges and the required actions to facilitate the future integration of these advanced technologies

Nonlinear control strategy for a cost effective myoelectric prosthetic hand

The loss of a limb tremendously impacts the life of the affected individual. In the past decades, researchers have been developing artificial limbs that may return some of the missing functions and cosmetics. However, the development of dexterous mechanisms capable of mimicking the function of the human hand is a complex venture. Even though myoelectric prostheses have advanced, several issues remain to be solved before an artificial limb may be comparable to its human counterpart. Moreover, the high cost of advanced limbs prevents their widespread use among the low-income population. This dissertation presents a strategy for the low-level of control of a cost effective robotic hand for prosthetic applications. The main purpose of this work is to reduce the high cost associated with limb replacement. The presented strategy uses an electromyographic signal classifier, which detects user intent by classifying 4 different wrist movements. This information is supplied as 4 different pre-shapes of the robotic hand to the low-level of control for safely and effectively performing the grasping tasks. Two proof-of-concept prototypes were implemented, consisting on five-finger underactuated hands driven by inexpensive DC motors and equipped with low-cost sensors. To overcome the limitations and nonlinearities of inexpensive components, a multi-stage control methodology was designed for modulating the grasping force based on slippage detection and nonlinear force control. A multi-stage control methodology for modulating the grasping force based on slippage detection and nonlinear force control was designed. The two main stages of the control strategy are the force control stage and the detection stage. The control strategy uses the force control stage to maintain a constant level of force over the object. The results of the experiments performed over this stage showed a rising time of less than 1 second, force overshoot of less than 1 N and steady state error of less than 0.15 N. The detection stage is used to monitor any sliding of the object from the hand. The experiments performed over this stage demonstrated a delay in the slip detection process of less than 200 milliseconds. The initial force, and the amount of force incremented after sliding is detected, were adjusted to reduce object displacement. Experiments were then performed to test the control strategy on situations often encountered in the ADL. The results showed that the control strategy was able to detect the dynamic changes in mass of the object and to successfully adjust the grasping force to prevent the object from dropping. The evaluation of the proposed control strategy suggests that this methodology can overcome the limitation of inexpensive sensors and actuators. Therefore, this control strategy may reduce the cost of current myoelectric prosthesis. We believe that the work presented here is a major step towards the development of a cost effective myoelectric prosthetic hand

Range-based techniques for discovering optimality and analyzing scaling relationships in neuromechanical systems

In this paper, a method for decoupling the neuromuscular function of a set of limbs from the role morphology plays in regulating the performance of an activity is introduced. This method is based on two previous methods: the rescaled range analysis specific to time series data, and the use of scaling laws. A review of the literature suggests that limb geometry can either facilitate or constrain performance as measured experimentally. Whether limb geometry is facilitatory or acts as a constraint depends on the size differential between arm morphology and the underlying muscle. "Changes in size and shape" are theoretically extrapolations of morphological geometry to other members of a population or species, to other species, or to technological manipulations of an individual via prosthetic devices. Three datasets are analyzed using the range-based method and a Monte-Carlo simulation, and are used to test the various ways of executing this analysis. It was found that when performance is kept stable but limb size and shape is scaled by a factor of .25, the greatest gain in performance results. It was also found that introducing force-based perturbations results in 'shifts' in the body geometry/performance relationship. While results such as this could be interpreted as a statistical artifact, the non-linear rise within a measurement class and linear decrease between measurement classes suggests an effect of scale in the optimality of this relationship. Overall, range-based techniques allow for the simulation and modeling of myriad changes in phenotype that result from biological and technological manipulation

Memory and information processing in neuromorphic systems

A striking difference between brain-inspired neuromorphic processors and current von Neumann processors architectures is the way in which memory and processing is organized. As Information and Communication Technologies continue to address the need for increased computational power through the increase of cores within a digital processor, neuromorphic engineers and scientists can complement this need by building processor architectures where memory is distributed with the processing. In this paper we present a survey of brain-inspired processor architectures that support models of cortical networks and deep neural networks. These architectures range from serial clocked implementations of multi-neuron systems to massively parallel asynchronous ones and from purely digital systems to mixed analog/digital systems which implement more biological-like models of neurons and synapses together with a suite of adaptation and learning mechanisms analogous to the ones found in biological nervous systems. We describe the advantages of the different approaches being pursued and present the challenges that need to be addressed for building artificial neural processing systems that can display the richness of behaviors seen in biological systems.Comment: Submitted to Proceedings of IEEE, review of recently proposed neuromorphic computing platforms and system

Foot/Ankle Prostheses Design Approach Based on Scientometric and Patentometric Analyses

There are different alternatives when selecting removable prostheses for below the knee amputated patients. The designs of these prostheses vary according to their different functions. These prostheses designs can be classified into Energy Storing and Return (ESAR), Controlled Energy Storing and Return (CESR), active, and hybrid. This paper aims to identify the state of the art related to the design of these prostheses of which ESAR prostheses are grouped into five types, and active and CESR are categorized into four groups. Regarding patent analysis, 324 were analyzed over the last six years. For scientific communications, a bibliometric analysis was performed using 104 scientific reports from the Web of Science in the same period. The results show a tendency of ESAR prostheses designs for patents (68%) and active prostheses designs for scientific documentation (40%).Beca Conacyt Doctorad

Microfabricated tactile sensors for biomedical applications: a review

During the last decades, tactile sensors based on different sensing principles have been developed due to the growing interest in robotics and, mainly, in medical applications. Several technological solutions have been employed to design tactile sensors; in particular, solutions based on microfabrication present several attractive features. Microfabrication technologies allow for developing miniaturized sensors with good performance in terms of metrological properties (e.g., accuracy, sensitivity, low power consumption, and frequency response). Small size and good metrological properties heighten the potential role of tactile sensors in medicine, making them especially attractive to be integrated in smart interfaces and microsurgical tools. This paper provides an overview of microfabricated tactile sensors, focusing on the mean principles of sensing, i.e., piezoresistive, piezoelectric and capacitive sensors. These sensors are employed for measuring contact properties, in particular force and pressure, in three main medical fields, i.e., prosthetics and artificial skin, minimal access surgery and smart interfaces for biomechanical analysis. The working principles and the metrological properties of the most promising tactile, microfabricated sensors are analyzed, together with their application in medicine. Finally, the new emerging technologies in these fields are briefly described