214 research outputs found

    Fused mechanomyography and inertial measurement for human-robot interface

    Get PDF
    Human-Machine Interfaces (HMI) are the technology through which we interact with the ever-increasing quantity of smart devices surrounding us. The fundamental goal of an HMI is to facilitate robot control through uniting a human operator as the supervisor with a machine as the task executor. Sensors, actuators, and onboard intelligence have not reached the point where robotic manipulators may function with complete autonomy and therefore some form of HMI is still necessary in unstructured environments. These may include environments where direct human action is undesirable or infeasible, and situations where a robot must assist and/or interface with people. Contemporary literature has introduced concepts such as body-worn mechanical devices, instrumented gloves, inertial or electromagnetic motion tracking sensors on the arms, head, or legs, electroencephalographic (EEG) brain activity sensors, electromyographic (EMG) muscular activity sensors and camera-based (vision) interfaces to recognize hand gestures and/or track arm motions for assessment of operator intent and generation of robotic control signals. While these developments offer a wealth of future potential their utility has been largely restricted to laboratory demonstrations in controlled environments due to issues such as lack of portability and robustness and an inability to extract operator intent for both arm and hand motion. Wearable physiological sensors hold particular promise for capture of human intent/command. EMG-based gesture recognition systems in particular have received significant attention in recent literature. As wearable pervasive devices, they offer benefits over camera or physical input systems in that they neither inhibit the user physically nor constrain the user to a location where the sensors are deployed. Despite these benefits, EMG alone has yet to demonstrate the capacity to recognize both gross movement (e.g. arm motion) and finer grasping (e.g. hand movement). As such, many researchers have proposed fusing muscle activity (EMG) and motion tracking e.g. (inertial measurement) to combine arm motion and grasp intent as HMI input for manipulator control. However, such work has arguably reached a plateau since EMG suffers from interference from environmental factors which cause signal degradation over time, demands an electrical connection with the skin, and has not demonstrated the capacity to function out of controlled environments for long periods of time. This thesis proposes a new form of gesture-based interface utilising a novel combination of inertial measurement units (IMUs) and mechanomyography sensors (MMGs). The modular system permits numerous configurations of IMU to derive body kinematics in real-time and uses this to convert arm movements into control signals. Additionally, bands containing six mechanomyography sensors were used to observe muscular contractions in the forearm which are generated using specific hand motions. This combination of continuous and discrete control signals allows a large variety of smart devices to be controlled. Several methods of pattern recognition were implemented to provide accurate decoding of the mechanomyographic information, including Linear Discriminant Analysis and Support Vector Machines. Based on these techniques, accuracies of 94.5% and 94.6% respectively were achieved for 12 gesture classification. In real-time tests, accuracies of 95.6% were achieved in 5 gesture classification. It has previously been noted that MMG sensors are susceptible to motion induced interference. The thesis also established that arm pose also changes the measured signal. This thesis introduces a new method of fusing of IMU and MMG to provide a classification that is robust to both of these sources of interference. Additionally, an improvement in orientation estimation, and a new orientation estimation algorithm are proposed. These improvements to the robustness of the system provide the first solution that is able to reliably track both motion and muscle activity for extended periods of time for HMI outside a clinical environment. Application in robot teleoperation in both real-world and virtual environments were explored. With multiple degrees of freedom, robot teleoperation provides an ideal test platform for HMI devices, since it requires a combination of continuous and discrete control signals. The field of prosthetics also represents a unique challenge for HMI applications. In an ideal situation, the sensor suite should be capable of detecting the muscular activity in the residual limb which is naturally indicative of intent to perform a specific hand pose and trigger this post in the prosthetic device. Dynamic environmental conditions within a socket such as skin impedance have delayed the translation of gesture control systems into prosthetic devices, however mechanomyography sensors are unaffected by such issues. There is huge potential for a system like this to be utilised as a controller as ubiquitous computing systems become more prevalent, and as the desire for a simple, universal interface increases. Such systems have the potential to impact significantly on the quality of life of prosthetic users and others.Open Acces

    Advances and perspectives of mechanomyography

    Get PDF
    INTRODUCTION: The evaluation of muscular tissue condition can be accomplished with mechanomyography (MMG), a technique that registers intramuscular mechanical waves produced during a fiber's contraction and stretching that are sensed or interfaced on the skin surface. OBJECTIVE: Considering the scope of MMG measurements and recent advances involving the technique, the goal of this paper is to discuss mechanomyography updates and discuss its applications and potential future applications. METHODS: Forty-three MMG studies were published between the years of 1987 and 2013. RESULTS: MMG sensors are developed with different technologies such as condenser microphones, accelerometers, laser-based instruments, etc. Experimental protocols that are described in scientific publications typically investigated the condition of the vastus lateralis muscle and used sensors built with accelerometers, third and fourth order Butterworth filters, 5-100Hz frequency bandpass, signal analysis using Root Mean Square (RMS) (temporal), Median Frequency (MDF) and Mean Power Frequency (MPF) (spectral) features, with epochs of 1 s. CONCLUSION: Mechanomyographic responses obtained in isometric contractions differ from those observed during dynamic contractions in both passive and functional electrical stimulation evoked movements. In the near future, MMG features applied to biofeedback closed-loop systems will help people with disabilities, such as spinal cord injury or limb amputation because they may improve both neural and myoelectric prosthetic control. Muscular tissue assessment is a new application area enabled by MMG; it can be useful in evaluating the muscular tonus in anesthetic blockade or in pathologies such as myotonic dystrophy, chronic obstructive pulmonary disease, and disorders including dysphagia, myalgia and spastic hypertonia. New research becomes necessary to improve the efficiency of MMG systems and increase their application in rehabilitation, clinical and other health areas304384401CONSELHO NACIONAL DE DESENVOLVIMENTO CIENTÍFICO E TECNOLÓGICO - CNPQFINANCIADORA DE ESTUDOS E PROJETOS - FINEPsem informaçã

    A survey on bio-signal analysis for human-robot interaction

    Get PDF
    The use of bio-signals analysis in human-robot interaction is rapidly increasing. There is an urgent demand for it in various applications, including health care, rehabilitation, research, technology, and manufacturing. Despite several state-of-the-art bio-signals analyses in human-robot interaction (HRI) research, it is unclear which one is the best. In this paper, the following topics will be discussed: robotic systems should be given priority in the rehabilitation and aid of amputees and disabled people; second, domains of feature extraction approaches now in use, which are divided into three main sections (time, frequency, and time-frequency). The various domains will be discussed, then a discussion of each domain's benefits and drawbacks, and finally, a recommendation for a new strategy for robotic systems

    Classification of the mechanomyogram signal using a wavelet packet transform and singular value decomposition

    Get PDF
    Title on author’s file: Classification of mechanomyogram signal using wavelet packet transform and singular value decomposition for multifunction prosthesis control2008-2009 > Academic research: refereed > Publication in refereed journalAccepted ManuscriptPublishe

    Integrating Neuromuscular and Touchscreen Input for Machine Control

    Get PDF
    Current touchscreen interfaces are unable to distinguish between individual fingers or to determine poses associated with the user’s hand. This limits the use of touchscreens in recognizing user input. As discussed herein, a statistical model can be trained using training data that includes sensor readings known to be associated with various hand poses and gestures. The trained statistical model can be configured to determine arm, hand, and/or figure configurations and forces (e.g., handstates) based on sensor readings, e.g., obtained via a wearable device such as a wristband with wearable sensors. The statistical model can identify the input from the handstate detected by the wearable device. For example, the handstates can include identification of a portion of the hand that is interacting with the touchscreen, a user’s finger position relative to the touchscreen, an identification of which finger or fingers of the user’s hand are interacting with the touchscreen, etc. The handstates can be used to control any aspect(s) of the touchscreen or a connected device indirectly through the touchscreen

    The effect of accelerometer location on the classification of single-site forearm mechanomyograms

    Get PDF
    <p>Abstract</p> <p>Background</p> <p>Recently, pattern recognition methods have been deployed in the classification of multiple activation states from mechanomyogram (MMG) signals for the purpose of controlling switching interfaces. Given the propagative properties of MMG signals, it has been suggested that MMG classification should be robust to changes in sensor placement. Nonetheless, this purported robustness remains speculative to date. This study sought to quantify the change in classification accuracy, if any, when a classifier trained with MMG signals from the muscle belly, is subsequently tested with MMG signals from a nearby location.</p> <p>Methods</p> <p>An arrangement of 5 accelerometers was attached to the flexor carpi radialis muscle of 12 able-bodied participants; a reference accelerometer was located over the muscle belly, two peripheral accelerometers were positioned along the muscle's transverse axis and two more were aligned to the muscle's longitudinal axis. Participants performed three classes of muscle activity: wrist flexion, wrist extension and semi-pronation. A collection of time, frequency and time-frequency features were considered and reduced by genetic feature selection. The classifier, trained using features from the reference accelerometer, was tested with signals from the longitudinally and transversally displaced accelerometers.</p> <p>Results</p> <p>Classification degradation due to accelerometer displacement was significant for all participants, and showed no consistent trend with the direction of displacement. Further, the displaced accelerometer signals showed task-dependent de-correlations with respect to the reference accelerometer.</p> <p>Conclusions</p> <p>These results indicate that MMG signal features vary with spatial location and that accelerometer displacements of only 1-2 cm cause sufficient feature drift to significantly diminish classification accuracy. This finding emphasizes the importance of consistent sensor placement between MMG classifier training and deployment for accurate control of switching interfaces.</p

    Electromyography - A Reliable Technique for Muscle Activity Assessment

    Get PDF
    In recent years, many questions have been raised on the credibility of Electromyography (EMG) as a technique to evaluate muscle activity, particularly by sports and fitness community. This questioning goes farther when it comes to surface electromyography (sEMG). This paper covers an overview of EMG, addresses some basic concepts and provide rudiment for research. Muscle activity assessment through EMG has been reviewed in terms of the type of movements. There are few limitations to EMG but these confines are addressable. The problem rather lies in the interpretation and generalization of that data. Limitations are there in every technology, precautionary measures must be taken to avoid those while using it. Reservations about EMG have been summarized along with their responses. A few techniques to analyze EMG data, and possibilities to extrapolate and interpret, are also provided. Current perspectives and practical applications of EMG and sEMG are also part of this article

    Walking Activity Recognition with sEMG Sensor Array on Thigh Circumference using Convolutional Neural Network

    Get PDF
    In recognition of walking gait modes using surface electromyography (sEMG), the use of sEMG sensor array can provide sensor redundancy and less rigorous identification of sEMG electrode placements as compared to the conventional sEMG electrode placements right in the middle of muscle bellies. However, the potentially lesser discriminative and noisier sEMG signals from the sEMG sensor array pose the challenge in developing accurate and robust machine learning classifier for walking activity recognition. In this paper, we explore the use of convolution neural network (CNN) classifier with frequency gradient feature derived from EMG signal spectrogram for detecting different walking activities using an sEMG sensor array on thigh circumference. EMG dataset from five healthy subjects and an amputee for five walking activities namely walking at slow, normal and fast speed, ramp ascending and ramp descending are used to train and test the CNN-based classifier. Our preliminary findings suggest that frequency gradient feature can improve the CNN-based classifier performance for walking activity recognition using EMG sensor array on thigh circumference
    • 

    corecore