Machine Learning for Microcontroller-Class Hardware -- A Review

The advancements in machine learning opened a new opportunity to bring intelligence to the low-end Internet-of-Things nodes such as microcontrollers. Conventional machine learning deployment has high memory and compute footprint hindering their direct deployment on ultra resource-constrained microcontrollers. This paper highlights the unique requirements of enabling onboard machine learning for microcontroller class devices. Researchers use a specialized model development workflow for resource-limited applications to ensure the compute and latency budget is within the device limits while still maintaining the desired performance. We characterize a closed-loop widely applicable workflow of machine learning model development for microcontroller class devices and show that several classes of applications adopt a specific instance of it. We present both qualitative and numerical insights into different stages of model development by showcasing several use cases. Finally, we identify the open research challenges and unsolved questions demanding careful considerations moving forward.Comment: Accepted for publication at IEEE Sensors Journa

Neuro-fuzzy software for intelligent control and education

Tese de mestrado integrado. Engenharia Electrotécnica e de Computadores (Major Automação). Faculdade de Engenharia. Universidade do Porto. 200

Embedded machine learning using microcontrollers in wearable and ambulatory systems for health and care applications: a review

The use of machine learning in medical and assistive applications is receiving significant attention thanks to the unique potential it offers to solve complex healthcare problems for which no other solutions had been found. Particularly promising in this field is the combination of machine learning with novel wearable devices. Machine learning models, however, suffer from being computationally demanding, which typically has resulted on the acquired data having to be transmitted to remote cloud servers for inference. This is not ideal from the system’s requirements point of view. Recently, efforts to replace the cloud servers with an alternative inference device closer to the sensing platform, has given rise to a new area of research Tiny Machine Learning (TinyML). In this work, we investigate the different challenges and specifications trade-offs associated to existing hardware options, as well as recently developed software tools, when trying to use microcontroller units (MCUs) as inference devices for health and care applications. The paper also reviews existing wearable systems incorporating MCUs for monitoring, and management, in the context of different health and care intended uses. Overall, this work addresses the gap in literature targeting the use of MCUs as edge inference devices for healthcare wearables. Thus, can be used as a kick-start for embedding machine learning models on MCUs, focusing on healthcare wearables

BEAGLEBOARD EMBEDDED SYSTEM FOR ADAPTIVE TRAFFIC LIGHT CONTROL SYSTEM WITH CAMERA SENSOR

Traffic is one of the most important aspects in human daily life because traffic affects smoothness of capital flows, logistics, and other community activities. Without appropriate traffic light control system, possibility of traffic congestion will be very high and hinder people’s life in urban areas. Adaptive traffic light control system can be used to solve traffic congestions in an intersection because it can adaptively change the durations of green light each lane in an intersection depend on traffic density. The proposed adaptive traffic light control system prototype uses Beagleboard-xM, CCTV camera, and AVR microcontrollers. We use computer vision technique to obtain information on traffic density combining Viola-Jones method with Kalman Filter method. To calculate traffic light time of each traffic light in intersection, we use Distributed Constraint Satisfaction Problem (DCSP). From implementations and experiments results, we conclude that BeagleBoard-xM can be used as main engine of adaptive traffic light control system with 91.735% average counting rate. Lalu intas adalah salah satu aspek yang paling penting dalam kehidupan sehari-hari manusia karena lalu lintas memengaruhi kelancaran arus modal, logistik, dan kegiatan masyarakat lainnya. Tanpa sistem kontrol lampu lalu lintas yang memadai, kemungkinan kemacetan lalu lintas akan sangat tinggi dan menghambat kehidupan masyarakat di perkotaan. Sistem kontrol lampu lalu lintas adaptif dapat digunakan untuk memecahkan kemacetan lalu lintas di persimpangan karena dapat mengubah durasi lampu hijau di setiap persimpangan jalan tergantung pada kepadatan lalu lintas. Prototipe sistem kontrol lampu lalu lintas menggunakan BeagleBoard-XM, kamera CCTV, dan mikrokontroler AVR. Peneliti menggunakan teknik computer vision untuk mendapatkan informasi tentang kepadatan lalu lintas dengan menggabungkan metode Viola-Jones dan metode Filter Kalman. Untuk menghitung waktu setiap lampu lalu lintas di persimpangan, peneliti menggunakan Distributed Constraint Satisfaction Problem (DCSP). Dari hasil implementasi dan percobaan dapat disimpulkan bahwa BeagleBoard-XM dapat digunakan sebagai mesin utama sistem kontrol lampu lalu lintas adaptif dengan tingkat akurasi penghitungan rata-rata sebesar 91.735%

Estimation Accuracy and Computational Cost Analysis of Artificial Neural Networks for State of Charge Estimation in Lithium Batteries

This paper presents a tradeoff analysis in terms of accuracy and computational cost between different architectures of artificial neural networks for the State of Charge (SOC) estimation of lithium batteries in hybrid and electric vehicles. The considered layouts are partly selected from the literature on SOC estimation, and partly are novel proposals that have been demonstrated to be effective in executing estimation tasks in other engineering fields. One of the architectures, the Nonlinear Autoregressive Neural Network with Exogenous Input (NARX), is presented with an unconventional layout that exploits a preliminary routine, which allows setting of the feedback initial value to avoid estimation divergence. The presented solutions are compared in terms of estimation accuracy, duration of the training process, robustness to the noise in the current measurement, and to the inaccuracy on the initial estimation. Moreover, the algorithms are implemented on an electronic control unit in serial communication with a computer, which emulates a real vehicle, so as to compare their computational costs. The proposed unconventional NARX architecture outperforms the other solutions. The battery pack that is used to design and test the networks is a 20 kW pack for a mild hybrid electric vehicle, whilst the adopted training, validation and test datasets are obtained from the driving cycles of a real car and from standard profiles

Prevention of Unauthorized Transport of Ore in Opencast Mines Using Automatic Number Plate Recognition

Security in mining is a primary concern, which mainly affects the production cost. An efficiently detecting and deterring theft will maximize the profitability of any mining organization. Many illegal transportation cases were registered in spite of rules imposed by central and state governments under Section 23 (c) of MMDR Act 1957. Use of an automated checkpoint gate based on license plate recognition and biometric fingerprint system for vehicle tracking enhances the security in mines. The method was tested on the number plates with various considerations like clean number plates, clean fingerprints, dusty and faded number plates, dusty fingerprints, and number plates captured by varying distance. By considering all the above conditions the pictures were processed by ANPR and bio-metric fingerprint modules. Vehicle license number plate was captured using a digital camera and the captured RGB image was converted to grayscale image. Thresholding was done to remove unwanted areas from the grayscale image. The characters of the number plate were segmented using Gabor filter. A track-sector matrix was generated by considering the number of pixels in each region and was matched with existing template to identify the character. The fingerprint scans the finger and matches with the template created at the time of fingerprint registration at the machine. The micro-controller accepted the processed output in binary form from ANPR and bio-metric fingerprint system. The micro-controller processed the binary output and the checkpoint gate was closed/open based on the output provided by the microcontroller to motor driver

A novel Approach for sEMG Gesture Recognition using Resource-constrained Hardware Platforms

Classifying human gestures using surface electromyografic sensors (sEMG) is a challenging task. Wearable sensors have proven to be extremely useful in this context, but their performance is limited by several factors (signal noise, computing resources, battery consumption, etc.). In particular, computing resources impose a limitation in many application scenarios, in which lightweight classification approaches are desirable. Recent research has shown that machine learning techniques are useful for human gesture classification once their salient features have been determined. This paper presents a novel approach for human gesture classification in which two different strategies are combined: a) a technique based on autoencoders is used to perform feature extraction; b) two alternative machine learning algorithms (namely J48 and K*) are then used for the classification stage. Empirical results are provided, showing that for limited computing power platforms our approach outperforms other alternative methodologies.Fil: Micheletto, Matías Javier. Universidad Nacional de la Patagonia Austral. Centro de Investigaciones y Transferencia Golfo San Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro de Investigaciones y Transferencia Golfo San Jorge. Universidad Nacional de la Patagonia "San Juan Bosco". Centro de Investigaciones y Transferencia Golfo San Jorge; ArgentinaFil: Chesñevar, Carlos Iván. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Bahía Blanca. Instituto de Ciencias e Ingeniería de la Computación. Universidad Nacional del Sur. Departamento de Ciencias e Ingeniería de la Computación. Instituto de Ciencias e Ingeniería de la Computación; ArgentinaFil: Santos, Rodrigo Martin. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Bahía Blanca. Instituto de Ciencias e Ingeniería de la Computación. Universidad Nacional del Sur. Departamento de Ciencias e Ingeniería de la Computación. Instituto de Ciencias e Ingeniería de la Computación; Argentin

Survey Paper Artificial and Computational Intelligence in the Internet of Things and Wireless Sensor Network

In this modern age, Internet of Things (IoT) and Wireless Sensor Network (WSN) as its derivatives have become one of the most popular and important technological advancements. In IoT, all things and services in the real world are digitalized and it continues to grow exponentially every year. This growth in number of IoT device in the end has created a tremendous amount of data and new data services such as big data systems. These new technologies can be managed to produce additional value to the existing business model. It also can provide a forecasting service and is capable to produce decision-making support using computational intelligence methods. In this survey paper, we provide detailed research activities concerning Computational Intelligence methods application in IoT WSN. To build a good understanding, in this paper we also present various challenges and issues for Computational Intelligence in IoT WSN. In the last presentation, we discuss the future direction of Computational Intelligence applications in IoT WSN such as Self-Organizing Network (dynamic network) concept