8,612 research outputs found
Safety-Aware Human-Robot Collaborative Transportation and Manipulation with Multiple MAVs
Human-robot interaction will play an essential role in various industries and
daily tasks, enabling robots to effectively collaborate with humans and reduce
their physical workload. Most of the existing approaches for physical
human-robot interaction focus on collaboration between a human and a single
ground robot. In recent years, very little progress has been made in this
research area when considering aerial robots, which offer increased versatility
and mobility compared to their grounded counterparts. This paper proposes a
novel approach for safe human-robot collaborative transportation and
manipulation of a cable-suspended payload with multiple aerial robots. We
leverage the proposed method to enable smooth and intuitive interaction between
the transported objects and a human worker while considering safety constraints
during operations by exploiting the redundancy of the internal transportation
system. The key elements of our system are (a) a distributed payload external
wrench estimator that does not rely on any force sensor; (b) a 6D admittance
controller for human-aerial-robot collaborative transportation and
manipulation; (c) a safety-aware controller that exploits the internal system
redundancy to guarantee the execution of additional tasks devoted to preserving
the human or robot safety without affecting the payload trajectory tracking or
quality of interaction. We validate the approach through extensive simulation
and real-world experiments. These include as well the robot team assisting the
human in transporting and manipulating a load or the human helping the robot
team navigate the environment. To the best of our knowledge, this work is the
first to create an interactive and safety-aware approach for quadrotor teams
that physically collaborate with a human operator during transportation and
manipulation tasks.Comment: Guanrui Li and Xinyang Liu contributed equally to this pape
Beam scanning by liquid-crystal biasing in a modified SIW structure
A fixed-frequency beam-scanning 1D antenna based on Liquid Crystals (LCs) is designed for application in 2D scanning with lateral alignment. The 2D array environment imposes full decoupling of adjacent 1D antennas, which often conflicts with the LC requirement of DC biasing: the proposed design accommodates both. The LC medium is placed inside a Substrate Integrated Waveguide (SIW) modified to work as a Groove Gap Waveguide, with radiating slots etched on the upper broad wall, that radiates as a Leaky-Wave Antenna (LWA). This allows effective application of the DC bias voltage needed for tuning the LCs. At the same time, the RF field remains laterally confined, enabling the possibility to lay several antennas in parallel and achieve 2D beam scanning. The design is validated by simulation employing the actual properties of a commercial LC medium
Unconventional Cognitive Intelligent Robotic Control: Quantum Soft Computing Approach in Human Being Emotion Estimation -- QCOptKB Toolkit Application
Strategy of intelligent cognitive control systems based on quantum and soft
computing presented. Quantum self-organization knowledge base synergetic effect
extracted from intelligent fuzzy controllers imperfect knowledge bases
described. That technology improved of robustness of intelligent cognitive
control systems in hazard control situations described with the cognitive
neuro-interface and different types of robot cooperation. Examples demonstrated
the introduction of quantum fuzzy inference gate design as prepared
programmable algorithmic solution for board embedded control systems. The
possibility of neuro-interface application based on cognitive helmet with
quantum fuzzy controller for driving of the vehicle is shown
ABC: Adaptive, Biomimetic, Configurable Robots for Smart Farms - From Cereal Phenotyping to Soft Fruit Harvesting
Currently, numerous factors, such as demographics, migration patterns, and economics, are leading to the critical labour shortage in low-skilled and physically demanding parts of agriculture. Thus, robotics can be developed for the agricultural sector to address these shortages. This study aims to develop an adaptive, biomimetic, and configurable modular robotics architecture that can be applied to multiple tasks (e.g., phenotyping, cutting, and picking), various crop varieties (e.g., wheat, strawberry, and tomato) and growing conditions. These robotic solutions cover the entire perception–action–decision-making loop targeting the phenotyping of cereals and harvesting fruits in a natural environment.
The primary contributions of this thesis are as follows. a) A high-throughput method for imaging field-grown wheat in three dimensions, along with an accompanying unsupervised measuring method for obtaining individual wheat spike data are presented. The unsupervised method analyses the 3D point cloud of each trial plot, containing hundreds of wheat spikes, and calculates the average size of the wheat spike and total spike volume per plot. Experimental results reveal that the proposed algorithm can effectively identify spikes from wheat crops and individual spikes. b) Unlike cereal, soft fruit is typically harvested by manual selection and picking. To enable robotic harvesting, the initial perception system uses conditional generative adversarial networks to identify ripe fruits using synthetic data. To determine whether the strawberry is surrounded by obstacles, a cluster complexity-based perception system is further developed to classify the harvesting complexity of ripe strawberries. c) Once the harvest-ready fruit is localised using point cloud data generated by a stereo camera, the platform’s action system can coordinate the arm to reach/cut the stem using the passive motion paradigm framework, as inspired by studies on neural control of movement in the brain. Results from field trials for strawberry detection, reaching/cutting the stem of the fruit with a mean error of less than 3 mm, and extension to analysing complex canopy structures/bimanual coordination (searching/picking) are presented.
Although this thesis focuses on strawberry harvesting, ongoing research is heading toward adapting the architecture to other crops. The agricultural food industry remains a labour-intensive sector with a low margin, and cost- and time-efficiency business model. The concepts presented herein can serve as a reference for future agricultural robots that are adaptive, biomimetic, and configurable
A field-based computing approach to sensing-driven clustering in robot swarms
Swarm intelligence leverages collective behaviours emerging from interaction and activity of several “simple” agents to solve problems in various environments. One problem of interest in large swarms featuring a variety of sub-goals is swarm clustering, where the individuals of a swarm are assigned or choose to belong to zero or more groups, also called clusters. In this work, we address the sensing-based swarm clustering problem, where clusters are defined based on both the values sensed from the environment and the spatial distribution of the values and the agents. Moreover, we address it in a setting characterised by decentralisation of computation and interaction, and dynamicity of values and mobility of agents. For the solution, we propose to use the field-based computing paradigm, where computation and interaction are expressed in terms of a functional manipulation of fields, distributed and evolving data structures mapping each individual of the system to values over time. We devise a solution to sensing-based swarm clustering leveraging multiple concurrent field computations with limited domain and evaluate the approach experimentally by means of simulations, showing that the programmed swarms form clusters that well reflect the underlying environmental phenomena dynamics
An assessment of the contact rates between individuals when movement is modelled by a correlated random walk
Understanding how individuals come into contact with each other is important in many fields from biology and ecology to robotics and physics. Interaction dynamics are central in understanding how information is spread between agents, how disease spreads through a population, and how group movement or behaviour occurs. However, in many applications, the underlying mode of movement is not considered, and instead, contacts are considered a fraction of all possible contacts amongst a population. This gives rise to the mass-action law which in turn implies a negative quadratic relationship between contacts and individuals. Here we consider how a simple but often used movement model, the correlated random walk, affects the contact rate in a standard Susceptible-Infection (SI) epidemiological model. Via extensive simulation, we show that the contact rate is not always well described by the assumed negative quadratic relationship, I(N−I) (where I is the number of infected at a given time and N the total number of individuals). Instead, we find that a contact rate proportional to [I(N−I)]α with 0<α≤1 is a better qualitative fit, where α depends upon parameters such as the straightness of the movement and the density of individuals. We highlight that the expected contacts at low densities increase with straight line movement, whereas, at high densities, they increase with more random movement
Sensor Fault Detection and Fault-Tolerant Estimation of Vehicle States
Manufacturing smarter and more reliable vehicles is a progressing trend in the automotive industry. Many of today’s vehicles are equipped with driver assistant, automated driving and advanced stability control systems. These systems rely on measured or estimated information to accomplish their tasks. Evidently, reliability of the sensory measurements and the estimate information is essential for desirable operation of advanced vehicle subsystems.
This thesis proposes a novel methodology to detect vehicle sensor faults, reconstruct the faulty sensory signals and deliver fault-tolerant estimation of vehicle states. The proposed method can detect failures of the longitudinal, lateral and vertical acceleration sensors, roll rate, yaw rate and pitch rate sensors, steering angle sensor, suspension height sensors, and motor torque sensors. The proposed structure can deliver fault-tolerant estimations of the vehicle states including the longitudinal, lateral and vertical tire forces, longitudinal and lateral velocities, roll angle, and pitch angle. Road grade and bank angles are also estimated in this method even in presence of sensor faults.
The unified structure in this thesis is realized by fusion of analytical redundancy relations, fault detection observers and adaptive state estimation algorithms. The proposed method can isolate the faults for vehicle stability and control systems and deliver accurate estimation of vehicle states required by such systems despite sensor failures.
The methods developed in this thesis are validated through experiments and can operate reliably in various driving scenarios
Virtual Model Building for Multi-Axis Machine Tools Using Field Data
Accurate machine dynamic models are the foundation of many advanced machining technologies such as virtual process planning and machine condition monitoring. Viewing recent designs of modern high-performance machine tools, to enhance the machine versatility and productivity, the machine axis configuration is becoming more complex and diversified, and direct drive motors are more commonly used. Due to the above trends, coupled and nonlinear multibody dynamics in machine tools are gaining more attention. Also, vibration due to limited structural rigidity is an important issue that must be considered simultaneously. Hence, this research aims at building high-fidelity machine dynamic models that are capable of predicting the dynamic responses, such as the tracking error and motor current signals, considering a wide range of dynamic effects such as structural flexibility, inter-axis coupling, and posture-dependency.
Building machine dynamic models via conventional bottom-up approaches may require extensive investigation on every single component. Such approaches are time-consuming or sometimes infeasible for the machine end-users. Alternatively, as the recent trend of Industry 4.0, utilizing data via Computer Numerical Controls (CNCs) and/or non-intrusive sensors to build the machine model is rather favorable for industrial implementation. Thus, the methods proposed in this thesis are top-down model building approaches, utilizing available data from CNCs and/or other auxiliary sensors. The achieved contributions and results of this thesis are summarized below.
As the first contribution, a new modeling and identification technique targeting a closed-loop control system of coupled rigid multi-axis feed drives has been developed. A multi-axis closed-loop control system, including the controller and the electromechanical plant, is described by a multiple-input multiple-output (MIMO) linear time-invariant (LTI) system, coupled with a generalized disturbance input that represents all the nonlinear dynamics. Then, the parameters of the open-loop and closed-loop dynamic models are respectively identified by a strategy that combines linear Least Squares (LS) and constrained global optimization. This strategy strikes a balance between model accuracy and computational efficiency. This proposed method was validated using an industrial 5-axis laser drilling machine and an experimental feed drive, achieving 2.38% and 5.26% root mean square (RMS) prediction error, respectively. Inter-axis coupling effects, i.e., the motion of one axis causing the dynamic responses of another axis, are correctly predicted. Also, the tracking error induced by motor ripple and nonlinear friction is correctly predicted as well.
As the second contribution, the above proposed methodology is extended to also consider structural flexibility, which is a crucial behavior of large-sized industrial 5-axis machine tools. More importantly, structural vibration is nonlinear and posture-dependent due to the nature of a multibody system. In this thesis, prominent cases of flexibility-induced vibrations in a linear feed drive are studied and modeled by lumped mass-spring-damper system. Then, a flexible linear drive coupled with a rotary drive is systematically analyzed. It is found that the case with internal structural vibration between the linear and rotary drives requires an additional motion sensor for the proposed model identification method. This particular case is studied with an experimental setup.
The thesis presents a method to reconstruct such missing internal structural vibration using the data from the embedded encoders as well as a low-cost micro-electromechanical system (MEMS) inertial measurement unit (IMU) mounted on the machine table. It is achieved by first synchronizing the data, aligning inertial frames, and calibrating mounting misalignments. Finally, the unknown internal vibration is reconstructed by comparing the rigid and flexible machine kinematic models. Due to the measurement limitation of MEMS IMUs and geometric assembly error, the reconstructed angle is unfortunately inaccurate. Nevertheless, the vibratory angular velocity and acceleration are consistently reconstructed, which is sufficient for the identification with reasonable model simplification.
Finally, the reconstructed internal vibration along with the gathered servo data are used to identify the proposed machine dynamic model. Due to the separation of linear and nonlinear dynamics, the vibratory dynamics can be simply considered by adding complex pole pairs into the MIMO LTI system. Experimental validation shows that the identified model is able to predict the dynamic responses of the tracking error and motor force/torque to the input command trajectory and external disturbances, with 2% ~ 6% RMS error. Especially, the vibratory inter-axis coupling effect and posture-dependent effect are accurately depicted.
Overall, this thesis presents a dynamic model-building approach for multi-axis feed drive assemblies. The proposed model is general and can be configured according to the kinematic configuration. The model-building approach only requires the data from the servo system or auxiliary motion sensors, e.g., an IMU, which is non-intrusive and in favor of industrial implementation. Future research includes further investigation of the IMU measurement, geometric error identification, validation using more complicated feed drive system, and applications to the planning and monitoring of 5-axis machining process
Adaptation of the human nervous system for self-aware secure mobile and IoT systems
IT systems have been deployed across several domains, such as hospitals and industries, for the management of information and operations. These systems will soon be ubiquitous in every field due to the transition towards the Internet of Things (IoT). The IoT brings devices with sensory functions into IT systems through the process of internetworking. The sensory functions of IoT enable them to generate and process information automatically, either without human contribution or having the least human interaction possible aside from the information and operations management tasks. Security is crucial as it prevents system exploitation. Security has been employed after system implementation, and has rarely been considered as a part of the system. In this dissertation, a novel solution based on a biological approach is presented to embed security as an inalienable part of the system.
The proposed solution, in the form of a prototype of the system, is based on the functions of the human nervous system (HNS) in protecting its host from the impacts caused by external or internal changes. The contributions of this work are the derivation of a new system architecture from HNS functionalities and experiments that prove the implementation feasibility and efficiency of the proposed HNS-based architecture through prototype development and evaluation.
The first contribution of this work is the adaptation of human nervous system functions to propose a new architecture for IT systems security. The major organs and functions of the HNS are investigated and critical areas are identified for the adaptation process. Several individual system components with similar functions to the HNS are created and grouped to form individual subsystems. The relationship between these components is established in a similar way as in the HNS, resulting in a new system architecture that includes security as a core component. The adapted HNS-based system architecture is employed in two the experiments prove its implementation capability, enhancement of security, and overall system operations.
The second contribution is the implementation of the proposed HNS-based security solution in the IoT test-bed. A temperature-monitoring application with an intrusion detection system (IDS) based on the proposed HNS architecture is implemented as part of the test-bed experiment. Contiki OS is used for implementation, and the 6LoWPAN stack is modified during the development process. The application, together with the IDS, has a brain subsystem (BrSS), a spinal cord subsystem (SCSS), and other functions similar to the HNS whose names are changed. The HNS functions are shared between an edge router and resource-constrained devices (RCDs) during implementation. The experiment is evaluated in both test-bed and simulation environments. Zolertia Z1 nodes are used to form a 6LoWPAN network, and an edge router is created by combining Pandaboard and Z1 node for a test-bed setup. Two networks with different numbers of sensor nodes are used as simulation environments in the Cooja simulator.
The third contribution of this dissertation is the implementation of the proposed HNS-based architecture in the mobile platform. In this phase, the Android operating system (OS) is selected for experimentation, and the proposed HNS-based architecture is specifically tailored for Android. A context-based dynamically reconfigurable access control system (CoDRA) is developed based on the principles of the refined HNS architecture. CoDRA is implemented through customization of Android OS and evaluated under real-time usage conditions in test-bed environments.
During the evaluation, the implemented prototype mimicked the nature of the HNS in securing the application under threat with negligible resource requirements and solved the problems in existing approaches by embedding security within the system. Furthermore, the results of the experiments highlighted the retention of HNS functions after refinement for different IT application areas, especially the IoT, due to its resource-constrained nature, and the implementable capability of our proposed HNS architecture.---
IT-järjestelmiä hyödynnetään tiedon ja toimintojen hallinnassa useilla aloilla, kuten sairaaloissa ja teollisuudessa. Siirtyminen kohti esineiden Internetiä (Internet of Things, IoT) tuo tällaiset laitteet yhä kiinteämmäksi osaksi jokapäiväistä elämää. IT-järjestelmiin liitettyjen IoT-laitteiden sensoritoiminnot mahdollistavat tiedon automaattisen havainnoinnin ja käsittelyn osana suurempaa järjestelmää jopa täysin ilman ihmisen myötävaikutusta, poislukien mahdolliset ylläpito- ja hallintatoimenpiteet. Turvallisuus on ratkaisevan tärkeää IT-järjestelmien luvattoman käytön estämiseksi. Valitettavan usein järjestelmäsuunnittelussa turvallisuus ei ole osana ydinsuunnitteluprosessia, vaan otetaan huomioon vasta käyttöönoton jälkeen. Tässä väitöskirjassa esitellään uudenlainen biologiseen lähestymistapaan perustuva ratkaisu, jolla turvallisuus voidaan sisällyttää erottamattomaksi osaksi järjestelmää.
Ehdotettu prototyyppiratkaisu perustuu ihmisen hermoston toimintaan tilanteessa, jossa se suojelee isäntäänsä ulkoisten tai sisäisten muutosten vaikutuksilta. Tämän työn keskeiset tulokset ovat uuden järjestelmäarkkitehtuurin johtaminen ihmisen hermoston toimintaperiaatteesta sekä tällaisen järjestelmän toteutettavuuden ja tehokkuuden arviointi kokeellisen prototyypin kehittämisen ja toiminnan arvioinnin avulla.
Tämän väitöskirjan ensimmäinen kontribuutio on ihmisen hermoston toimintoihin perustuva IT-järjestelmäarkkitehtuuri. Tutkimuksessa arvioidaan ihmisen hermoston toimintaa ja tunnistetaan keskeiset toiminnot ja toiminnallisuudet, jotka mall-innetaan osaksi kehitettävää järjestelmää luomalla näitä vastaavat järjestelmäkomponentit. Nä-istä kootaan toiminnallisuudeltaan hermostoa vastaavat osajärjestelmät, joiden keskinäinen toiminta mallintaa ihmisen hermoston toimintaa. Näin luodaan arkkitehtuuri, jonka keskeisenä komponenttina on turvallisuus. Tämän pohjalta toteutetaan kaksi prototyyppijärjestelmää, joiden avulla arvioidaan arkkitehtuurin toteutuskelpoisuutta, turvallisuutta sekä toimintakykyä.
Toinen kontribuutio on esitetyn hermostopohjaisen turvallisuusratkaisun toteuttaminen IoT-testialustalla. Kehitettyyn arkkitehtuuriin perustuva ja tunkeutumisen estojärjestelmän (intrusion detection system, IDS) sisältävä lämpötilan seurantasovellus toteutetaan käyttäen Contiki OS -käytöjärjestelmää. 6LoWPAN protokollapinoa muokataan tarpeen mukaan kehitysprosessin aikana. IDS:n lisäksi sovellukseen kuuluu aivo-osajärjestelmä (Brain subsystem, BrSS), selkäydinosajärjestelmä (Spinal cord subsystem, SCSS), sekä muita hermoston kaltaisia toimintoja. Nämä toiminnot jaetaan reunareitittimen ja resurssirajoitteisten laitteiden kesken. Tuloksia arvioidaan sekä simulaatioiden että testialustan tulosten perusteella. Testialustaa varten 6LoWPAN verkon toteutukseen valittiin Zolertia Z1 ja reunareititin on toteutettu Pandaboardin ja Z1:n yhdistelmällä. Cooja-simulaattorissa käytettiin mallinnukseen ymp-äristönä kahta erillistä ja erikokoisuta sensoriverkkoa.
Kolmas tämän väitöskirjan kontribuutio on kehitetyn hermostopohjaisen arkkitehtuurin toteuttaminen mobiilialustassa. Toteutuksen alustaksi valitaan Android-käyttöjärjestelmä, ja kehitetty arkkitehtuuri räätälöidään Androidille. Tuloksena on kontekstipohjainen dynaamisesti uudelleen konfiguroitava pääsynvalvontajärjestelmä (context-based dynamically reconfigurable access control system, CoDRA). CoDRA toteutetaan mukauttamalla Androidin käyttöjärjestelmää ja toteutuksen toimivuutta arvioidaan reaaliaikaisissa käyttöolosuhteissa testialustaympäristöissä.
Toteutusta arvioitaessa havaittiin, että kehitetty prototyyppi jäljitteli ihmishermoston toimintaa kohdesovelluksen suojaamisessa, suoriutui tehtävästään vähäisillä resurssivaatimuksilla ja onnistui sisällyttämään turvallisuuden järjestelmän ydintoimintoihin. Tulokset osoittivat, että tämän tyyppinen järjestelmä on toteutettavissa sekä sen, että järjestelmän hermostonkaltainen toiminnallisuus säilyy siirryttäessä sovellusalueelta toiselle, erityisesti resursseiltaan rajoittuneissa IoT-järjestelmissä
A Human-Centric Metaverse Enabled by Brain-Computer Interface: A Survey
The growing interest in the Metaverse has generated momentum for members of
academia and industry to innovate toward realizing the Metaverse world. The
Metaverse is a unique, continuous, and shared virtual world where humans embody
a digital form within an online platform. Through a digital avatar, Metaverse
users should have a perceptual presence within the environment and can interact
and control the virtual world around them. Thus, a human-centric design is a
crucial element of the Metaverse. The human users are not only the central
entity but also the source of multi-sensory data that can be used to enrich the
Metaverse ecosystem. In this survey, we study the potential applications of
Brain-Computer Interface (BCI) technologies that can enhance the experience of
Metaverse users. By directly communicating with the human brain, the most
complex organ in the human body, BCI technologies hold the potential for the
most intuitive human-machine system operating at the speed of thought. BCI
technologies can enable various innovative applications for the Metaverse
through this neural pathway, such as user cognitive state monitoring, digital
avatar control, virtual interactions, and imagined speech communications. This
survey first outlines the fundamental background of the Metaverse and BCI
technologies. We then discuss the current challenges of the Metaverse that can
potentially be addressed by BCI, such as motion sickness when users experience
virtual environments or the negative emotional states of users in immersive
virtual applications. After that, we propose and discuss a new research
direction called Human Digital Twin, in which digital twins can create an
intelligent and interactable avatar from the user's brain signals. We also
present the challenges and potential solutions in synchronizing and
communicating between virtual and physical entities in the Metaverse
- …