An auction-based approach with closed-loop bid adjustment to dynamic task allocation in robot teams

Dynamic task allocation is among the most difficult issues in multi-robot coordination, although it is imperative for a multitude of applications. Auction-based approaches are popular methods that allocate tasks to robots by assembling team information at a single location to make practicable decisions. However, a main deficiency of auction-based methods is that robots generally do not have sufficient information to estimate reliable bids to perform tasks, particularly in dynamic environments. While some techniques have been developed to improve bidding, they are mostly open-looped without feed-back adjustments to tune the bid prices for subsequent tasks of the same type. Robots' bids, if not assessed and adjusted accordingly, may not be trustworthy and would indeed impede team performance. To address this issue, we propose a closed-loop bid adjustment mechanism for auction-based multi-robot task allocation, with an aim to evaluate and improve robots' bids, and hence enhance the overall team performance. Each robot in a team maintains and uses its own track record as closed-loop feedback information to adjust and improve its bid prices. After a robot has completed a task, it assesses and records its performance to reflect the discrepancy between the bid price and the actual cost of the task. Such performance records, with time-discounting factors, are taken into account to damp out fluctuations of bid prices. Adopting this adjustment mechanism, a task would be more likely allocated to a competent robot that submits a more accurate bid price, and hence improve the overall team performance. Simulation of task allocation of free-range automated guided vehicles serving at a container terminal is presented to demonstrate the effectiveness of the adjustment mechanism.postprintThe World Congress on Engineering (WCE 2011), London, U.K., 6-8 July 2011. In Proceedings of WCE, 2011, v. 2, p. 1061-106

Performance optimisation of mobile robots in dynamic environments

This paper presents a robotic simulation system, that combines task allocation and motion planning of multiple mobile robots, for performance optimisation in dynamic environments. While task allocation assigns jobs to robots, motion planning generates routes for robots to execute the assigned jobs. Task allocation and motion planning together play a pivotal role in optimisation of robot team performance. These two issues become more challenging when there are often operational uncertainties in dynamic environments. We address these issues by proposing an auction-based closed-loop module for task allocation and a bio-inspired intelligent module for motion planning to optimise robot team performance in dynamic environments. The task allocation module is characterised by a closed-loop bid adjustment mechanism to improve the bid accuracy even in light of stochastic disturbances. The motion planning module is bio-inspired intelligent in that it features detection of imminent neighbours and responsiveness of virtual force navigation in dynamic traffic conditions. Simulations show that the proposed system is a practical tool to optimise the operations by a team of robots in dynamic environments. © 2012 IEEE.published_or_final_versionThe IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS 2012), Tianjin, China, 2-4 July 2012. In Proceedings of IEEE VECIMS, 2012, p. 54-5

Model-based viewpoint invariant human activity recognition from uncalibrated monocular video sequence

There is growing interest in human activity recognition systems, motivated by their numerous promising applications in many domains. Despite much progress, most researchers have narrowed the problem towards fixed camera viewpoint owing to inherent difficulty to train their systems across all possible viewpoints. Fixed viewpoint systems are impractical in real scenarios. Therefore, we attempt to relax the fixed viewpoint assumption and present a novel and simple framework to recognize and classify human activities from uncalibrated monocular video source from any viewpoint. The proposed framework comprises two stages: 3D human pose estimation and human activity recognition. In the pose estimation stage, we estimate 3D human pose by a simple search-based and tracking-based technique. In the activity recognition stage, we use Nearest Neighbor, with Dynamic Time Warping as a distance measure, to classify multivariate time series which emanate from streams of pose vectors from multiple video frames. We have performed some experiments to evaluate the accuracy of the two stages separately. The encouraging experimental results demonstrate the effectiveness of our framework