Fly with me : algorithms and methods for influencing a flock

As robots become more affordable, they will begin to exist in the world in greater quantities. Some of these robots will likely be designed to act as components in specific teams. These teams could work on tasks that are too large or complex for a single robot - or that are merely more efficiently accomplished by a team - such as surveillance in a large building or product delivery to packers in a warehouse. Multiagent systems research studies how these teams are formed and how they work together. Ad hoc teamwork, a newer area of multiagent systems research, studies how new robots can join these pre-existing teams and assist the team in accomplishing its goal. This dissertation extends and applies research in ad hoc teamwork towards the general area of flocking, which is an emergent swarm behavior. In particular, the work in this dissertation considers how ad hoc agents - called influencing agents in this dissertation - can join a flock, be recognized by the rest of the flock as part of the flock, influence the flock towards particular behaviors through their own behavior, and then separate from the flock. Specifically, the primary research question addressed in this dissertation is How can influencing agents be utilized in various types of flocks to influence the flock towards a particular behavior? In order to address this research question, this dissertation makes six main types of contributions. First, this dissertation formalizes the problem of using influencing agents to influence a flock. Second, this dissertation contributes and analyzes algorithms for influencing a flock to a desired orientation. Third, this dissertation presents methods for determining how to best add influencing agents to a flock. Fourth, this dissertation provides methods by which influencing agents can join and then leave a flock in motion. Fifth, this dissertation evaluates some of the influencing agent algorithms on a robot platform. Sixth, although the majority of this dissertation assumes the influencing agents will join a flock that behaves similarly to European starlings, this dissertation also provides insight into when and how its algorithms are generalizable to other types of flocks as well as to general teamwork and coordination research. All of the methods presented in this dissertation are empirically evaluated using a simulator that can support large flocks.Computer Science

Effect of leader placement on robotic swarm control

Human control of a robotic swarm entails selecting a few in-fluential leaders who can steer the collective efficiently and robustly. However, a clear measure of influence with respect to leader position is not adequately studied. Studies with animal systems have shown that leaders who exert strong couplings may be located in front, where they provide energy benefits, or in the middle, where they can be seen by a larger section of the group. In this paper, we systematically vary number of leaders and leader positions in simulated robotic swarms of two different sizes, and assess their effect on steering effectiveness and energy expenditure. In particular, we analyze the effect of placing leaders in the front, middle, and periphery, on the time to converge and lateral acceleration of a swarm of robotic agents as it performs a single turn to reach the desired goal direction. Our results show that swarms with leaders in the middle and periphery take less time to converge than swarms with leaders in the front, while the lateral acceleration between the three placement strategies is not different. We also find that the time to converge towards the goal direction reduces with the increase in percentage of leaders in the swarm, although this value decays slowly beyond the percentage of leaders at 30%. As the swarm size is increased, we find that the leaders in the periphery become less effective in reducing the time to converge. Finally, closer analysis of leader placement and coverage reveals that front leaders within the swarm tend to expand their coverage and move towards the center as the maneuver is performed. Results from this study are expected to inform leader placement strategies towards more effective human swarm interaction systems

Evaluation of Water Sanitation Options for Poultry Production

An evaluation of poultry farm water supplies was conducted to determine the value and impact of water system sanitation practices in commercial broiler houses on microbial levels. Water line cleaning between flocks using concentrated disinfectant solution before placing chicks reduced biofilms retained in the lines to a safe level. Occasional microbial surges were noticed during different points of flock grow-out period even when daily water sanitation was present indicating water is highly susceptible to microbial contamination. However, the daily water sanitation practice controlled the occasional microbial surges in water from sustaining and kept drinking water to a microbiologically acceptable level. Regardless of the line cleaning between flocks and daily water sanitation practice, biofilm buildup in water lines reoccurred by the 6th week of bird grow-out period requiring a mandatory line cleaning between flocks to optimize system hygiene and to ensure microbiologically safe water for the next flock of chicks. The second study involved using hydrogen peroxide as an alternative disinfectant to chlorine for water sanitation. An in vitro trial was conducted to evaluate commercially available hydrogen peroxide products at their recommended concentrations for residuals and efficacy over time. Effective Residual Concentration (ERC) of 25-50 ppm of hydrogen peroxide in test solution (drinking rate for birds) started in the lowest concentration tested at 59. 14 ml of product added to 3780 ml of water creating stock solution for all products tested. At this concentration, all products maintained the ERC level at least for 3 days of preparing test solutions, with tendency of holding this residual level for a longer period by stabilized products than non- stabilized. Significant bacterial reductions within an hour of contact time were achieved in 48 hours post treatment microbial water introduction in test solutions as challenge. However, higher residuals or longer contact time was required for mold control. Key words: water sanitation practice, microbial levels, disinfectants, efficac

Real-time Learning and Planning in Environments with Swarms:A Hierarchical and a Parameter-based Simulation Approach

Swarms can be applied in many relevant domains, such as patrolling or rescue. They usually follow simple local rules, leading to complex emergent behavior. Given their wide applicability, an agent may need to take decisions in an environment containing a swarm that is not under its control, and that may even be an antagonist. Predicting the behavior of each swarm member is a great challenge, and must be done under real time constraints, since they usually move constantly following quick reactive algorithms. We propose the first two solutions for this novel problem, showing integrated on-line learning and planning for decision-making with unknown swarms: (i) we learn an ellipse abstraction of the swarm based on statistical models, and predict its future parameters using time-series; (ii) we learn algorithm parameters followed by each swarm member, in order to directly simulate them. We find in our experiments that we are significantly faster to reach an objective than local repulsive forces, at the cost of success rate in some situations. Additionally, we show that this is a challenging problem for reinforcement learning

The genesis and development of deathscapes in America -- a story of how Chicago and Louisville cemeteries demonstrate the shifting rationale of cemetery placement during the 19th and 20th centuries.

Today, most construction projects require a systematic site qualification based on a suitability analysis utilizing parameters such as slope, soil type, elevation, distance to open water, and distance to transportation. The proper siting determines the success of a project in terms of project stability and longevity. However, has this suitability analysis exist for one of the most significant phases of humanity – death. Historically dead bodies seem to have been placed without suitable qualification being many cemeteries have created environmental problems for the living. Hence, with which placement rationale has been used comes to mind. With a varied array of rationale used in cemetery placement, this thesis aimed to focus on a simple question. Were cemeteries placed based on qualifying criteria mentioned above or not? If so, factors beyond a normal suitability analysis exist. If not, then these qualifying criteria should probably be employed going forward. This question was investigated through a spatial analysis of cemeteries placed in two different geographical areas of the United States

Computational Intelligence for Cooperative Swarm Control

Over the last few decades, swarm intelligence (SI) has shown significant benefits in many practical applications. Real-world applications of swarm intelligence include disaster response and wildlife conservation. Swarm robots can collaborate to search for survivors, locate victims, and assess damage in hazardous environments during an earthquake or natural disaster. They can coordinate their movements and share data in real-time to increase their efficiency and effectiveness while guiding the survivors. In addition to tracking animal movements and behaviour, robots can guide animals to or away from specific areas. Sheep herding is a significant source of income in Australia that could be significantly enhanced if the human shepherd could be supported by single or multiple robots. Although the shepherding framework has become a popular SI mechanism, where a leading agent (sheepdog) controls a swarm of agents (sheep) to complete a task, controlling a swarm of agents is still not a trivial task, especially in the presence of some practical constraints. For example, most of the existing shepherding literature assumes that each swarm member has an unlimited sensing range to recognise all other members’ locations. However, this is not practical for physical systems. In addition, current approaches do not consider shepherding as a distributed system where an agent, namely a central unit, may observe the environment and commu- nicate with the shepherd to guide the swarm. However, this brings another hurdle when noisy communication channels between the central unit and the shepherd af- fect the success of the mission. Also, the literature lacks shepherding models that can cope with dynamic communication systems. Therefore, this thesis aims to design a multi-agent learning system for effective shepherding control systems in a partially observable environment under communication constraints. To achieve this goal, the thesis first introduces a new methodology to guide agents whose sensing range is limited. In this thesis, the sheep are modelled as an induced network to represent the sheep’s sensing range and propose a geometric method for finding a shepherd-impacted subset of sheep. The proposed swarm optimal herding point uses a particle swarm optimiser and a clustering mechanism to find the sheepdog’s near-optimal herding location while considering flock cohesion. Then, an improved version of the algorithm (named swarm optimal modified centroid push) is proposed to estimate the sheepdog’s intermediate waypoints to the herding point considering the sheep cohesion. The approaches outperform existing shepherding methods in reducing task time and increasing the success rate for herding. Next, to improve shepherding in noisy communication channels, this thesis pro- poses a collaborative learning-based method to enhance communication between the central unit and the herding agent. The proposed independent pre-training collab- orative learning technique decreases the transmission mean square error by half in 10% of the training time compared to existing approaches. The algorithm is then ex- tended so that the sheepdog can read the modulated herding points from the central unit. The results demonstrate the efficiency of the new technique in time-varying noisy channels. Finally, the central unit is modelled as a mobile agent to lower the time-varying noise caused by the sheepdog’s motion during the task. So, I propose a Q-learning- based incremental search to increase transmission success between the shepherd and the central unit. In addition, two unique reward functions are presented to ensure swarm guidance success with minimal energy consumption. The results demonstrate an increase in the success rate for shepherding