Study of artificial intelligence and computer vision methods for tracking transmission lines with the AID of UAVs

Currently, Unmanned Aerial Vehicles (UAVs) have been used in the most diverse applications in both the civil and military sectors. In the civil sector, aerial inspection services have been gaining a lot of attention, especially in the case of inspections of high voltage electrical systems transmission lines. This type of inspection involves a helicopter carrying three or more people (technicians, pilot, etc.) flying over the transmission line along its entire length which is a dangerous service especially due to the proximity of the transmission line and possible environmental conditions (wind gusts, for example). In this context, the use of UAVs has shown considerable interest due to their low cost and safety for transmission line inspection technicians. This work presents research results related to the application of UAVs for transmission lines inspection, autonomously, allowing the identification of invasions of the transmission line area as well as possible defects in components (cables, insulators, connection, etc.) through the use of Convolutional Neural Networks (CNN) for fault detection and identification. This thesis proposes the development of an autonomous system to track power transmission lines using UAVs efficiently and with low implementation and operation costs, based exclusively on rea-time image processing that identifies the structure of the towers and transmission lines durin the flight and controls the aircraft´s movements, guiding it along the closest possible path. A sumary of the work developed will be presented in the next sections.Atualmente, os Veículos Aéreos Não Tripulados – VANTs têm sido utilizados nas mais diversas aplicações tanto no setor civil quanto militar. No setor civil, os serviços de inspeção aérea vêm ganhando bastante atenção, principalmente no caso de inspeções de linhas de transmissão de sistemas elétricos de alta tensão. Este tipo de inspeção envolve um helicóptero transportando três ou mais pessoas (técnicos, pilotos, etc.) sobrevoando a linha de transmissão em toda a sua extensão, o que constitui um serviço perigoso principalmente pela proximidade da linha de transmissão e possíveis condições ambientais (rajadas de vento, por exemplo). Neste contexto, a utilização de VANTs tem demonstrado considerável interesse devido ao seu baixo custo e segurança para técnicos de inspeção de linhas de transmissão. Este trabalho apresenta resultados de pesquisas relacionadas à aplicação de VANTs para inspeção de linhas de transmissão, de forma autônoma, permitindo a identificação de invasões da área da linha de transmissão bem como possíveis defeitos em componentes (cabos, isoladores, conexões, etc.) através do uso de Convolucional. Redes Neurais - CNN para detecção e identificação de falhas. Esta tese propõe o desenvolvimento de um sistema autônomo para rastreamento de linhas de transmissão de energia utilizando VANTs de forma eficiente e com baixos custos de implantação e operação, baseado exclusivamente no processamento de imagens em tempo real que identifica a estrutura das torres e linhas de transmissão durante o voo e controla a velocidade da aeronave. movimentos, guiando-o pelo caminho mais próximo possível. Um resumo do trabalho desenvolvido será apresentado nas próximas seções

An OpenEaagles Framework Extension for Hardware-in-the-Loop Swarm Simulation

Unmanned Aerial Vehicle (UAV) swarm applications, algorithms, and control strategies have experienced steady growth and development over the past 15 years. Yet, to this day, most swarm development efforts have gone untested and thus unimplemented. Cost of aircraft systems, government imposed airspace restrictions, and the lack of adequate modeling and simulation tools are some of the major inhibitors to successful swarm implementation. This thesis examines how the OpenEaagles simulation framework can be extended to bridge this gap. This research aims to utilize Hardware-in-the-Loop (HIL) simulation to provide developers a functional capability to develop and test the behaviors of scalable and modular swarms of autonomous UAVs in simulation with high confidence that these behaviors will prop- agate to real/live ight tests. Demonstrations show the framework enhances and simplifies swarm development through encapsulation, possesses high modularity, pro- vides realistic aircraft modeling, and is capable of simultaneously accommodating four hardware-piloted swarming UAVs during HIL simulation or 64 swarming UAVs during pure simulation

Autonomous Recognition of Collective Motion Behaviours in Robot Swarms from Vision Data Using Deep Neural Networks

The study of natural swarms and the attempt to replicate their behaviours in artificial systems have been an active area of research for many years. The complexity of such systems, arising from simple interactions of many similar units, is fascinating and has inspired researchers from various disciplines to study and understand the underlying mechanisms. In robotics, implementing swarm behaviours in embodied agents (robots) is challenging due to the need to design simple rules for interaction between individual robots that can lead to complex collective behaviours. Every new behaviour designed needs to be manually tuned to function well on any given robotic platform. While it is relatively easy to design rule-based systems that can display structured collective behaviour (such as collective motion or grouping), computers still need to recognise such behaviour when it occurs. Recognition of swarm behaviour is useful in at least two cases. In Case 1, it permits a party to recognise a swarm controlled by another party in an adversarial interaction. Case 2, it permits a machine to develop collective behaviours autonomously by recognising when desirable behaviour emerges. Existing work has examined collective behaviour recognition using feature-based data describing a swarm. However, this may not be feasible in Case 1 if feature-based data is not available for an adversarial swarm. This thesis proposes deep neural network approaches to recognising collective behaviour from video data. The work contributes four datasets comprising examples of both collective flocking behaviour and random behaviour in groups of Pioneer 3DX robots. The first dataset captures the behaviours from the perspective of a top-down video to address Case 1. The second and third datasets capture the behaviours from the perspective of forward-facing cameras on each robot as an approach to Case 2. As well, the fourth dataset captures behaviours using spherical cameras that contribute to Case 2. We also make use of feature-based data describing the same behaviours for comparative purposes. This thesis contributes the design of a deep neural network appropriate for learning to recognise collective behaviour from video data. We compare the performance of this network to that of a shallow network trained on feature-based data in terms of distinguishing collective from random motion and distinguishing various grouping parameters of collective behaviour. Results show that video data can be as accurate as feature-based data for distinguishing flocking collective motion from random motion. We also present a case study showing that our approach to the recognition of collective motion can transfer from simulated robots to real robots

Interactive sonification exploring emergent behavior applying models for biological information and listening

Sonification is an open-ended design task to construct sound informing a listener of data. Understanding application context is critical for shaping design requirements for data translation into sound. Sonification requires methodology to maintain reproducibility when data sources exhibit non-linear properties of self-organization and emergent behavior. This research formalizes interactive sonification in an extensible model to support reproducibility when data exhibits emergent behavior. In the absence of sonification theory, extensibility demonstrates relevant methods across case studies. The interactive sonification framework foregrounds three factors: reproducible system implementation for generating sonification; interactive mechanisms enhancing a listener's multisensory observations; and reproducible data from models that characterize emergent behavior. Supramodal attention research suggests interactive exploration with auditory feedback can generate context for recognizing irregular patterns and transient dynamics. The sonification framework provides circular causality as a signal pathway for modeling a listener interacting with emergent behavior. The extensible sonification model adopts a data acquisition pathway to formalize functional symmetry across three subsystems: Experimental Data Source, Sound Generation, and Guided Exploration. To differentiate time criticality and dimensionality of emerging dynamics, are applied between subsystems to maintain scale and symmetry of concurrent processes and temporal dynamics. Tuning functions accommodate sonification design strategies that yield order parameter values to render emerging patterns discoverable as well as , to reproduce desired instances for clinical listeners. Case studies are implemented with two computational models, Chua's circuit and Swarm Chemistry social agent simulation, generating data in real-time that exhibits emergent behavior. is introduced as an informal model of a listener's clinical attention to data sonification through multisensory interaction in a context of structured inquiry. Three methods are introduced to assess the proposed sonification framework: Listening Scenario classification, data flow Attunement, and Sonification Design Patterns to classify sound control. Case study implementations are assessed against these methods comparing levels of abstraction between experimental data and sound generation. Outcomes demonstrate the framework performance as a reference model for representing experimental implementations, also for identifying common sonification structures having different experimental implementations, identifying common functions implemented in different subsystems, and comparing impact of affordances across multiple implementations of listening scenarios

Agent-Based Modelling as a Foundation for Big Data

In this article we propose a process-based definition of big data, as opposed to the size - and technology-based definitions. We argue that big data should be perceived as a continu- ous, unstructured and unprocessed dynamics of primitives, rather than as points (snapshots) or summaries (aggregates) of an underlying phenomenon. Given this, we show that big data can be generated through agent-based models but not by equation-based models. Though statistical and machine learning tools can be used to analyse big data, they do not constitute a big data-generation mechanism. Furthermore, agent-based models can aid in evaluating the quality (interpreted as information aggregation efficiency) of big data. Based on this, we argue that agent-based modelling can serve as a possible foundation for big data. We substantiate this interpretation through some pioneering studies from the 1980s on swarm intelligence and several prototypical agent-based models developed around the 2000s

Amergent Music: behavior and becoming in technoetic & media arts

Merged with duplicate records 10026.1/1082 and 10026.1/2612 on 15.02.2017 by CS (TIS)Technoetic and media arts are environments of mediated interaction and emergence, where meaning is negotiated by individuals through a personal examination and experience—or becoming—within the mediated space. This thesis examines these environments from a musical perspective and considers how sound functions as an analog to this becoming. Five distinct, original musical works explore the possibilities as to how the emergent dynamics of mediated, interactive exchange can be leveraged towards the construction of musical sound. In the context of this research, becoming can be understood relative to Henri Bergson’s description of the appearance of reality—something that is making or unmaking but is never made. Music conceived of a linear model is essentially fixed in time. It is unable to recognize or respond to the becoming of interactive exchange, which is marked by frequent and unpredictable transformation. This research abandons linear musical approaches and looks to generative music as a way to reconcile the dynamics of mediated interaction with a musical listening experience. The specifics of this relationship are conceptualized in the structaural coupling model, which borrows from Maturana & Varela’s “structural coupling.” The person interacting and the generative musical system are compared to autopoietic unities, with each responding to mutual perturbations while maintaining independence and autonomy. Musical autonomy is sustained through generative techniques and organized within a psychogeographical framework. In the way that cities invite use and communicate boundaries, the individual sounds of a musical work create an aural context that is legible to the listener, rendering the consequences or implications of any choice audible. This arrangement of sound, as it relates to human presence in a technoetic environment, challenges many existing assumptions, including the idea “the sound changes.” Change can be viewed as a movement predicated by behavior. Amergent music is brought forth through kinds of change or sonic movement more robustly explored as a dimension of musical behavior. Listeners hear change, but it is the result of behavior that arises from within an autonomous musical system relative to the perturbations sensed within its environment. Amergence propagates through the effects of emergent dynamics coupled to the affective experience of continuous sonic transformation.Rutland Port Authoritie

Dynamic Guarding of Marine Assets Through Cluster Control of Automated Surface Vessel Fleets

There is often a need to mark or patrol marine areas in order to prevent boat traffic from approaching critical regions, such as the location of a high-value vessel, a dive site, or a fragile marine ecosystem. In this paper, we describe the use of a fleet of robotic kayaks that provides such a function: the fleet circumnavigates the critical area until a threatening boat approaches, at which point the fleet establishes a barrier between the ship and the protected area. Coordinated formation control of the fleet is implemented through the use of the cluster-space control architecture, which is a full-order controller that treats the fleet as a virtual, articulating, kinematic mechanism. An application-specific layer interacts with the cluster-space controller in order for an operator to directly specify and monitor guarding-related parameters, such as the spacing between boats. This system has been experimentally verified in the field with a fleet of robotic kayaks. In this paper, we describe the control architecture used to establish the guarding behavior, review the design of the robotic kayaks, and present experimental data regarding the functionality and performance of the system.Fil: Mahacek, Paul. Santa Clara University; Estados UnidosFil: Kitts, Christopher A.. Santa Clara University; Estados UnidosFil: Mas, Ignacio Agustin. Santa Clara University; Estados Unidos. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentin