An automatic visual analysis system for tennis

This article presents a novel video analysis system for coaching tennis players of all levels, which uses computer vision algorithms to automatically edit and index tennis videos into meaningful annotations. Existing tennis coaching software lacks the ability to automatically index a tennis match into key events, and therefore, a coach who uses existing software is burdened with time-consuming manual video editing. This work aims to explore the effectiveness of a system to automatically detect tennis events. A secondary aim of this work is to explore the bene- fits coaches experience in using an event retrieval system to retrieve the automatically indexed events. It was found that automatic event detection can significantly improve the experience of using video feedback as part of an instructional coaching session. In addition to the automatic detection of key tennis events, player and ball movements are automati- cally tracked throughout an entire match and this wealth of data allows users to find interesting patterns in play. Player and ball movement information are integrated with the automatically detected tennis events, and coaches can query the data to retrieve relevant key points during a match or analyse player patterns that need attention. This coaching software system allows coaches to build advanced queries, which cannot be facilitated with existing video coaching solutions, without tedious manual indexing. This article proves that the event detection algorithms in this work can detect the main events in tennis with an average precision and recall of 0.84 and 0.86, respectively, and can typically eliminate man- ual indexing of key tennis events

Dynamic Reconfiguration in Camera Networks: A Short Survey

There is a clear trend in camera networks towards enhanced functionality and flexibility, and a fixed static deployment is typically not sufficient to fulfill these increased requirements. Dynamic network reconfiguration helps to optimize the network performance to the currently required specific tasks while considering the available resources. Although several reconfiguration methods have been recently proposed, e.g., for maximizing the global scene coverage or maximizing the image quality of specific targets, there is a lack of a general framework highlighting the key components shared by all these systems. In this paper we propose a reference framework for network reconfiguration and present a short survey of some of the most relevant state-of-the-art works in this field, showing how they can be reformulated in our framework. Finally we discuss the main open research challenges in camera network reconfiguration

Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Wide-Area Surveillance System using a UAV Helicopter Interceptor and Sensor Placement Planning Techniques

This project proposes and describes the implementation of a wide-area surveillance system comprised of a sensor/interceptor placement planning and an interceptor unmanned aerial vehicle (UAV) helicopter. Given the 2-D layout of an area, the planning system optimally places perimeter cameras based on maximum coverage and minimal cost. Part of this planning system includes the MATLAB implementation of Erdem and Sclaroff’s Radial Sweep algorithm for visibility polygon generation. Additionally, 2-D camera modeling is proposed for both fixed and PTZ cases. Finally, the interceptor is also placed to minimize shortest-path flight time to any point on the perimeter during a detection event. Secondly, a basic flight control system for the UAV helicopter is designed and implemented. The flight control system’s primary goal is to hover the helicopter in place when a human operator holds an automatic-flight switch. This system represents the first step in a complete waypoint-navigation flight control system. The flight control system is based on an inertial measurement unit (IMU) and a proportional-integral-derivative (PID) controller. This system is implemented using a general-purpose personal computer (GPPC) running Windows XP and other commercial off-the-shelf (COTS) hardware. This setup differs from other helicopter control systems which typically use custom embedded solutions or micro-controllers. Experiments demonstrate the sensor placement planning achieving \u3e90% coverage at optimized-cost for several typical areas given multiple camera types and parameters. Furthermore, the helicopter flight control system experiments achieve hovering success over short flight periods. However, the final conclusion is that the COTS IMU is insufficient for high-speed, high-frequency applications such as a helicopter control system

Novel EOD Robot Design with a Dexterous Gripper and Intuitive Teleoperation

This project focuses on the design and implementation of an intelligent Explosive Ordinance Disposal (EOD) robot to provide law enforcement agencies with a cost effective and reliable robotic platform. The key features of the robot include an intuitive user interface which provides additional sensor feedback and enhanced visual awareness, an onboard three degree of freedom manipulator arm, and a dexterous gripper allowing for the removal of detonators. The robot provides a safe distance threat assessment and increased capacity for explosive ordinance disposal, improving the effectiveness of bomb disposal teams. The robot\u27s low-cost, intuitive operation and ease-of-maintenance promote its widespread appeal, thereby saving the lives of both law enforcement personnel and civilians

Augmented Reality in Surveillance Systems

The aim with this thesis is to investigate the possibilities to use Augmented Reality (AR) in surveillance systems. The thesis will examine ideas suited for network based cameras but also other devices such as a head mounted display (HMD). AR today is mainly used in smartphones as entertainment and therefore the approach to use AR in surveillance systems will cover new areas. The project will be divided into several steps including investigation, design, tool-evaluation and implementation. Investigation includes numerous brainstorming sessions and research along with storyboards and scenarios. The investigation will lead to a product to be designed and implemented in a selected platform. To design the application, a Lo-Fi and Hi-Fi prototype is created. As a result, a final application was implemented on the platform Android which uses Google Maps as an overview of the camera system. All the cameras are viewed in different manners and in the image, the enhanced AR information is applied to increase the information output and orientation. Axis Communications network cameras where used in the application.Syftet med denna uppsats är att undersöka möjligheterna att använda Augmented Reality i övervakningssystem. Arbetet kommer att utforska idéer anpassade för nätverkskameror men även andra anordningar såsom en head mounted display. Idag används AR huvudsakligen i smartphones som underhållning, vilket innebär att det här projektet kommer leda in AR till nya områden inom övervakning. Projektet är uppdelat i flera steg: utredning, design, utvärdering av verktyg och till sist implementering. Utredningen innehöll brainstormingsessioner och forskning som tillsammans med storyboards och användarfall gav en helhet. Till sist definierades en produkt som skulle utformas och genomföras på en utvald plattform. Vid designfasen skapades en Lo-Fi-prototyp för att undersöka om testpersonerna använde systemet som avsett. Lo-Fi- prototypen gav även ytterligare feedback till ett bättre system. Som ett resultat av alla steg har en slutlig applikation skapats till plattformen Android. Applikationen använder Google Maps för att för att skapa en översikt i kamerasystemet. Bilderna som kamerorna visar är förstärkta med AR, vilket förbättrar bildinformationen samt ger en bättre orientering än tidigare

Augmented Reality

Augmented Reality (AR) is a natural development from virtual reality (VR), which was developed several decades earlier. AR complements VR in many ways. Due to the advantages of the user being able to see both the real and virtual objects simultaneously, AR is far more intuitive, but it's not completely detached from human factors and other restrictions. AR doesn't consume as much time and effort in the applications because it's not required to construct the entire virtual scene and the environment. In this book, several new and emerging application areas of AR are presented and divided into three sections. The first section contains applications in outdoor and mobile AR, such as construction, restoration, security and surveillance. The second section deals with AR in medical, biological, and human bodies. The third and final section contains a number of new and useful applications in daily living and learning

Neuromodulation by endogenous Interlukin-1β in hippocampus of the murine brain: Regulation of neuronal excitation

The pro-inflammatory cytokine, Interleukin-1β (IL-1β), is well known for its ability to initiate and propagate inflammatory responses at sites of infection and tissue injury. Paradoxically at odds with this classic view, it is now clear that IL-1β signaling modulates a number of physiological functions in the central nervous system. In this regard, IL-1β is involved in sleep and body fluid regulation in the basal forebrain and hypothalamus, respectively, and plasticity changes that underlie cognition in the hippocampus. Evidence from a previous study in my laboratory further suggests that IL-1β regulates the innate seizure threshold, which arguably is a reflection of the homeostatic balance between excitation and inhibition (E/I) in the brain. Recognizing that the IL-1β signaling receptor, Interleukin 1 Receptor 1 (IL-1R1), is highly concentrated on granule neurons of the dentate gyrus of the hippocampal formation and that dysfunction of this brain region can shift the E/I balance toward excitation, my research focused on the possibility that constitutive IL-1β signaling in the hippocampal formation modulates brain E/I balance. The specific goal was to elucidate the cellular source(s) and release mechanism of IL-1β in the hippocampus and to examine the functional significance of this release in maintenance of the seizure threshold. In Aim 1, I used the PTZ acute seizure model and mice lacking IL-1R1 to confirm the previous results demonstrating that IL-1β signaling is required for maintenance of the innate seizure threshold. In Aim 2, using a brain-permeable antagonist of the ATP-activated purinergic receptor, P2RX7, I found that IL-1β immunoreactivity accumulated in pyramidal neurons of the CA3 and to a lesser extent in the CA1 subregions of the hippocampus. A subsequent study using hippocampal neuron cultures indicated P2RX7-dependent neuronal release of IL-1β and found that its subcellular localization included both cell bodies and processes of these neurons. Thirdly, I found that P2RX7 increased activity-dependent gene expression in cultures of hippocampal neurons and lowered the seizure threshold in a manner that resembled the phenotype of mice lacking IL-1R1 signaling. Together, results from this aim indicated strong possibility of basal IL-1β release from hippocampal neurons occurring via an ATP-dependent mechanism and contributing to maintaining the E/I balance of the normal brain. Additional results from studies in Aim 3 suggest that the rate of production and release of IL-1β is not affected by changes in neuronal excitation and that IL-1β may affect neuronal excitation via modulation of cyclooxygenase-2 function in hippocampus. Overall, the results from my dissertation research extend the knowledge of the biological function of IL-1β in the normal brain. A better understanding of this function could facilitate development of novel therapies to treat seizure induction in epileptic brains and perhaps reduce the probability of acquiring epilepsy in at-risk individuals

Monocular visual traffic surveillance: a review

To facilitate the monitoring and management of modern transportation systems, monocular visual traffic surveillance systems have been widely adopted for speed measurement, accident detection, and accident prediction. Thanks to the recent innovations in computer vision and deep learning research, the performance of visual traffic surveillance systems has been significantly improved. However, despite this success, there is a lack of survey papers that systematically review these new methods. Therefore, we conduct a systematic review of relevant studies to fill this gap and provide guidance to future studies. This paper is structured along the visual information processing pipeline that includes object detection, object tracking, and camera calibration. Moreover, we also include important applications of visual traffic surveillance systems, such as speed measurement, behavior learning, accident detection and prediction. Finally, future research directions of visual traffic surveillance systems are outlined

LookOut! Interactive Camera Gimbal Controller for Filming Long Takes

The job of a camera operator is more challenging, and potentially dangerous, when filming long moving camera shots. Broadly, the operator must keep the actors in-frame while safely navigating around obstacles, and while fulfilling an artistic vision. We propose a unified hardware and software system that distributes some of the camera operator's burden, freeing them up to focus on safety and aesthetics during a take. Our real-time system provides a solo operator with end-to-end control, so they can balance on-set responsiveness to action vs planned storyboards and framing, while looking where they're going. By default, we film without a field monitor. Our LookOut system is built around a lightweight commodity camera gimbal mechanism, with heavy modifications to the controller, which would normally just provide active stabilization. Our control algorithm reacts to speech commands, video, and a pre-made script. Specifically, our automatic monitoring of the live video feed saves the operator from distractions. In pre-production, an artist uses our GUI to design a sequence of high-level camera "behaviors." Those can be specific, based on a storyboard, or looser objectives, such as "frame both actors." Then during filming, a machine-readable script, exported from the GUI, ties together with the sensor readings to drive the gimbal. To validate our algorithm, we compared tracking strategies, interfaces, and hardware protocols, and collected impressions from a) film-makers who used all aspects of our system, and b) film-makers who watched footage filmed using LookOut.Comment: V2: - Fixed typos. - Cleaner supplemental. - New plot in control section with same data from a supplemental vide