Adaptive Multi-Camera System for Real Time Object Detection

In this paper we present an adaptive multi-camera system for real time object detection able to efficiently adjust the computational requirements of video processing blocks to the available processing power and the activity of the scene. The system is based on a two level adaptation strategy that works at local and at global level. Object detection is based on a Gaussian mixtures model background subtraction algorithm. Results show that the system can efficiently adapt the algorithm parameters without a significant loss in the detection accuracy

Hierarchical Object Detection applied to Fish Species

Gathering information of aquatic life is often based on timeconsuming methods utilizing video feeds. It would be beneficial to capture more information cost-effectively from video feeds. Video based object detection has an ability to achieve this. Recent research has shown promising results with the use of YOLO for object detection of fish. As underwater conditions can be difficult and thus fish species are hard to discriminate. This study proposes a hierarchical structure-based YOLO Fish algorithm in both the classification and the dataset to gain valuable information. With the use of hierarchical classification and other techniques. YOLO Fish is a state-of-the-art object detector on Nordic fish species, with an mAP of 91.8%. The algorithm has an inference time of 26.4 ms, fast enough to run on real-time video on the high-end GPU Tesla V100.Hierarchical Object Detection applied to Fish SpeciespublishedVersio

Hierarchical Fish Species Detection in Real-Time Video Using YOLO

Master's thesis in Information- and communication technology (IKT590)Information gathering of aquatic life is often based on time consuming methods with a foundation in video feeds. It would be beneficial to capture more information in a cost effective manner from video feeds, and video object detection has an opportunity to achieve this. Recent research has shown promising results with the use of YOLO for object detection of fish. As under-water conditions can be difficult and fish species hard to discriminate, we propose the use of a hierarchical structures in both the classification and the dataset to gain valuable information. With the use of hierarchical classification and other techniques we present YOLO Fish. YOLO Fish is a state of the art object detector on nordic fish species, with an mAP of 91.8%. For a more stable video, YOLO Fish can be used with the object tracking algorithm SORT. This results in a complete fish detector for real-time video

Smart environment monitoring through micro unmanned aerial vehicles

In recent years, the improvements of small-scale Unmanned Aerial Vehicles (UAVs) in terms of flight time, automatic control, and remote transmission are promoting the development of a wide range of practical applications. In aerial video surveillance, the monitoring of broad areas still has many challenges due to the achievement of different tasks in real-time, including mosaicking, change detection, and object detection. In this thesis work, a small-scale UAV based vision system to maintain regular surveillance over target areas is proposed. The system works in two modes. The first mode allows to monitor an area of interest by performing several flights. During the first flight, it creates an incremental geo-referenced mosaic of an area of interest and classifies all the known elements (e.g., persons) found on the ground by an improved Faster R-CNN architecture previously trained. In subsequent reconnaissance flights, the system searches for any changes (e.g., disappearance of persons) that may occur in the mosaic by a histogram equalization and RGB-Local Binary Pattern (RGB-LBP) based algorithm. If present, the mosaic is updated. The second mode, allows to perform a real-time classification by using, again, our improved Faster R-CNN model, useful for time-critical operations. Thanks to different design features, the system works in real-time and performs mosaicking and change detection tasks at low-altitude, thus allowing the classification even of small objects. The proposed system was tested by using the whole set of challenging video sequences contained in the UAV Mosaicking and Change Detection (UMCD) dataset and other public datasets. The evaluation of the system by well-known performance metrics has shown remarkable results in terms of mosaic creation and updating, as well as in terms of change detection and object detection

Object Detection using Particle Swarm Optimisation and Kalman Filter to Track Partially occluded Targets

Motion estimation, object detection, and tracking have been actively pursued by researchers in the field of real time video processing. In the present work, a new algorithm is proposed to automatically detect objects using revised local binary pattern (m-LBP) for object detection. The detected object was tracked and its location estimated using the Kalman filter, whose state covariance matrix was tuned using particle swarm optimisation (PSO). PSO, being a nature inspired algorithm, is a well proven optimization technique. This algorithm was applied to important real-world problems of partially-occluded objects in infrared videos. Algorithm validation was performed by realizing a thermal imager, and this novel algorithm was implemented in it to demonstrate that the proposed algorithm is more efficient and produces better results in motion estimation for partially-occluded objects. It is also shown that track convergence is 56% faster in the PSO-Kalman algorithm than tracking with Kalman-only filter