A Real-time Target Detection Algorithm for Panorama Infrared Search and Track System

AbstractWith regard to target detection in high resolution panorama images attained by circumferential scan Infrared Search and Tracking system, a rough-to-meticulous real-time target detection algorithm is proposed based on analysis of characteristics of targets and background. In the rough detection phase, it attains initial high rate target detection by quick real-time algorithm, based on the gray high frequency and movement characteristics of the target in the whole panorama image. In the meticulous detection phase, focusing on the detected suspected target sliced images, it has further delicate detection and recognition on the basis of targets’ characteristics to exclude those false jamming. The detection result of the test images shows, the algorithm enables stable detection with low-rate false alarm for distant dim small targets, and has been applied to the development of engineering sample of the Panorama Infrared Search and Tracking system

Airborne Infrared Search and Track Systems

Infrared search and track (IRST) systems are required for fighter aircraft to enable them to passively search, detect, track, classify, and prioritise multiple airborne targets under all aspects, look-up, look-down, and co-altitude conditions and engage them at as long ranges as possible. While the IRST systems have been proven in performance for ground-based and naval-based platforms, it is still facing some technical problems for airborne applications. These problems arise from uncertainty in target signature, atmospheric effects, background clutter (especially dense and varying clouds), signal and data processing algorithms to detect potential targets at long ranges and some hardware limitations such as large memory requirement to store and process wide field of view data. In this paper, an overview of airborne IRST as a system has been presented with detailed comparative simulation results of different detectionitracking algorithms and the present status of airborne IRST

A flexible algorithm for detecting challenging moving objects in real-time within IR video sequences

Real-time detecting moving objects in infrared video sequences may be particularly challenging because of the characteristics of the objects, such as their size, contrast, velocity and trajectory. Many proposed algorithms achieve good performances but only in the presence of some specific kinds of objects, or by neglecting the computational time, becoming unsuitable for real-time applications. To obtain more flexibility in different situations, we developed an algorithm capable of successfully dealing with small and large objects, slow and fast objects, even if subjected to unusual movements, and poorly-contrasted objects. The algorithm is also capable to handle the contemporary presence of multiple objects within the scene and to work in real-time even using cheap hardware. The implemented strategy is based on a fast but accurate background estimation and rejection, performed pixel by pixel and updated frame by frame, which is robust to possible background intensity changes and to noise. A control routine prevents the estimation from being biased by the transit of moving objects, while two noise-adaptive thresholding stages, respectively, drive the estimation control and allow extracting moving objects after the background removal, leading to the desired detection map. For each step, attention has been paid to develop computationally light solution to achieve the real-time requirement. The algorithm has been tested on a database of infrared video sequences, obtaining promising results against different kinds of challenging moving objects and outperforming other commonly adopted solutions. Its effectiveness in terms of detection performance, flexibility and computational time make the algorithm particularly suitable for real-time applications such as intrusion monitoring, activity control and detection of approaching objects, which are fundamental task in the emerging research area of Smart City

A combined approach to infrared small target detection with the alternating direction method of multipliers and an improved top-hat transformation

In infrared small target detection, the infrared patch image model (IPI) based methods produce better results than other popular approaches (such as Max-Mean, top-hat, and Human Visual System) but suffer from the long processing times and serious clutters and noises. To tackle such issues, we take a novel approach to divide the traditional target detection process into a background suppression step and a noise and clutter elimination step. The proposed method firstly adapts the alternating direction method of multipliers to preliminarily remove the background. This step does not require sliding patches thus reducing the processing time significantly. The interim results are then processed via an improved new top-hat transformation using a specifically constructed threefold structuring element, to eliminate the residual noises and clutters. The binarised segmentation is done using adaptive thresholds. The experiment results show our method can detect the infrared targets more efficiently and consistently than both the IPI and the new top-hat methods as well as some other widely used methods

Life-like Image Processing for Small Target Motion Detection in Cluttered Dynamic Environments

Discriminating targets moving against a cluttered background is a huge challenge for future robotic vision systems, let alone detecting a target as small as one or a few pixels. As a source of inspiration, insects are quite apt at searching for mates and tracking prey – which always appear as small dim speckles in the visual field. The exquisite sensitivity of insects for small target motion, as revealed recently, is coming from a class of specific neurons called small target motion detectors (STMDs). Some of the STMDs have also demonstrated direction selectivity which means these STMDs respond strongly only to their preferred motion direction. Build a quantitative STMD model is the first step for not only further understanding of the biological visual system, but also providing robust and economic solutions of small target detection for an artificial visual system. This research aims to explore STMD-based image processing methods for small target motion detection against cluttered dynamic backgrounds. The major contributions are summarized as follows. Three STMD-based neural models are proposed in this research named as directionally selective STMD(DSTMD), STMD Plus and Feedback STMD, respectively. The DSTMD systematically models and studies direction selectivity of the STMD neurons, meanwhile provides with unified and rigorous mathematical description. Specifically, in the DSTMD, a new correlation mechanism is introduced for direction selectivity via correlating signals relayed from two pixels. Then, a lateral inhibition mechanism is implemented on the spatial field for size selectivity of the STMD neurons. Finally, a population vector algorithm is used to encode motion direction of small targets. Extensive experiments showed that the proposed DSTMD not only is in accord with current biological findings, i.e. showing directional preferences, but also works reliably in detecting small targets against cluttered backgrounds. The STMD Plus is developed to discriminate small targets from small-target-like background features (named as fake features) by integrating motion information with directional contrast. More precisely, the STMD Plus is composed of four subsystems – ommatidia, motion pathway, contrast pathway and mushroom body. Compared to existing STMD-based models, the additional contrast pathway extracts directional contrast from luminance signals to eliminate false positive background motion. The directional contrast and the extracted motion information by the motion pathway are integrated in the mushroom body for small target discrimination. The experimental results demonstrated the significant and consistent improvements of the proposed visual system model over existing STMD-based models against fake features. The Feedback STMD is also designed to filter out fake features by introducing a new feedback mechanism. Specifically, the model output is first temporally delayed then applied to the previous neural layer to construct a feedback loop. By subtracting the feedback signal from the inputs of the STMDs, the background fake features are largely suppressed. Experimental results show that the developed feedback neural model achieves better performance than the existing STMD-based models in discriminating small targets from complex backgrounds

Filter design for small target detection on infrared imagery using normalized-cross-correlation layer

In this paper, we introduce a machine learning approach to the problem of infrared small target detection filter design. For this purpose, similarly to a convolutional layer of a neural network, the normalized-cross-correlational (NCC) layer, which we utilize for designing a target detection/recognition filter bank, is proposed. By employing the NCC layer in a neural network structure, we introduce a framework, in which supervised training is used to calculate the optimal filter shape and the optimum number of filters required for a specific target detection/recognition task on infrared images. We also propose the mean-absolute-deviation NCC (MAD-NCC) layer, an efficient implementation of the proposed NCC layer, designed especially for FPGA systems, in which square root operations are avoided for real-time computation. As a case study we work on dim-target detection on mid-wave infrared imagery and obtain the filters that can discriminate a dim target from various types of background clutter, specific to our operational concept

Sea-Surface Object Detection Based on Electro-Optical Sensors: A Review

Sea-surface object detection is critical for navigation safety of autonomous ships. Electrooptical (EO) sensors, such as video cameras, complement radar on board in detecting small obstacle sea-surface objects. Traditionally, researchers have used horizon detection, background subtraction, and foreground segmentation techniques to detect sea-surface objects. Recently, deep learning-based object detection technologies have been gradually applied to sea-surface object detection. This article demonstrates a comprehensive overview of sea-surface object-detection approaches where the advantages and drawbacks of each technique are compared, covering four essential aspects: EO sensors and image types, traditional object-detection methods, deep learning methods, and maritime datasets collection. In particular, sea-surface object detections based on deep learning methods are thoroughly analyzed and compared with highly influential public datasets introduced as benchmarks to verify the effectiveness of these approaches. The arti

Infrared small-target detection based on background-suppression proximal gradient and GPU acceleration

Patch-based methods improve the performance of infrared small target detection, transforming the detection problem into a Low-Rank Sparse Decomposition (LRSD) problem. However, two challenges hinder the success of these methods: (1) The interference from strong edges of the background, and (2) the time-consuming nature of solving the model. To tackle these two challenges, we propose a novel infrared small-target detection method using a Background-Suppression Proximal Gradient (BSPG) and GPU parallelism. We first propose a new continuation strategy to suppress the strong edges. This strategy enables the model to simultaneously consider heterogeneous components while dealing with low-rank backgrounds. Then, the Approximate Partial Singular Value Decomposition (APSVD) is presented to accelerate solution of the LRSD problem and further improve the solution accuracy. Finally, we implement our method on GPU using multi-threaded parallelism, in order to further enhance the computational efficiency of the model. The experimental results demonstrate that our method out-performs existing advanced methods, in terms of detection accuracy and execution time