132 research outputs found
Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advances
Remote sensing object detection (RSOD), one of the most fundamental and
challenging tasks in the remote sensing field, has received longstanding
attention. In recent years, deep learning techniques have demonstrated robust
feature representation capabilities and led to a big leap in the development of
RSOD techniques. In this era of rapid technical evolution, this review aims to
present a comprehensive review of the recent achievements in deep learning
based RSOD methods. More than 300 papers are covered in this review. We
identify five main challenges in RSOD, including multi-scale object detection,
rotated object detection, weak object detection, tiny object detection, and
object detection with limited supervision, and systematically review the
corresponding methods developed in a hierarchical division manner. We also
review the widely used benchmark datasets and evaluation metrics within the
field of RSOD, as well as the application scenarios for RSOD. Future research
directions are provided for further promoting the research in RSOD.Comment: Accepted with IEEE Geoscience and Remote Sensing Magazine. More than
300 papers relevant to the RSOD filed were reviewed in this surve
Artificial Neural Networks and Evolutionary Computation in Remote Sensing
Artificial neural networks (ANNs) and evolutionary computation methods have been successfully applied in remote sensing applications since they offer unique advantages for the analysis of remotely-sensed images. ANNs are effective in finding underlying relationships and structures within multidimensional datasets. Thanks to new sensors, we have images with more spectral bands at higher spatial resolutions, which clearly recall big data problems. For this purpose, evolutionary algorithms become the best solution for analysis. This book includes eleven high-quality papers, selected after a careful reviewing process, addressing current remote sensing problems. In the chapters of the book, superstructural optimization was suggested for the optimal design of feedforward neural networks, CNN networks were deployed for a nanosatellite payload to select images eligible for transmission to ground, a new weight feature value convolutional neural network (WFCNN) was applied for fine remote sensing image segmentation and extracting improved land-use information, mask regional-convolutional neural networks (Mask R-CNN) was employed for extracting valley fill faces, state-of-the-art convolutional neural network (CNN)-based object detection models were applied to automatically detect airplanes and ships in VHR satellite images, a coarse-to-fine detection strategy was employed to detect ships at different sizes, and a deep quadruplet network (DQN) was proposed for hyperspectral image classification
Operator State Estimation for Adaptive Aiding in Uninhabited Combat Air Vehicles
This research demonstrated the first closed-loop implementation of adaptive automation using operator functional state in an operationally relevant environment. In the Uninhabited Combat Air Vehicle (UCAV) environment, operators can become cognitively overloaded and their performance may decrease during mission critical events. This research demonstrates an unprecedented closed-loop system, one that adaptively aids UCAV operators based on their cognitive functional state A series of experiments were conducted to 1) determine the best classifiers for estimating operator functional state, 2) determine if physiological measures can be used to develop multiple cognitive models based on information processing demands and task type, 3) determine the salient psychophysiological measures in operator functional state, and 4) demonstrate the benefits of intelligent adaptive aiding using operator functional state. Aiding the operator actually improved performance and increased mission effectiveness by 67%
A Survey of Deep Learning-Based Object Detection
Object detection is one of the most important and challenging branches of
computer vision, which has been widely applied in peoples life, such as
monitoring security, autonomous driving and so on, with the purpose of locating
instances of semantic objects of a certain class. With the rapid development of
deep learning networks for detection tasks, the performance of object detectors
has been greatly improved. In order to understand the main development status
of object detection pipeline, thoroughly and deeply, in this survey, we first
analyze the methods of existing typical detection models and describe the
benchmark datasets. Afterwards and primarily, we provide a comprehensive
overview of a variety of object detection methods in a systematic manner,
covering the one-stage and two-stage detectors. Moreover, we list the
traditional and new applications. Some representative branches of object
detection are analyzed as well. Finally, we discuss the architecture of
exploiting these object detection methods to build an effective and efficient
system and point out a set of development trends to better follow the
state-of-the-art algorithms and further research.Comment: 30 pages,12 figure
Ship recognition on the sea surface using aerial images taken by Uav : a deep learning approach
Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesOceans are very important for mankind, because they are a very important source of
food, they have a very large impact on the global environmental equilibrium, and it is
over the oceans that most of the world commerce is done. Thus, maritime surveillance
and monitoring, in particular identifying the ships used, is of great importance to
oversee activities like fishing, marine transportation, navigation in general, illegal
border encroachment, and search and rescue operations. In this thesis, we used images
obtained with Unmanned Aerial Vehicles (UAVs) over the Atlantic Ocean to identify
what type of ship (if any) is present in a given location. Images generated from UAV
cameras suffer from camera motion, scale variability, variability in the sea surface and
sun glares. Extracting information from these images is challenging and is mostly done
by human operators, but advances in computer vision technology and development of
deep learning techniques in recent years have made it possible to do so automatically.
We used four of the state-of-art pretrained deep learning network models, namely
VGG16, Xception, ResNet and InceptionResNet trained on ImageNet dataset, modified
their original structure using transfer learning based fine tuning techniques and then
trained them on our dataset to create new models. We managed to achieve very high
accuracy (99.6 to 99.9% correct classifications) when classifying the ships that appear
on the images of our dataset. With such a high success rate (albeit at the cost of high
computing power), we can proceed to implement these algorithms on maritime patrol
UAVs, and thus improve Maritime Situational Awareness
Automatic vision based fault detection on electricity transmission components using very highresolution
Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesElectricity is indispensable to modern-day governments and citizenry’s day-to-day operations.
Fault identification is one of the most significant bottlenecks faced by Electricity transmission and
distribution utilities in developing countries to deliver credible services to customers and ensure
proper asset audit and management for network optimization and load forecasting. This is due to
data scarcity, asset inaccessibility and insecurity, ground-surveys complexity, untimeliness, and
general human cost. In this context, we exploit the use of oblique drone imagery with a high spatial
resolution to monitor four major Electric power transmission network (EPTN) components
condition through a fine-tuned deep learning approach, i.e., Convolutional Neural Networks
(CNNs). This study explored the capability of the Single Shot Multibox Detector (SSD), a onestage
object detection model on the electric transmission power line imagery to localize, classify
and inspect faults present. The components fault considered include the broken insulator plate,
missing insulator plate, missing knob, and rusty clamp. The adopted network used a CNN based
on a multiscale layer feature pyramid network (FPN) using aerial image patches and ground truth
to localise and detect faults via a one-phase procedure. The SSD Rest50 architecture variation
performed the best with a mean Average Precision of 89.61%. All the developed SSD based
models achieve a high precision rate and low recall rate in detecting the faulty components, thus
achieving acceptable balance levels F1-score and representation. Finally, comparable to other
works of literature within this same domain, deep-learning will boost timeliness of EPTN inspection
and their component fault mapping in the long - run if these deep learning architectures are widely
understood, adequate training samples exist to represent multiple fault characteristics; and the
effects of augmenting available datasets, balancing intra-class heterogeneity, and small-scale
datasets are clearly understood
Deep learning in remote sensing: a review
Standing at the paradigm shift towards data-intensive science, machine
learning techniques are becoming increasingly important. In particular, as a
major breakthrough in the field, deep learning has proven as an extremely
powerful tool in many fields. Shall we embrace deep learning as the key to all?
Or, should we resist a 'black-box' solution? There are controversial opinions
in the remote sensing community. In this article, we analyze the challenges of
using deep learning for remote sensing data analysis, review the recent
advances, and provide resources to make deep learning in remote sensing
ridiculously simple to start with. More importantly, we advocate remote sensing
scientists to bring their expertise into deep learning, and use it as an
implicit general model to tackle unprecedented large-scale influential
challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin
A Radial Basis Function Neural Network Approach to Two-Color Infrared Missile Detection
Multicolor infrared imaging missile-warning systems require real-time detection techniques that can process the wide instantaneous field of regard of focal plane array sensors with a low false alarm rate. Current technology applies classical statistical methods to this problem and ignores neural network techniques. Thus the research reported here is novel in that it investigates the use of radial basis function (RBF) neural networks to detect sub-pixel missile signatures. An RBF neural network is designed and trained to detect targets in two-color infrared imagery using a recently developed regression tree algorithm. Features are calculated for 3 by 3 pixel sub-images in each color band and concatenated into a vector as input to the network. The RBF network responds with a value of unity to feature vectors representing missiles and with zero to vectors representing background. Images are thresholded prior to application to the trained RBF network to narrow the field of interest of the RBF network and increase missile detection speed. The RBF network-based technique then generates potential target locations and probabilities that the locations correspond to missiles. Results show that the RBF network-based technique operates in near teal-time and detects 100% of the missiles in data that was not used in training Receiver operating characteristic (ROC) curves show that overly high classification thresholds can exceed the RBF network response for a true missile and result in non-detection. However, these ROC curves also show that adaptive control of the classification threshold on the RBF network output can reduce the number of false alarms to zero
- …