1,584 research outputs found
Limited Evaluation Cooperative Co-evolutionary Differential Evolution for Large-scale Neuroevolution
Many real-world control and classification tasks involve a large number of
features. When artificial neural networks (ANNs) are used for modeling these
tasks, the network architectures tend to be large. Neuroevolution is an
effective approach for optimizing ANNs; however, there are two bottlenecks that
make their application challenging in case of high-dimensional networks using
direct encoding. First, classic evolutionary algorithms tend not to scale well
for searching large parameter spaces; second, the network evaluation over a
large number of training instances is in general time-consuming. In this work,
we propose an approach called the Limited Evaluation Cooperative
Co-evolutionary Differential Evolution algorithm (LECCDE) to optimize
high-dimensional ANNs.
The proposed method aims to optimize the pre-synaptic weights of each
post-synaptic neuron in different subpopulations using a Cooperative
Co-evolutionary Differential Evolution algorithm, and employs a limited
evaluation scheme where fitness evaluation is performed on a relatively small
number of training instances based on fitness inheritance. We test LECCDE on
three datasets with various sizes, and our results show that cooperative
co-evolution significantly improves the test error comparing to standard
Differential Evolution, while the limited evaluation scheme facilitates a
significant reduction in computing time
Multi-Objective Evolutionary for Object Detection Mobile Architectures Search
Recently, Neural architecture search has achieved great success on
classification tasks for mobile devices. The backbone network for object
detection is usually obtained on the image classification task. However, the
architecture which is searched through the classification task is sub-optimal
because of the gap between the task of image and object detection. As while
work focuses on backbone network architecture search for mobile device object
detection is limited, mainly because the backbone always requires expensive
ImageNet pre-training. Accordingly, it is necessary to study the approach of
network architecture search for mobile device object detection without
expensive pre-training. In this work, we propose a mobile object detection
backbone network architecture search algorithm which is a kind of evolutionary
optimized method based on non-dominated sorting for NAS scenarios. It can
quickly search to obtain the backbone network architecture within certain
constraints. It better solves the problem of suboptimal linear combination
accuracy and computational cost. The proposed approach can search the backbone
networks with different depths, widths, or expansion sizes via a technique of
weight mapping, making it possible to use NAS for mobile devices detection
tasks a lot more efficiently. In our experiments, we verify the effectiveness
of the proposed approach on YoloX-Lite, a lightweight version of the target
detection framework. Under similar computational complexity, the accuracy of
the backbone network architecture we search for is 2.0% mAP higher than
MobileDet. Our improved backbone network can reduce the computational effort
while improving the accuracy of the object detection network. To prove its
effectiveness, a series of ablation studies have been carried out and the
working mechanism has been analyzed in detail
- …