An Improved Ant Colony Algorithm for New energy Industry Resource Allocation in Cloud Environment

The new energy industry development is affected by many factors. Among them, the resources utilization ratio is a major reason for the low productivity of enterprises. As the core problem of cloud computing, the resource allocation problem has been widely concerned by the people, and the resource allocation problem of the new energy industry as the key to energy innovation and transformation should be more paid attention to. In multi-resource cloud computing scenarios, requests made by users often involve multiple types of resources. Traditional resource allocation algorithms have a single optimization object, typically time efficiency. In order to achieve cluster load balancing, utilization of system resources and improvement of system work efficiency, this paper proposes a new cloud computing allocation algorithm based on improved ant colony algorithm. According to the limit conditions of cloud computing environment and computing resources, this paper finds the shortest response time of all resource nodes and gets a set of best available nodes. This method can meet the quality requirements of cloud computing, and the task completion time of the improved algorithm is shorter, the number of algorithm iterations is less, and the load balancing effect is better. Through MATLAB simulation experiments, the effectiveness of the proposed method is verified

Towards Efficient Resource Provisioning in Hadoop

Considering recent exponential growth in the amount of information processed in Big Data, the high energy consumed by data processing engines in datacenters has become a major issue, underlining the need for efficient resource allocation for better energy-efficient computing. This thesis proposes the Best Trade-off Point (BToP) method which provides a general approach and techniques based on an algorithm with mathematical formulas to find the best trade-off point on an elbow curve of performance vs. resources for efficient resource provisioning in Hadoop MapReduce and Apache Spark. Our novel BToP method is expected to work for any applications and systems which rely on a tradeoff curve with an elbow shape, non-inverted or inverted, for making good decisions. This breakthrough method for optimal resource provisioning was not available before in the scientific, computing, and economic communities. To illustrate the effectiveness of the BToP method on the ubiquitous Hadoop MapReduce, our Terasort experiment shows that the number of task resources recommended by the BToP algorithm is always accurate and optimal when compared to the ones suggested by three popular rules of thumbs. We also test the BToP method on the emerging cluster computing framework Apache Spark running in YARN cluster mode. Despite the effectiveness of Spark’s robust and sophisticated built-in dynamic resource allocation mechanism, which is not available in MapReduce, the BToP method could still consistently outperform it according to our Spark-Bench Terasort test results. The performance efficiency gained from the BToP method not only leads to significant energy saving but also improves overall system throughput and prevents cluster underutilization in a multi-tenancy environment. In General, the BToP method is preferable for workloads with identical resource consumption signatures in production environment where job profiling for behavioral replication will lead to the most efficient resource provisioning

Task Allocation on Layered Multi-Agent Systems: When Evolutionary Many-Objective Optimization Meets Deep Q-Learning

IEEE This paper is concerned with the multi-task multi-agent allocation problem via many-objective optimization for multi-agent systems (MASs). First, a novel layered MAS model is constructed to address the multi-task multi-agent allocation problem that includes both the original task simplification and the many-objective allocation. In the first layer of the model, the deep Q-learning method is introduced to simplify the prioritization of the original task set. In the second layer of the model, the modified shift-based density estimation (MSDE) method is put forward to improve the conventional Strength Pareto Evolutionary Algorithm 2 (SPEA2) in order to achieve many-objective optimization on task assignments. Then, an MSDE-SPEA2-based method is proposed to tackle the many-objective optimization problem with objectives including task allocation, makespan, agent satisfaction, resource utilization, task completion, and task waiting time. As compared with existing allocation methods, the developed method in this paper exhibits an outstanding feature that the task assignment and the task scheduling are carried out simultaneously. Finally, extensive experiments are conducted to 1) verify the validity of the proposed model and the effectiveness of two main algorithms; and 2) illustrate the optimal solution for task allocation and efficient strategy for task scheduling under different scenarios.National Key Research and Development Program of China; National Natural Science Foundation of China under Grants ;European Union’s Horizon 2020 Research and Innovation Programme; Royal Society of the UK; Alexander von Humboldt Foundatio

Collaborative signal and information processing for target detection with heterogeneous sensor networks

In this paper, an approach for target detection and acquisition with heterogeneous sensor networks through strategic resource allocation and coordination is presented. Based on sensor management and collaborative signal and information processing, low-capacity low-cost sensors are strategically deployed to guide and cue scarce high performance sensors in the network to improve the data quality, with which the mission is eventually completed more efficiently with lower cost. We focus on the problem of designing such a network system in which issues of resource selection and allocation, system behaviour and capacity, target behaviour and patterns, the environment, and multiple constraints such as the cost must be addressed simultaneously. Simulation results offer significant insight into sensor selection and network operation, and demonstrate the great benefits introduced by guided search in an application of hunting down and capturing hostile vehicles on the battlefield

Difficulties of Estimating the Cost of Achieving Education Standards

Outlines the limitations of four approaches to estimating the resources needed to improve educational outcomes, including higher state standards, varied student needs, different capacities and prices for education inputs across districts, and poor data