Reinforcement learning for efficient network penetration testing

Penetration testing (also known as pentesting or PT) is a common practice for actively assessing the defenses of a computer network by planning and executing all possible attacks to discover and exploit existing vulnerabilities. Current penetration testing methods are increasingly becoming non-standard, composite and resource-consuming despite the use of evolving tools. In this paper, we propose and evaluate an AI-based pentesting system which makes use of machine learning techniques, namely reinforcement learning (RL) to learn and reproduce average and complex pentesting activities. The proposed system is named Intelligent Automated Penetration Testing System (IAPTS) consisting of a module that integrates with industrial PT frameworks to enable them to capture information, learn from experience, and reproduce tests in future similar testing cases. IAPTS aims to save human resources while producing much-enhanced results in terms of time consumption, reliability and frequency of testing. IAPTS takes the approach of modeling PT environments and tasks as a partially observed Markov decision process (POMDP) problem which is solved by POMDP-solver. Although the scope of this paper is limited to network infrastructures PT planning and not the entire practice, the obtained results support the hypothesis that RL can enhance PT beyond the capabilities of any human PT expert in terms of time consumed, covered attacking vectors, accuracy and reliability of the outputs. In addition, this work tackles the complex problem of expertise capturing and re-use by allowing the IAPTS learning module to store and re-use PT policies in the same way that a human PT expert would learn but in a more efficient way

Feasibility of expanding traffic monitoring systems with floating car data technology

Trajectory information reported by certain vehicles (Floating Car Data or FCD) can be applied to monitor the road network. Policy makers face difficulties when deciding to invest in the expansion of their infrastructure based on inductive loops and cameras, or to invest in a FCD system. This paper targets this decision. The provided FCD functionality is investigated, minimum requirements are determined and reliability issues are researched. The communication cost is derived and combined with other elements to assess the total costs for different scenarios. The outcome is to target a penetration rate of 1%, a sample interval of 10 seconds and a transmission interval of 30 seconds. Such a deployment can accurately determine the locations of incidents and traffic jams. It can also estimate travel times accurately for highways, for urban roads this is limited to a binary categorization into normal or congested traffic. No reliability issues are expected. The most cost efficient scenario when deploying a new FCD system is to launch a smartphone application. For Belgium, this costs 13 million EUR for 10 years. However, it is estimated that purchasing data from companies already acquiring FCD data through their own product could reduce costs with a factor 10

An Assessment of PIER Electric Grid Research 2003-2014 White Paper

This white paper describes the circumstances in California around the turn of the 21st century that led the California Energy Commission (CEC) to direct additional Public Interest Energy Research funds to address critical electric grid issues, especially those arising from integrating high penetrations of variable renewable generation with the electric grid. It contains an assessment of the beneficial science and technology advances of the resultant portfolio of electric grid research projects administered under the direction of the CEC by a competitively selected contractor, the University of California’s California Institute for Energy and the Environment, from 2003-2014

Smart Computer Security Audit: Reinforcement Learning with a Deep Neural Network Approximator

A significant challenge in modern computer security is the growing skill gap as intruder capabilities increase, making it necessary to begin automating elements of penetration testing so analysts can contend with the growing number of cyber threats. In this paper, we attempt to assist human analysts by automating a single host penetration attack. To do so, a smart agent performs different attack sequences to find vulnerabilities in a target system. As it does so, it accumulates knowledge, learns new attack sequences and improves its own internal penetration testing logic. As a result, this agent (AgentPen for simplicity) is able to successfully penetrate hosts it has never interacted with before. A computer security administrator using this tool would receive a comprehensive, automated sequence of actions leading to a security breach, highlighting potential vulnerabilities, and reducing the amount of menial tasks a typical penetration tester would need to execute. To achieve autonomy, we apply an unsupervised machine learning algorithm, Q-learning, with an approximator that incorporates a deep neural network architecture. The security audit itself is modelled as a Markov Decision Process in order to test a number of decisionmaking strategies and compare their convergence to optimality. A series of experimental results is presented to show how this approach can be effectively used to automate penetration testing using a scalable, i.e. not exhaustive, and adaptive approach

Optimizing multi-dimensional terahertz imaging analysis for colon cancer diagnosis

Peer reviewedPublisher PD

Deal or no deal: can incentives encourage widespread adoption of intelligent speed adaptation devices?

Given the burden of injury, economic, environmental and social consequences associated with speeding, reducing road traffic speed remains a major priority. Intelligent speed adaptation (ISA) is a promising but controversial new in-vehicle system that provides drivers with support on the speed-control task. In order to model potential system uptake, this paper explores drivers’ preferences for two different types of ISA given a number of alternative fiscal incentives and non-fiscal measures, using a stated preference approach. As would be expected with such a contentious issue, the analysis revealed the presence of significant variations in sensitivities and preferences in the sample. While a non-negligible part of the sample population has such strong opposition to ISA that no reasonable discounts or incentives would lead to them buying or accepting such a system, there is also a large part of the population that, if given the right incentives, would be willing or even keen to equip their vehicle with an ISA device

Assessment of traffic impact on future cooperative driving systems: challenges and considerations

Connect & Drive is a start-up project to develop a cooperative driving system and improve the traffic performance on Dutch highways. It consists of two interactive subsystems: cooperative adaptive cruise control (CACC) and connected cruise control (CCC). To assess the traffic performance, a traffic simulation model will be established for large-scale evaluation and providing feedbacks to system designs. This paper studies the factors determining the traffic performance and discusses challenges and difficulties to establish such a traffic simulation model