A Multiagent CyberBattleSim for RL Cyber Operation Agents

Hardening cyber physical assets is both crucial and labor-intensive. Recently, Machine Learning (ML) in general and Reinforcement Learning RL) more specifically has shown great promise to automate tasks that otherwise would require significant human insight/intelligence. The development of autonomous RL agents requires a suitable training environment that allows us to quickly evaluate various alternatives, in particular how to arrange training scenarios that pit attackers and defenders against each other. CyberBattleSim is a training environment that supports the training of red agents, i.e., attackers. We added the capability to train blue agents, i.e., defenders. The paper describes our changes and reports on the results we obtained when training blue agents, either in isolation or jointly with red agents. Our results show that training a blue agent does lead to stronger defenses against attacks. In particular, training a blue agent jointly with a red agent increases the blue agent's capability to thwart sophisticated red agents.Comment: To appear in Proceedings of the 2022 International Conference on Computational Science and Computational Intelligenc

Incorporating Ambipolar and Ohmic Diffusion in the AMR MHD code RAMSES

We have implemented non-ideal Magneto-Hydrodynamics (MHD) effects in the Adaptive Mesh Refinement (AMR) code RAMSES, namely ambipolar diffusion and Ohmic dissipation, as additional source terms in the ideal MHD equations. We describe in details how we have discretized these terms using the adaptive Cartesian mesh, and how the time step is diminished with respect to the ideal case, in order to perform a stable time integration. We have performed a large suite of test runs, featuring the Barenblatt diffusion test, the Ohmic diffusion test, the C-shock test and the Alfven wave test. For the latter, we have performed a careful truncation error analysis to estimate the magnitude of the numerical diffusion induced by our Godunov scheme, allowing us to estimate the spatial resolution that is required to address non-ideal MHD effects reliably. We show that our scheme is second-order accurate, and is therefore ideally suited to study non-ideal MHD effects in the context of star formation and molecular cloud dynamics

A dicing free SOI process for MEMS devices

This paper presents a full wafer, dicing free, dry release process for MEMS silicon-on-insulator (SOI) sensors and actuators. The developed process is particularly useful for inertial sensors that benefit from a large proof mass, for example accelerometers and gyroscopes. It involves consecutive front and backside deep reactive ion etching (DRIE) of the substrate to define the device features, release holes, and trenches. This is followed by hydrofluoric acid vapor phase etching (HF VPE) to release the proof mass and the handle wafer underneath to allow vertical displacements of the proof mass. The release process also allows the devices to be detached from each other and the substrate without the need of an extra dicing step that may damage the delicate device features or create debris. In the work described here, the process is demonstrated for the full wafer release of a high performance accelerometer with a large proof mass measuring 4 × 7 mm2. The sensor was successfully fabricated with a yield of over 95

On the Delay of Reactive-Greedy-Reactive Routing in Unmanned Aeronautical Ad-hoc Networks

AbstractReactive-Greedy-Reactive (RGR) has been proposed as a promising routing protocol in highly mobile density-variable Unmanned Aeronautical Ad-hoc Networks (UAANETs). In RGR, location information of Unmanned Aerial Vehicles (UAVs) as well as reactive end-to-end paths are employed in the routing process. It had already been shown that RGR outperforms existing routing protocols in terms of packet delivery ratio. In this paper, the delay performance of RGR is evaluated and compared against Ad-hoc On-demand Distance Vector (AODV) and Greedy Geographic Forwarding (GGF).We considerextensive simulation scenariostocover both searchingand tracking applicationsofUAANETs. The results illustrate that when the number of UAVs is high enough in a searching mission to form a connected UAANET, RGR performs well. In sparsely connected searching scenarios or dense tracking scenarios, RGR may also slightly decrease delay compared to traditional reactive routing protocols for similar PDR

Elastic properties of freely suspended MoS2 nanosheets

We study the elastic deformation of few layers (5 to 25) thick freely suspended MoS2 nanosheets by means of a nanoscopic version of a bending test experiment, carried out with the tip of an atomic force microscope. The Young's modulus of these nanosheets is extremely high (E = 0.33 TPa), comparable to that of graphene oxide, and the deflections are reversible up to tens of nanometers.Comment: 11 pages, 7 figures (including supplementary information

Potential Dependence of Surfactant Adsorption at the Graphite Electrode / Deep Eutectic Solvent Interface

Atomic force microscope (AFM) and cyclic voltammetry (CV) are used to probe how ionic surfactant adsorbed layer structure affects redox processes at deep eutectic solvent (DES)/graphite interfaces. Unlike its behaviour in water, sodium dodecyl sulphate (SDS) in DESs only adsorbs as a complete layer of hemicylindrical hemimicelles far above its critical micelle concentration (CMC). Near the CMC it forms a tail-to-tail monolayer at OCP and positive potentials, and which desorbs at negative potentials. In contrast, cetyltrimethylammonium bromide (CTAB) adsorbs as hemimicelles at low concentrations, and remains adsorbed at both positive and negative potentials. The SDS horizontal monolayer has little overall effect on redox processes at the graphite interface, but hemimicelles form an effective and stable barrier. The stronger solvophobic interactions between the C16 versus C12 alkyl chains in the DES allow CTAB to self-assemble into a robust coating at low concentrations, and illustrate how the structure of the DES/electrode interface and electrochemical response can be engineered by controlling surfactant structure

Dark Energy Perturbations Revisited

In this paper we study the evolution of cosmological perturbations in the presence of dynamical dark energy, and revisit the issue of dark energy perturbations. For a generally parameterized equation of state (EoS) such as w_D(z) = w_0+w_1\frac{z}{1+z}, (for a single fluid or a single scalar field ) the dark energy perturbation diverges when its EoS crosses the cosmological constant boundary w_D=-1. In this paper we present a method of treating the dark energy perturbations during the crossing of the $w_D=-1$ surface by imposing matching conditions which require the induced 3-metric on the hypersurface of w_D=-1 and its extrinsic curvature to be continuous. These matching conditions have been used widely in the literature to study perturbations in various models of early universe physics, such as Inflation, the Pre-Big-Bang and Ekpyrotic scenarios, and bouncing cosmologies. In all of these cases the EoS undergoes a sudden change. Through a detailed analysis of the matching conditions, we show that \delta_D and \theta_D are continuous on the matching hypersurface. This justifies the method used[1-4] in the numerical calculation and data fitting for the determination of cosmological parameters. We discuss the conditions under which our analysis is applicable.Comment: 10 pages and 1 figure

Resistive jet simulations extending radially self-similar magnetohydrodynamic models

Numerical simulations with self-similar initial and boundary conditions provide a link between theoretical and numerical investigations of jet dynamics. We perform axisymmetric resistive magnetohydrodynamic (MHD) simulations for a generalised solution of the Blandford & Payne type, and compare them with the corresponding analytical and numerical ideal-MHD solutions. We disentangle the effects of the numerical and physical diffusivity. The latter could occur in outflows above an accretion disk, being transferred from the underlying disk into the disk corona by MHD turbulence (anomalous turbulent diffusivity), or as a result of ambipolar diffusion in partially ionized flows. We conclude that while the classical magnetic Reynolds number $R_{\rm m}$ measures the importance of resistive effects in the induction equation, a new introduced number, \rbeta=(\beta/2)R_{\rm m} with $\beta$ the plasma beta, measures the importance of the resistive effects in the energy equation. Thus, in magnetised jets with $\beta<2$, when \rbeta \la 1 resistive effects are non-negligible and affect mostly the energy equation. The presented simulations indeed show that for a range of magnetic diffusivities corresponding to \rbeta \ga 1 the flow remains close to the ideal-MHD self-similar solution.Comment: Accepted for publication in MNRA