1,305 research outputs found

    MERMAIDE: Learning to Align Learners using Model-Based Meta-Learning

    Full text link
    We study how a principal can efficiently and effectively intervene on the rewards of a previously unseen learning agent in order to induce desirable outcomes. This is relevant to many real-world settings like auctions or taxation, where the principal may not know the learning behavior nor the rewards of real people. Moreover, the principal should be few-shot adaptable and minimize the number of interventions, because interventions are often costly. We introduce MERMAIDE, a model-based meta-learning framework to train a principal that can quickly adapt to out-of-distribution agents with different learning strategies and reward functions. We validate this approach step-by-step. First, in a Stackelberg setting with a best-response agent, we show that meta-learning enables quick convergence to the theoretically known Stackelberg equilibrium at test time, although noisy observations severely increase the sample complexity. We then show that our model-based meta-learning approach is cost-effective in intervening on bandit agents with unseen explore-exploit strategies. Finally, we outperform baselines that use either meta-learning or agent behavior modeling, in both 00-shot and K=1K=1-shot settings with partial agent information

    Developing Customized & Secure Blockchains with Deep Federation Learning to Prevent Successive Attacks

    Get PDF
    International audienceRecently, blockchain technology has been one of the most promising fields of research aiming to enhance the security and privacy of systems. It follows a distributed mechanism to make the storage system fault-tolerant. However, even after adopting all the security measures, there are some risks for cyberattacks in the blockchain. From a statistical point of view, attacks can be compared to anomalous transactions compared to normal transactions. In this paper, these anomalous transactions can be detected using machine learning algorithms, thus making the framework much more secure. Several machine learning algorithms can detect anomalous observations. Due to the typical nature of the transactions dataset (time-series), we choose to apply a sequence to the sequence model. In this paper, we present our approach, where we use federated learning embedded with an LSTM-based autoencoder to detect anomalous transactions

    Local atomic and magnetic structure of dilute magnetic semiconductor (Ba,K)(Zn,Mn)2_2As2_2

    Get PDF
    We have studied the atomic and magnetic structure of the dilute ferromagnetic semiconductor system (Ba,K)(Zn,Mn)2_2As2_2 through atomic and magnetic pair distribution function analysis of temperature-dependent x-ray and neutron total scattering data. We detected a change in curvature of the temperature-dependent unit cell volume of the average tetragonal crystallographic structure at a temperature coinciding with the onset of ferromagnetic order. We also observed the existence of a well-defined local orthorhombic structure on a short length scale of ≲5\lesssim 5 \AA, resulting in a rather asymmetrical local environment of the Mn and As ions. Finally, the magnetic PDF revealed ferromagnetic alignment of Mn spins along the crystallographic cc-axis, with robust nearest-neighbor ferromagnetic correlations that exist even above the ferromagnetic ordering temperature. We discuss these results in the context of other experiments and theoretical studies on this system

    Cluster-mining: An approach for determining core structures of metallic nanoparticles from atomic pair distribution function data

    Get PDF
    We present a novel approach for finding and evaluating structural models of small metallic nanoparticles. Rather than fitting a single model with many degrees of freedom, the approach algorithmically builds libraries of nanoparticle clusters from multiple structural motifs, and individually fits them to experimental PDFs. Each cluster-fit is highly constrained. The approach, called cluster-mining, returns all candidate structure models that are consistent with the data as measured by a goodness of fit. It is highly automated, easy to use, and yields models that are more physically realistic and result in better agreement to the data than models based on cubic close-packed crystallographic cores, often reported in the literature for metallic nanoparticles

    Direct Implicit and Explicit Energy-Conserving Particle-in-Cell Methods for Modeling of Capacitively-Coupled Plasma Devices

    Full text link
    Achieving entire large scale kinetic modelling is a crucial task for the development and optimization of modern plasma devices. With the trend of decreasing pressure in applications such as plasma etching, kinetic simulations are necessary to self-consistently capture the particle dynamics. The standard, explicit, electrostatic, momentum-conserving Particle-In-Cell method suffers from tight stability constraints to resolve the electron plasma length (i.e. Debye length) and time scales (i.e. plasma period). This results in very high computational cost, making this technique generally prohibitive for the large volume entire device modeling (EDM). We explore the Direct Implicit algorithm and the explicit Energy Conserving algorithm as alternatives to the standard approach, which can reduce computational cost with minimal (or controllable) impact on results. These algorithms are implemented into the well-tested EDIPIC-2D and LTP-PIC codes, and their performance is evaluated by testing on a 2D capacitively coupled plasma discharge scenario. The investigation revels that both approaches enable the utilization of cell sizes larger than the Debye length, resulting in reduced runtime, while incurring only a minor compromise in accuracy. The methods also allow for time steps larger than the electron plasma period, however this can lead to numerical heating or cooling. The study further demonstrates that by appropriately adjusting the ratio of cell size to time step, it is possible to mitigate this effect to acceptable level

    Pair distribution function analysis of ZrO2 nanocrystals and insights in the formation of ZrO2-YBa2Cu3O7 nanocomposites

    Get PDF
    The formation of superconducting nanocomposites from preformed nanocrystals is still not well understood. Here, we examine the case of ZrO2 nanocrystals in a YBa2Cu3O7-x matrix. First we analyzed the preformed ZrO2 nanocrystals via atomic pair distribution function analysis and found that the nanocrystals have a distorted tetragonal crystal structure. Second, we investigated the influence of various surface ligands attached to the ZrO2 nanocrystals on the distribution of metal ions in the pyrolyzed matrix via secondary ion mass spectroscopy technique. The choice of stabilizing ligand is crucial in order to obtain good superconducting nanocomposite films with vortex pinning. Short, carboxylate based ligands lead to poor superconducting properties due to the inhomogeneity of metal content in the pyrolyzed matrix. Counter-intuitively, a phosphonate ligand with long chains does not disturb the growth of YBa2Cu3O7-x. Even more surprisingly, bisphosphonate polymeric ligands provide good colloidal stability in solution but do not prevent coagulation in the final film, resulting in poor pinning. These results thus shed light on the various stages of the superconducting nanocomposite formation

    Complete Strain Mapping of Nanosheets of Tantalum Disulfide

    Get PDF
    Quasi-two-dimensional (quasi-2D) materials hold promise for future electronics because of their unique band structures that result in electronic and mechanical properties sensitive to crystal strains in all three dimensions. Quantifying crystal strain is a prerequisite to correlating it with the performance of the device, and calls for high resolution but spatially resolved rapid characterization methods. Here we show that using fly-scan nano X-ray diffraction we can accomplish a tensile strain sensitivity below 0.001% with a spatial resolution of better than 80 nm over a spatial extent of 100 μ\mum on quasi 2D flakes of 1T-TaS2. Coherent diffraction patterns were collected from a ∼\sim 100 nm thick sheet of 1T-TaS2 by scanning 12keV focused X-ray beam across and rotating the sample. We demonstrate that the strain distribution around micron and sub-micron sized 'bubbles' that are present in the sample may be reconstructed from these images. The experiments use state of the art synchrotron instrumentation, and will allow rapid and non-intrusive strain mapping of thin film samples and electronic devices based on quasi 2D materials
    • …
    corecore