Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning

Federated learning is a distributed framework for training machine learning models over the data residing at mobile devices, while protecting the privacy of individual users. A major bottleneck in scaling federated learning to a large number of users is the overhead of secure model aggregation across many users. In particular, the overhead of the state-of-the-art protocols for secure model aggregation grows quadratically with the number of users. In this paper, we propose the first secure aggregation framework, named Turbo-Aggregate, that in a network with $N$ users achieves a secure aggregation overhead of $O(N\log{N})$, as opposed to $O(N^2)$, while tolerating up to a user dropout rate of $50\%$. Turbo-Aggregate employs a multi-group circular strategy for efficient model aggregation, and leverages additive secret sharing and novel coding techniques for injecting aggregation redundancy in order to handle user dropouts while guaranteeing user privacy. We experimentally demonstrate that Turbo-Aggregate achieves a total running time that grows almost linear in the number of users, and provides up to $40\times$ speedup over the state-of-the-art protocols with up to $N=200$ users. Our experiments also demonstrate the impact of model size and bandwidth on the performance of Turbo-Aggregate

Amorphous metallic films in silicon metallization systems

The general objective was to determine the potential of amorphous metallic thin films as a means of improving the stability of metallic contacts to a silicon substrate. The specific objective pursued was to determine the role of nitrogen in the formation and the resulting properties of amorphous thin-film diffusion barriers. Amorphous metallic films are attractive as diffusion barriers because of the low atomic diffusivity in these materials. Previous investigations revealed that in meeting this condition alone, good diffusion barriers are not necessarily obtained, because amorphous films can react with an adjacent medium (e.g., Si, Al) before they recrystallize. In the case of a silicon single-crystalline substrate, correlation exists between the temperature at which an amorphous metallic binary thin film reacts and the temperatures at which the films made of the same two metallic elements react individually. Amorphous binary films made of Zr and W were investigated. Both react with Si individually only at elevated temperatures. It was confirmed that such films react with Si only above 700 C when annealed in vacuum for 30 min. Amorphous W-N films were also investigated. They are more stable as barriers between Al and Si than polycrystalline W. Nitrogen effectively prevents the W-Al reaction that sets in at 500 C with polycrystalline W

Characteristics of inhomogeneous jets in confined swirling air flows

An experimental program to study the characteristics of inhomogeneous jets in confined swirling flows to obtain detailed and accurate data for the evaluation and improvement of turbulent transport modeling for combustor flows is discussed. The work was also motivated by the need to investigate and quantify the influence of confinement and swirl on the characteristics of inhomogeneous jets. The flow facility was constructed in a simple way which allows easy interchange of different swirlers and the freedom to vary the jet Reynolds number. The velocity measurements were taken with a one color, one component DISA Model 55L laser-Doppler anemometer employing the forward scatter mode. Standard statistical methods are used to evaluate the various moments of the signals to give the flow characteristics. The present work was directed at the understanding of the velocity field. Therefore, only velocity and turbulence data of the axial and circumferential components are reported for inhomogeneous jets in confined swirling air flows

Exploring knowledge exchange: a useful framework for practice and policy

Knowledge translation is underpinned by a dynamic and social knowledge exchange process but there are few descriptions of how this unfolds in practice settings. This has hampered attempts to produce realistic and useful models to help policymakers and researchers understand how knowledge exchange works. This paper reports the results of research which investigated the nature of knowledge exchange. We aimed to understand whether dynamic and fluid definitions of knowledge exchange are valid and to produce a realistic, descriptive framework of knowledge exchange. Our research was informed by a realist approach. We embedded a knowledge broker within three service delivery teams across a large mental health organisation, each of whom was grappling with specific challenges. The knowledge broker participated in the team's problem-solving process and collected observational fieldnotes. We also interviewed the team members. Observational and interview data were analysed quantitatively and qualitatively in order to determine and describe the nature of the knowledge exchange process in more detail. This enabled us to refine our conceptual framework of knowledge exchange. We found that knowledge exchange can be understood as a dynamic and fluid process which incorporates distinct forms of knowledge from multiple sources. Quantitative analysis illustrated that five broadly-defined components of knowledge exchange (problem, context, knowledge, activities, use) can all be in play at any one time and do not occur in a set order. Qualitative analysis revealed a number of distinct themes which better described the nature of knowledge exchange. By shedding light on the nature of knowledge exchange, our findings problematise some of the linear, technicist approaches to knowledge translation. The revised model of knowledge exchange which we propose here could therefore help to reorient thinking about knowledge exchange and act as a starting point for further exploration and evaluation of the knowledge exchange process

Chromium silicide formation by ion mixing

The formation of CrSi_2 by ion mixing was studied as a function of temperature, silicide thickness and irradiated interface. Samples were prepared by annealing evaporated couples of Cr on Si and Si on Cr at 450°C for short times to form Si/CrSi_2/Cr sandwiches. Xenon beams with energies up to 300 keV and fluences up to 8 X 10^15 cm^(-2) were used for mixing at temperatures between 20 and 300°C. Penetrating only the Cr/CrSi_2 interface at temperatures above 150°C induces further growth of the silicide as a uniform stoichiometric layer. The growth rate does not depend on the thickness of the initially formed silicide at least up to a thickness of 150 nm. The amount of growth depends linearly on the density of energy deposited at the interface. The growth is temperature dependent with an apparent activation energy of 0.2 eV. Irradiating only through the Si/CrSi_2 interface does not induce silicide growth. We conclude that the formation of CrSi_2 by ion beam mixing is an interface-limited process and that the limiting reaction occurs at the Cr/CrSi_2 interface

Gravitational energy in a small region for the modified Einstein and Landau-Lifshitz pseudotensors

The purpose of the classical Einstein and Landau-Lifshitz pseudotensors is for determining the gravitational energy. Neither of them can guarantee a positive energy in holonomic frames. In the small sphere approximation, it has been required that the quasilocal expression for the gravitational energy-momentum density should be proportional to the Bel-Robinson tensor $B_{\alpha\beta\mu\nu}$. However, we propose a new tensor $V_{\alpha\beta\mu\nu}$ which is the sum of certain tensors $S_{\alpha\beta\mu\nu}$ and $K_{\alpha\beta\mu\nu}$, it has certain properties so that it gives the same gravitational "energy-momentum" content as $B_{\alpha\beta\mu\nu}$ does. Moreover, we show that a modified Einstein pseudotensor turns out to be one of the Chen-Nester quasilocal expressions, while the modified Landau-Lifshitz pseudotensor becomes the Papapetrou pseudotensor; these two modified pseudotensors have positive gravitational energy in a small region.Comment:

Behavior of turbulent gas jets in an axisymmetric confinement

The understanding of the mixing of confined turbulent jets of different densities with air is of great importance to many industrial applications, such as gas turbine and Ramjet combustors. Although there have been numerous studies on the characteristics of free gas jets, little is known of the behavior of gas jets in a confinement. The jet, with a diameter of 8.73 mm, is aligned concentrically in a tube of 125 mm diameter, thus giving a confinement ratio of approximately 205. The arrangement forms part of the test section of an open-jet wind tunnel. Experiments are carried out with carbon dioxide, air and helium/air jets at different jet velocities. Mean velocity and turbulence measurements are made with a one-color, one-component laser Doppler velocimeter operating in the forward scatter mode. Measurements show that the jets are highly dissipative. Consequently, equilibrium jet characteristics similar to those found in free air jets are observed in the first two diameters downstream of the jet. These results are independent of the fluid densities and velocities. Decay of the jet, on the other hand, is a function of both the jet fluid density and momentum. In all the cases studied, the jet is found to be completely dissipated in approximately 30 jet diameters, thus giving rise to a uniform flow with a very high but constant turbulence field across the confinement