Accelerating federated learning via momentum gradient descent

Federated learning (FL) provides a communication-efficient approach to solve machine learning problems concerning distributed data, without sending raw data to a central server. However, existing works on FL only utilize first-order gradient descent (GD) and do not consider the preceding iterations to gradient update which can potentially accelerate convergence. In this article, we consider momentum term which relates to the last iteration. The proposed momentum federated learning (MFL) uses momentum gradient descent (MGD) in the local update step of FL system. We establish global convergence properties of MFL and derive an upper bound on MFL convergence rate. Comparing the upper bounds on MFL and FL convergence rates, we provide conditions in which MFL accelerates the convergence. For different machine learning models, the convergence performance of MFL is evaluated based on experiments with MNIST and CIFAR-10 datasets. Simulation results confirm that MFL is globally convergent and further reveal significant convergence improvement over FL

Language Provision in UK MFL Departments 2018 Survey

The report investigates the provision of language modules (i.e. modules whose object of study is language) in MFL departments alongside models of collaboration between Languages departments and Institution-Wide Language Provision (IWLP) in UK universities. Results offer an invitation to reconceptualise our discipline to strengthen an agenda of inclusion and diversity integrating all languages, as well as a single voice for MFL and IWLP

Marginal Fermi liquid analysis of 300 K reflectance of Bi2Sr2CaCu2O8+x

We use 300 K reflectance data to investigate the normal-state electrodynamics of the high temperature superconductor Bi$_{2}$Sr$_{2}$CaCu$_{2}$O$_{8+\delta}$ over a wide range of doping levels. The data show that at this temperature the free carriers are coupled to a continuous spectrum of fluctuations. Assuming the Marginal Fermi Liquid (MFL) form as a first approximation for the fluctuation spectrum, the doping-dependent coupling constant $\lambda (p)$ can be estimated directly from the slope of the reflectance spectrum. We find that $\lambda (p)$ decreases smoothly with the hole doping level, from underdoped samples with $p=0.103$ ($T_c = 67$ K) where $\lambda (p)= 0.93$ to overdoped samples with $p=0.226$, ($T_c= 60$ K) where $\lambda(p)= 0.53$. An analysis of the intercept and curvature of the reflectance spectrum shows deviations from the MFL spectrum symmetrically placed at the optimal doping point $p=0.16$. The Kubo formula for the conductivity gives a better fit to the experiments with the MFL spectrum up to 2000 cm$^{-1}$ and with an additional Drude component or an additional Lorentz component up to 7000 cm$^{-1}$. By comparing three different model fits we conclude that the MFL channel is necessary for a good fit to the reflectance data. Finally, we note that the monotonic variation of the reflectance slope with doping provides us with an independent measure of the doping level for the Bi-2212 system.Comment: 11 pages, 11 figure

Spin-Polarized Transport in Ferromagnet-Marginal Fermi Liquid Systems

Spin-polarized transport through a marginal Fermi liquid (MFL) which is connected to two noncollinear ferromagnets via tunnel junctions is discussed in terms of the nonequilibrium Green function approach. It is found that the current-voltage characteristics deviate obviously from the ohmic behavior, and the tunnel current increases slightly with temperature, in contrast to those of the system with a Fermi liquid. The tunnel magnetoresistance (TMR) is observed to decay exponentially with increasing the bias voltage, and to decrease slowly with increasing temperature. With increasing the coupling constant of the MFL, the current is shown to increase linearly, while the TMR is found to decay slowly. The spin-valve effect is observed.Comment: 5 pages, 6 figures, Phys. Rev. B 71, 064412 (2005

Superconducting Diamagnetic Fluctuations in MgB2

The fluctuating diamagnetic magnetization Mfl at constant field H as a function of temperature and the isothermal magnetization Mfl vs H are measured in MgB2, above the superconducting transition temperature. The expressions for Mfl in randomly oriented powders are derived in the Gaussian approximation of local Ginzburg-Landau theory and used for the analysis of the data. The scaled magnetization Mfl/H^{1/2}*T is found to be field dependent. In the limit of evanescent field the behaviour for Gaussian fluctuations is obeyed while for H>~ 100 Oe the field tends to suppress the fluctuating pairs, with a field dependence of Mfl close to the one expected when short wavelength fluctuations and non-local electrodynamic effects are taken into account. Our data, besides providing the isothermal magnetization curves for T>Tc(0) in a BCS-type superconductor such as MgB2, evidence an enhancement of the fluctuating diamagnetism which is related to the occurrence in this new superconductor of an anisotropic spectrum of the superconducting fluctuations.Comment: Tex file, 4 pages, 3 ps figures, submitted to Phys. Rev. Let

A core genetic module : the Mixed Feedback Loop

The so-called Mixed Feedback Loop (MFL) is a small two-gene network where protein A regulates the transcription of protein B and the two proteins form a heterodimer. It has been found to be statistically over-represented in statistical analyses of gene and protein interaction databases and to lie at the core of several computer-generated genetic networks. Here, we propose and mathematically study a model of the MFL and show that, by itself, it can serve both as a bistable switch and as a clock (an oscillator) depending on kinetic parameters. The MFL phase diagram as well as a detailed description of the nonlinear oscillation regime are presented and some biological examples are discussed. The results emphasize the role of protein interactions in the function of genetic modules and the usefulness of modelling RNA dynamics explicitly.Comment: To be published in Physical Review