Federated Training of Dual Encoding Models on Small Non-IID Client Datasets

Dual encoding models that encode a pair of inputs are widely used for representation learning. Many approaches train dual encoding models by maximizing agreement between pairs of encodings on centralized training data. However, in many scenarios, datasets are inherently decentralized across many clients (user devices or organizations) due to privacy concerns, motivating federated learning. In this work, we focus on federated training of dual encoding models on decentralized data composed of many small, non-IID (independent and identically distributed) client datasets. We show that existing approaches that work well in centralized settings perform poorly when naively adapted to this setting using federated averaging. We observe that, we can simulate large-batch loss computation on individual clients for loss functions that are based on encoding statistics. Based on this insight, we propose a novel federated training approach, Distributed Cross Correlation Optimization (DCCO), which trains dual encoding models using encoding statistics aggregated across clients, without sharing individual data samples. Our experimental results on two datasets demonstrate that the proposed DCCO approach outperforms federated variants of existing approaches by a large margin.Comment: ICLR 2023 Workshop on Pitfalls of Limited Data and Computation for Trustworthy M

Modelling and Bayesian analysis of the Abakaliki smallpox data

The celebrated Abakaliki smallpox data have appeared numerous times in the epidemic modelling literature, but in almost all cases only a specific subset of the data is considered. The only previous analysis of the full data set relied on approximation methods to derive a likelihood and did not assess model adequacy. The data themselves continue to be of interest due to concerns about the possible re-emergence of smallpox as a bioterrorism weapon. We present the first full Bayesian statistical analysis using data-augmentation Markov chain Monte Carlo methods which avoid the need for likelihood approximations and which yield a wider range of results than previous analyses. We also carry out model assessment using simulation-based methods. Our findings suggest that the outbreak was largely driven by the interaction structure of the population, and that the introduction of control measures was not the sole reason for the end of the epidemic. We also obtain quantitative estimates of key quantities including reproduction numbers

A multi-modal dance corpus for research into interaction between humans in virtual environments

We present a new, freely available, multimodal corpus for research into, amongst other areas, real-time realistic interaction between humans in online virtual environments. The specific corpus scenario focuses on an online dance class application scenario where students, with avatars driven by whatever 3D capture technology is locally available to them, can learn choreographies with teacher guidance in an online virtual dance studio. As the dance corpus is focused on this scenario, it consists of student/teacher dance choreographies concurrently captured at two different sites using a variety of media modalities, including synchronised audio rigs, multiple cameras, wearable inertial measurement devices and depth sensors. In the corpus, each of the several dancers performs a number of fixed choreographies, which are graded according to a number of specific evaluation criteria. In addition, ground-truth dance choreography annotations are provided. Furthermore, for unsynchronised sensor modalities, the corpus also includes distinctive events for data stream synchronisation. The total duration of the recorded content is 1 h and 40 min for each single sensor, amounting to 55 h of recordings across all sensors. Although the dance corpus is tailored specifically for an online dance class application scenario, the data is free to download and use for any research and development purposes

Social surplus approach and heterodox economics

Given the emphasis on social provisioning in heterodox economics, two of its central theoretical organizing principles are the concepts of the total social product and the social surplus. This appears to link heterodox economics to the social surplus approach associated with the classical economists and currently with Sraffian economists. However, heterodox economics connects agency with the social surplus and the social product, which the Sraffians reject as they take the level and composition of the social product as given. Therefore the different theoretical approach regarding the social surplus taken in heterodox economics may generate a different but similar way of theorizing about a capitalist economy. To explore this difference is the aim of the paper. Thus the paper is divided into four parts and a conclusion. In the first section social provisioning and the social surplus is introduced. In the second section, the Sraffian social surplus approach is delineated while in the third section the heterodox social surplus approach is delineated. In the fourth section of the paper, some of the implications emerging from the differences between the two approaches are discussed. The paper is concluded in the final section

Laser edge forming to increase the bending radius in hemming

Hemming can be used, for example, to join dissimilar materials which cannot be welded by conventional laser or arc based processes. A critical value in hemming is the ratio of outer sheet bending radius and outer sheet thickness because cracks can occur in outer sheets with low ductility due to a small bending radius. In this study, a novel approach is introduced for increasing the bending radius by laser based edge forming. The laser beam melts the edge of the inner sheet prior to the hemming process. In laser edge forming, the edge thickness increases due to the surface tension of the melt. The edge cross-section has typically a nearly circular shape after solidification. Two laser beam irradiation strategies were investigated. In case of the first strategy, a defocused laser beam was applied. The second strategy combined a focused laser beam resulting in the formation of a vapor capillary (keyhole) with sinusoidal beam oscillation transversal to the sheet edge. The results show that the position of the cylindrical edge cross-section according to the sheet plane could be affected by the applied irradiation strategy. The needed laser power was significantly lower when using a focused laser beam due to the deep penetration effect. The potential of the laser edge forming technique for crack-free hemming processes was demonstrated with 1 mm thick aluminum alloy sheets by carrying out stripe tests

Laser edge forming to increase the bending radius in hemming

Hemming can be used, for example, to join dissimilar materials which cannot be welded by conventional laser or arc based processes. A critical value in hemming is the ratio of outer sheet bending radius and outer sheet thickness because cracks can occur in outer sheets with low ductility due to a small bending radius. In this study, a novel approach is introduced for increasing the bending radius by laser based edge forming. The laser beam melts the edge of the inner sheet prior to the hemming process. In laser edge forming, the edge thickness increases due to the surface tension of the melt. The edge cross-section has typically a nearly circular shape after solidification. Two laser beam irradiation strategies were investigated. In case of the first strategy, a defocused laser beam was applied. The second strategy combined a focused laser beam resulting in the formation of a vapor capillary (keyhole) with sinusoidal beam oscillation transversal to the sheet edge. The results show that the position of the cylindrical edge cross-section according to the sheet plane could be affected by the applied irradiation strategy. The needed laser power was significantly lower when using a focused laser beam due to the deep penetration effect. The potential of the laser edge forming technique for crack-free hemming processes was demonstrated with 1 mm thick aluminum alloy sheets by carrying out stripe tests

In vitro and in vivo metabolism studies of a nutritional supplement containing methylstenbolone

Ethical objections often limit the use of human volunteers for excretion studies with designer drugs. Metabolism studies are however essential to find the best markers of doping agents. Alternative models can therefore be a valuable tool for anti-doping laboratories to identify metabolites of new substances for inclusion in existing screening methods. Recently, a ‘nutritional’ supplement, named ‘Ultradrol’, was introduced on the market. This product contains, according to the label, 17α-methylstenbolone. Nevertheless, analysis of the content revealed the presence of both methylstenbolone and methasterone, a structurally closely related steroid. To elucidate the phase I metabolism of this steroid product an uPA+/+ -SCID chimeric mouse model and human liver microsomes (HLM) were used. Methylstenbolone was isolated from the supplement via HPLC fraction collection and administered to both models. By using HLM ten mono-hydroxylated metabolites (U1-U10) and a still unidentified derivative of methylstenbolone (U13) were detected. In the chimeric mouse urine only di-hydroxylated methylstenbolone derivatives (U11-U12) were identified. Neither methasterone nor its metabolites were detected after administration of methylstenbolone. Administration of the steroid product to both models resorted mainly in the detection of methasterone metabolites and these were very similar to those already described in literature. A MRM method on GC-triple quadrupole MS was developed to detect misuse of methylstenbolone. In a sample, previously tested positive for methasterone, methylstenbolone and U13 were additionally detected, indicating the use and the applicability of the developed method. The results of this study will be published elsewhere